[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:15:49.026394 22903 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.93.254:40305
I20260709 12:15:49.028561 22903 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:15:49.029994 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:49.052090 22910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:49.052240 22909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:49.052384 22912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:49.053930 22903 server_base.cc:1061] running on GCE node
I20260709 12:15:50.270610 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:50.270896 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:50.271167 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599350271142 us; error 0 us; skew 500 ppm
I20260709 12:15:50.272145 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:50.278748 22903 webserver.cc:533] Webserver started at http://127.22.93.254:43147/ using document root <none> and password file <none>
I20260709 12:15:50.279788 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:50.280010 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:50.280467 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:50.287191 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/master-0-root/instance:
uuid: "13dd589a12404f71a4ab2518f1ae363d"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-k289"
I20260709 12:15:50.296330 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:15:50.302464 22918 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.303913 22903 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:15:50.304270 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/master-0-root
uuid: "13dd589a12404f71a4ab2518f1ae363d"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-k289"
I20260709 12:15:50.304598 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:50.358245 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:50.360146 22903 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:15:50.360612 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:50.446230 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.254:40305
I20260709 12:15:50.446309 22969 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.254:40305 every 8 connection(s)
I20260709 12:15:50.455433 22970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:50.481021 22970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d: Bootstrap starting.
I20260709 12:15:50.488293 22970 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:50.490554 22970 log.cc:826] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d: Log is configured to *not* fsync() on all Append() calls
I20260709 12:15:50.496173 22970 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d: No bootstrap required, opened a new log
I20260709 12:15:50.518889 22970 raft_consensus.cc:359] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dd589a12404f71a4ab2518f1ae363d" member_type: VOTER }
I20260709 12:15:50.519619 22970 raft_consensus.cc:385] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:50.519963 22970 raft_consensus.cc:740] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13dd589a12404f71a4ab2518f1ae363d, State: Initialized, Role: FOLLOWER
I20260709 12:15:50.521064 22970 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dd589a12404f71a4ab2518f1ae363d" member_type: VOTER }
I20260709 12:15:50.521639 22970 raft_consensus.cc:399] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:15:50.521977 22970 raft_consensus.cc:493] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:15:50.522369 22970 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:50.527153 22970 raft_consensus.cc:515] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dd589a12404f71a4ab2518f1ae363d" member_type: VOTER }
I20260709 12:15:50.528012 22970 leader_election.cc:304] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13dd589a12404f71a4ab2518f1ae363d; no voters: 
I20260709 12:15:50.530062 22970 leader_election.cc:290] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:15:50.530498 22973 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:50.533645 22973 raft_consensus.cc:697] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 1 LEADER]: Becoming Leader. State: Replica: 13dd589a12404f71a4ab2518f1ae363d, State: Running, Role: LEADER
I20260709 12:15:50.534747 22973 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dd589a12404f71a4ab2518f1ae363d" member_type: VOTER }
I20260709 12:15:50.535982 22970 sys_catalog.cc:565] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:15:50.547158 22974 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13dd589a12404f71a4ab2518f1ae363d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dd589a12404f71a4ab2518f1ae363d" member_type: VOTER } }
I20260709 12:15:50.547111 22975 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13dd589a12404f71a4ab2518f1ae363d. Latest consensus state: current_term: 1 leader_uuid: "13dd589a12404f71a4ab2518f1ae363d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13dd589a12404f71a4ab2518f1ae363d" member_type: VOTER } }
I20260709 12:15:50.548054 22974 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:50.548056 22975 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [sys.catalog]: This master's current role is: LEADER
I20260709 12:15:50.552171 22981 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:15:50.565008 22981 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:15:50.571103 22903 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:15:50.586146 22981 catalog_manager.cc:1383] Generated new cluster ID: 620512090c4746a99ff5bcc7466ba8a4
I20260709 12:15:50.586524 22981 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:15:50.601528 22981 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:15:50.603508 22981 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:15:50.617035 22981 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d: Generated new TSK 0
I20260709 12:15:50.618486 22981 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:15:50.639145 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:50.650837 22992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.652484 22993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:50.657238 22903 server_base.cc:1061] running on GCE node
W20260709 12:15:50.657333 22995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:50.658327 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:50.658529 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:50.658775 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599350658734 us; error 0 us; skew 500 ppm
I20260709 12:15:50.659476 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:50.664692 22903 webserver.cc:533] Webserver started at http://127.22.93.193:45287/ using document root <none> and password file <none>
I20260709 12:15:50.665356 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:50.665817 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:50.666195 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:50.667608 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-0-root/instance:
uuid: "644a670f55a9495b97a3621521f9493a"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-k289"
I20260709 12:15:50.674618 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:15:50.680339 23000 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.681337 22903 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:15:50.681764 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "644a670f55a9495b97a3621521f9493a"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-k289"
I20260709 12:15:50.682202 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:50.717358 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:50.719650 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:50.723130 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:50.729799 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:50.730202 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.730571 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:50.730829 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.845820 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:42131
I20260709 12:15:50.845922 23062 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:42131 every 8 connection(s)
I20260709 12:15:50.855351 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:15:50.865615 23067 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.868155 23068 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:15:50.878600 23070 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:50.882756 22903 server_base.cc:1061] running on GCE node
I20260709 12:15:50.884047 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:50.884377 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:50.884598 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599350884578 us; error 0 us; skew 500 ppm
I20260709 12:15:50.885470 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:50.889020 23063 heartbeater.cc:344] Connected to a master server at 127.22.93.254:40305
I20260709 12:15:50.889559 23063 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:50.890703 23063 heartbeater.cc:507] Master 127.22.93.254:40305 requested a full tablet report, sending...
I20260709 12:15:50.891575 22903 webserver.cc:533] Webserver started at http://127.22.93.194:42137/ using document root <none> and password file <none>
I20260709 12:15:50.892336 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:50.892609 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:50.892967 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:50.894371 22935 ts_manager.cc:194] Registered new tserver with Master: 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131)
I20260709 12:15:50.894649 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-1-root/instance:
uuid: "9acc9ee56e54412c933503a95e6074b0"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-k289"
I20260709 12:15:50.896965 22935 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:58622
I20260709 12:15:50.902343 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:15:50.908743 23075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.909757 22903 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:15:50.910117 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-1-root
uuid: "9acc9ee56e54412c933503a95e6074b0"
format_stamp: "Formatted at 2026-07-09 12:15:50 on dist-test-slave-k289"
I20260709 12:15:50.910517 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:50.933029 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:50.935063 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:50.938079 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:50.942329 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:50.942618 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:50.942912 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:50.943147 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:15:51.047849 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.194:38419
I20260709 12:15:51.047916 23137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.194:38419 every 8 connection(s)
I20260709 12:15:51.054322 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260709 12:15:51.070254 23138 heartbeater.cc:344] Connected to a master server at 127.22.93.254:40305
I20260709 12:15:51.070779 23138 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:51.072181 23138 heartbeater.cc:507] Master 127.22.93.254:40305 requested a full tablet report, sending...
W20260709 12:15:51.072345 23141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:51.075318 22935 ts_manager.cc:194] Registered new tserver with Master: 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:51.075573 22903 server_base.cc:1061] running on GCE node
W20260709 12:15:51.075762 23142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:51.077373 22935 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56424
W20260709 12:15:51.077492 23144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:15:51.078696 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:15:51.078965 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:15:51.079192 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599351079174 us; error 0 us; skew 500 ppm
I20260709 12:15:51.079998 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:15:51.083052 22903 webserver.cc:533] Webserver started at http://127.22.93.195:46015/ using document root <none> and password file <none>
I20260709 12:15:51.083732 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:15:51.083983 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:15:51.084327 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:15:51.085922 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-2-root/instance:
uuid: "00913dfef0304840b0b59b385a3c571f"
format_stamp: "Formatted at 2026-07-09 12:15:51 on dist-test-slave-k289"
I20260709 12:15:51.092644 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.003s
I20260709 12:15:51.097404 23149 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:51.098448 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:15:51.098842 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-2-root
uuid: "00913dfef0304840b0b59b385a3c571f"
format_stamp: "Formatted at 2026-07-09 12:15:51 on dist-test-slave-k289"
I20260709 12:15:51.099280 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599348838328-22903-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:15:51.159951 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:15:51.161738 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:15:51.163465 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:15:51.166069 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:15:51.166356 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:51.166637 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:15:51.166854 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:15:51.280232 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.195:34833
I20260709 12:15:51.280427 23211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.195:34833 every 8 connection(s)
I20260709 12:15:51.300619 23212 heartbeater.cc:344] Connected to a master server at 127.22.93.254:40305
I20260709 12:15:51.301162 23212 heartbeater.cc:461] Registering TS with master...
I20260709 12:15:51.302387 23212 heartbeater.cc:507] Master 127.22.93.254:40305 requested a full tablet report, sending...
I20260709 12:15:51.304872 22935 ts_manager.cc:194] Registered new tserver with Master: 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:51.305317 22903 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019083536s
I20260709 12:15:51.306716 22935 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56438
I20260709 12:15:51.365821 22935 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56440:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:15:51.370247 22935 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:15:51.501513 23103 tablet_service.cc:1511] Processing CreateTablet for tablet 1b99eb1c94d9406a9a5235850c23a334 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:51.507834 23174 tablet_service.cc:1511] Processing CreateTablet for tablet 1d096557add543d19d63cb64c9c15f02 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:51.507731 23100 tablet_service.cc:1511] Processing CreateTablet for tablet 1d096557add543d19d63cb64c9c15f02 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:51.512152 23103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b99eb1c94d9406a9a5235850c23a334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.511796 23101 tablet_service.cc:1511] Processing CreateTablet for tablet 41f6cb2b474b4ebe8c74377bfd9efcb7 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:51.505805 23177 tablet_service.cc:1511] Processing CreateTablet for tablet 1b99eb1c94d9406a9a5235850c23a334 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:51.514833 23176 tablet_service.cc:1511] Processing CreateTablet for tablet a41e0f548cfc4b239e855069d87af82c (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:51.516860 23175 tablet_service.cc:1511] Processing CreateTablet for tablet 41f6cb2b474b4ebe8c74377bfd9efcb7 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:51.507869 23102 tablet_service.cc:1511] Processing CreateTablet for tablet a41e0f548cfc4b239e855069d87af82c (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:51.518654 23099 tablet_service.cc:1511] Processing CreateTablet for tablet 00f25518694a414583a82b55d28454d6 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:51.521406 23101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f6cb2b474b4ebe8c74377bfd9efcb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.523343 23174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d096557add543d19d63cb64c9c15f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.524096 23100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d096557add543d19d63cb64c9c15f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.525018 23177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b99eb1c94d9406a9a5235850c23a334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.525682 23099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f25518694a414583a82b55d28454d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.528999 23175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f6cb2b474b4ebe8c74377bfd9efcb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.529366 23102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41e0f548cfc4b239e855069d87af82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.532685 23176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41e0f548cfc4b239e855069d87af82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.531642 23173 tablet_service.cc:1511] Processing CreateTablet for tablet 00f25518694a414583a82b55d28454d6 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:51.536808 23173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f25518694a414583a82b55d28454d6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:15:51.559940 22983 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:51.581625 23098 tablet_service.cc:1511] Processing CreateTablet for tablet ea5bbd78cc174df8a53a1cc887fb6969 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:51.583477 23098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5bbd78cc174df8a53a1cc887fb6969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.599783 23172 tablet_service.cc:1511] Processing CreateTablet for tablet ea5bbd78cc174df8a53a1cc887fb6969 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:51.601436 23172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5bbd78cc174df8a53a1cc887fb6969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.603199 23097 tablet_service.cc:1511] Processing CreateTablet for tablet af3785b4b18447e5810e769747b1e306 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:51.605134 23097 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3785b4b18447e5810e769747b1e306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.609874 23171 tablet_service.cc:1511] Processing CreateTablet for tablet af3785b4b18447e5810e769747b1e306 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:51.615006 23171 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3785b4b18447e5810e769747b1e306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.631834 23028 tablet_service.cc:1511] Processing CreateTablet for tablet 1b99eb1c94d9406a9a5235850c23a334 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:15:51.633592 23028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b99eb1c94d9406a9a5235850c23a334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.639081 23027 tablet_service.cc:1511] Processing CreateTablet for tablet a41e0f548cfc4b239e855069d87af82c (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:15:51.641669 23027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a41e0f548cfc4b239e855069d87af82c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.643183 23026 tablet_service.cc:1511] Processing CreateTablet for tablet 41f6cb2b474b4ebe8c74377bfd9efcb7 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:15:51.645689 23026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41f6cb2b474b4ebe8c74377bfd9efcb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.665593 23096 tablet_service.cc:1511] Processing CreateTablet for tablet 47a40fd692cb46e9a97550802a74d4ed (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:51.667891 23096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a40fd692cb46e9a97550802a74d4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.684470 23024 tablet_service.cc:1511] Processing CreateTablet for tablet 00f25518694a414583a82b55d28454d6 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:15:51.697269 23023 tablet_service.cc:1511] Processing CreateTablet for tablet ea5bbd78cc174df8a53a1cc887fb6969 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:15:51.705024 23024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00f25518694a414583a82b55d28454d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.707688 23025 tablet_service.cc:1511] Processing CreateTablet for tablet 1d096557add543d19d63cb64c9c15f02 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:15:51.715444 23021 tablet_service.cc:1511] Processing CreateTablet for tablet 47a40fd692cb46e9a97550802a74d4ed (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:51.716828 23025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d096557add543d19d63cb64c9c15f02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.707502 23022 tablet_service.cc:1511] Processing CreateTablet for tablet af3785b4b18447e5810e769747b1e306 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:15:51.721886 23021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a40fd692cb46e9a97550802a74d4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.708559 23170 tablet_service.cc:1511] Processing CreateTablet for tablet 47a40fd692cb46e9a97550802a74d4ed (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:15:51.725982 23170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47a40fd692cb46e9a97550802a74d4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.729863 23023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea5bbd78cc174df8a53a1cc887fb6969. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.730108 23230 tablet_bootstrap.cc:492] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0: Bootstrap starting.
I20260709 12:15:51.746050 23022 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af3785b4b18447e5810e769747b1e306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.865022 23020 tablet_service.cc:1511] Processing CreateTablet for tablet e091cad3d2d64ea08c86210eec7729e2 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
W20260709 12:15:51.850371 22919 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.93.194:38419, user_credentials={real_user=slave}} blocked reactor thread for 69769.2us
I20260709 12:15:51.868485 23020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e091cad3d2d64ea08c86210eec7729e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.871235 23230 tablet_bootstrap.cc:654] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:51.898429 23099 tablet_service.cc:1511] Processing CreateTablet for tablet e091cad3d2d64ea08c86210eec7729e2 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:51.900580 23063 heartbeater.cc:499] Master 127.22.93.254:40305 was elected leader, sending a full tablet report...
I20260709 12:15:51.900759 23099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e091cad3d2d64ea08c86210eec7729e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.906498 23174 tablet_service.cc:1511] Processing CreateTablet for tablet e091cad3d2d64ea08c86210eec7729e2 (DEFAULT_TABLE table=test-workload [id=e99645fd73cf4d96a547031d75c0afe3]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:15:51.908100 23174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e091cad3d2d64ea08c86210eec7729e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:15:51.959036 23231 tablet_bootstrap.cc:492] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f: Bootstrap starting.
I20260709 12:15:51.972369 23230 tablet_bootstrap.cc:492] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0: No bootstrap required, opened a new log
I20260709 12:15:51.973707 23230 ts_tablet_manager.cc:1403] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0: Time spent bootstrapping tablet: real 0.263s	user 0.011s	sys 0.012s
I20260709 12:15:52.002120 23231 tablet_bootstrap.cc:654] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.021011 23230 raft_consensus.cc:359] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.022369 23230 raft_consensus.cc:385] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.022810 23230 raft_consensus.cc:740] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.045003 23233 tablet_bootstrap.cc:492] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a: Bootstrap starting.
I20260709 12:15:52.066303 23230 consensus_queue.cc:260] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.080626 23138 heartbeater.cc:499] Master 127.22.93.254:40305 was elected leader, sending a full tablet report...
I20260709 12:15:52.082898 23233 tablet_bootstrap.cc:654] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.086761 23231 tablet_bootstrap.cc:492] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f: No bootstrap required, opened a new log
I20260709 12:15:52.087380 23231 ts_tablet_manager.cc:1403] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f: Time spent bootstrapping tablet: real 0.170s	user 0.019s	sys 0.046s
I20260709 12:15:52.101439 23230 ts_tablet_manager.cc:1434] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0: Time spent starting tablet: real 0.127s	user 0.013s	sys 0.017s
I20260709 12:15:52.103082 23230 tablet_bootstrap.cc:492] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0: Bootstrap starting.
I20260709 12:15:52.104460 23231 raft_consensus.cc:359] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.105569 23231 raft_consensus.cc:385] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.105963 23231 raft_consensus.cc:740] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.109679 23231 consensus_queue.cc:260] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.111631 23233 tablet_bootstrap.cc:492] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a: No bootstrap required, opened a new log
I20260709 12:15:52.112203 23233 ts_tablet_manager.cc:1403] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a: Time spent bootstrapping tablet: real 0.069s	user 0.027s	sys 0.006s
I20260709 12:15:52.113766 23230 tablet_bootstrap.cc:654] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.115845 23233 raft_consensus.cc:359] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.116648 23233 raft_consensus.cc:385] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.117019 23233 raft_consensus.cc:740] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.118383 23212 heartbeater.cc:499] Master 127.22.93.254:40305 was elected leader, sending a full tablet report...
I20260709 12:15:52.118923 23233 consensus_queue.cc:260] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.124492 23231 ts_tablet_manager.cc:1434] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.004s
I20260709 12:15:52.125080 23230 tablet_bootstrap.cc:492] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0: No bootstrap required, opened a new log
I20260709 12:15:52.125630 23230 ts_tablet_manager.cc:1403] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.001s
I20260709 12:15:52.125893 23231 tablet_bootstrap.cc:492] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f: Bootstrap starting.
I20260709 12:15:52.130004 23230 raft_consensus.cc:359] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.130888 23230 raft_consensus.cc:385] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.131238 23230 raft_consensus.cc:740] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.132153 23230 consensus_queue.cc:260] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.134641 23230 ts_tablet_manager.cc:1434] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:15:52.136229 23231 tablet_bootstrap.cc:654] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.136407 23233 ts_tablet_manager.cc:1434] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.001s
I20260709 12:15:52.137678 23233 tablet_bootstrap.cc:492] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a: Bootstrap starting.
I20260709 12:15:52.139302 23230 tablet_bootstrap.cc:492] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0: Bootstrap starting.
I20260709 12:15:52.149238 23239 raft_consensus.cc:493] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.149950 23239 raft_consensus.cc:515] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.151849 23235 raft_consensus.cc:493] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.152395 23235 raft_consensus.cc:515] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.155351 23235 leader_election.cc:290] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.158952 23233 tablet_bootstrap.cc:654] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.161067 23239 leader_election.cc:290] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.165047 23230 tablet_bootstrap.cc:654] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.166728 23231 tablet_bootstrap.cc:492] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f: No bootstrap required, opened a new log
I20260709 12:15:52.167410 23231 ts_tablet_manager.cc:1403] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f: Time spent bootstrapping tablet: real 0.042s	user 0.004s	sys 0.015s
I20260709 12:15:52.171980 23231 raft_consensus.cc:359] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.172811 23231 raft_consensus.cc:385] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.173143 23231 raft_consensus.cc:740] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.174000 23231 consensus_queue.cc:260] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.176892 23231 ts_tablet_manager.cc:1434] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:15:52.178071 23231 tablet_bootstrap.cc:492] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f: Bootstrap starting.
I20260709 12:15:52.193822 23231 tablet_bootstrap.cc:654] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.196148 23230 tablet_bootstrap.cc:492] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0: No bootstrap required, opened a new log
I20260709 12:15:52.198002 23230 ts_tablet_manager.cc:1403] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.007s
I20260709 12:15:52.208421 23230 raft_consensus.cc:359] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.209545 23230 raft_consensus.cc:385] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.210042 23233 tablet_bootstrap.cc:492] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a: No bootstrap required, opened a new log
I20260709 12:15:52.209951 23230 raft_consensus.cc:740] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.211239 23230 consensus_queue.cc:260] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.214347 23230 ts_tablet_manager.cc:1434] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:15:52.215711 23230 tablet_bootstrap.cc:492] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0: Bootstrap starting.
I20260709 12:15:52.223338 23233 ts_tablet_manager.cc:1403] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a: Time spent bootstrapping tablet: real 0.086s	user 0.008s	sys 0.020s
I20260709 12:15:52.225087 23230 tablet_bootstrap.cc:654] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.228001 23233 raft_consensus.cc:359] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.229001 23233 raft_consensus.cc:385] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.229418 23233 raft_consensus.cc:740] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.230465 23233 consensus_queue.cc:260] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.233703 23233 ts_tablet_manager.cc:1434] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:15:52.236135 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.239246 23233 tablet_bootstrap.cc:492] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a: Bootstrap starting.
W20260709 12:15:52.240630 23077 leader_election.cc:343] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.243667 23239 raft_consensus.cc:493] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.242272 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:52.244273 23239 raft_consensus.cc:515] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.245067 23113 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 0.
I20260709 12:15:52.248090 23239 leader_election.cc:290] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.250533 23237 raft_consensus.cc:493] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.249095 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
I20260709 12:15:52.251452 23038 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 0.
I20260709 12:15:52.251340 23237 raft_consensus.cc:515] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.252791 23001 leader_election.cc:304] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.257603 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:52.258888 23079 leader_election.cc:304] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 00913dfef0304840b0b59b385a3c571f
I20260709 12:15:52.259586 23113 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 0.
I20260709 12:15:52.260689 23235 raft_consensus.cc:2804] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.261236 23239 raft_consensus.cc:2804] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.261799 23239 raft_consensus.cc:493] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.262178 23239 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.262285 23001 leader_election.cc:304] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.261104 23235 raft_consensus.cc:493] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.264650 23235 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.270538 23237 leader_election.cc:290] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:52.286186 23231 tablet_bootstrap.cc:492] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f: No bootstrap required, opened a new log
I20260709 12:15:52.287128 23231 ts_tablet_manager.cc:1403] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f: Time spent bootstrapping tablet: real 0.109s	user 0.020s	sys 0.017s
I20260709 12:15:52.293052 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.298749 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.315647 23230 tablet_bootstrap.cc:492] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0: No bootstrap required, opened a new log
I20260709 12:15:52.316562 23230 ts_tablet_manager.cc:1403] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0: Time spent bootstrapping tablet: real 0.101s	user 0.024s	sys 0.012s
W20260709 12:15:52.319298 23002 leader_election.cc:343] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:52.326654 23002 leader_election.cc:343] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.332742 23239 raft_consensus.cc:515] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
W20260709 12:15:52.330600 23001 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:38419, user_credentials={real_user=slave}} blocked reactor thread for 68441.3us
W20260709 12:15:52.337862 23139 tablet.cc:2406] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:52.340095 23233 tablet_bootstrap.cc:654] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.342083 23231 raft_consensus.cc:359] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.344837 23231 raft_consensus.cc:385] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.345028 23256 raft_consensus.cc:493] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.345176 23231 raft_consensus.cc:740] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.345247 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
W20260709 12:15:52.347146 23213 tablet.cc:2406] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:15:52.348039 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:52.348840 23235 raft_consensus.cc:515] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.346879 23231 consensus_queue.cc:260] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.350668 23253 raft_consensus.cc:2804] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:15:52.350673 23002 leader_election.cc:343] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.350639 23230 raft_consensus.cc:359] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.353713 23113 raft_consensus.cc:2393] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 644a670f55a9495b97a3621521f9493a in current term 1: Already voted for candidate 9acc9ee56e54412c933503a95e6074b0 in this term.
I20260709 12:15:52.353931 23230 raft_consensus.cc:385] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.349995 23239 leader_election.cc:290] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.356911 23235 leader_election.cc:290] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.354753 23230 raft_consensus.cc:740] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.359373 23230 consensus_queue.cc:260] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.354502 23253 raft_consensus.cc:493] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.360798 23001 leader_election.cc:304] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 644a670f55a9495b97a3621521f9493a; no voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0
I20260709 12:15:52.363598 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:52.363708 23239 raft_consensus.cc:2749] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.364161 23230 ts_tablet_manager.cc:1434] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0: Time spent starting tablet: real 0.047s	user 0.010s	sys 0.000s
W20260709 12:15:52.365376 23077 leader_election.cc:343] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.366202 23230 tablet_bootstrap.cc:492] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0: Bootstrap starting.
I20260709 12:15:52.345690 23256 raft_consensus.cc:515] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.372763 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:52.362707 23253 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.374071 23038 raft_consensus.cc:2393] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9acc9ee56e54412c933503a95e6074b0 in current term 1: Already voted for candidate 644a670f55a9495b97a3621521f9493a in this term.
I20260709 12:15:52.375592 23079 leader_election.cc:304] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9acc9ee56e54412c933503a95e6074b0; no voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a
I20260709 12:15:52.376922 23235 raft_consensus.cc:2749] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.379402 23231 ts_tablet_manager.cc:1434] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f: Time spent starting tablet: real 0.085s	user 0.011s	sys 0.001s
I20260709 12:15:52.380537 23231 tablet_bootstrap.cc:492] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f: Bootstrap starting.
I20260709 12:15:52.381229 23233 tablet_bootstrap.cc:492] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a: No bootstrap required, opened a new log
I20260709 12:15:52.381780 23233 ts_tablet_manager.cc:1403] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a: Time spent bootstrapping tablet: real 0.147s	user 0.006s	sys 0.028s
I20260709 12:15:52.385422 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.385776 23230 tablet_bootstrap.cc:654] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:52.388813 23077 leader_election.cc:343] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.387032 23256 leader_election.cc:290] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833), 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131)
I20260709 12:15:52.392362 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
W20260709 12:15:52.397662 23079 leader_election.cc:343] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.398211 23079 leader_election.cc:304] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9acc9ee56e54412c933503a95e6074b0; no voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a
I20260709 12:15:52.399085 23256 raft_consensus.cc:2749] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.398806 23233 raft_consensus.cc:359] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.399619 23233 raft_consensus.cc:385] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.401631 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
I20260709 12:15:52.401782 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:52.400259 23233 raft_consensus.cc:740] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Initialized, Role: FOLLOWER
W20260709 12:15:52.404132 23153 leader_election.cc:343] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:52.405260 23150 leader_election.cc:343] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.404958 23233 consensus_queue.cc:260] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.405728 23150 leader_election.cc:304] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f; no voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0
I20260709 12:15:52.407438 23237 raft_consensus.cc:2749] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.411739 23233 ts_tablet_manager.cc:1434] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 12:15:52.412951 23233 tablet_bootstrap.cc:492] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a: Bootstrap starting.
I20260709 12:15:52.414804 23253 raft_consensus.cc:515] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.419214 23230 tablet_bootstrap.cc:492] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0: No bootstrap required, opened a new log
I20260709 12:15:52.419997 23230 ts_tablet_manager.cc:1403] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.003s
I20260709 12:15:52.421999 23233 tablet_bootstrap.cc:654] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.423924 23230 raft_consensus.cc:359] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.424829 23230 raft_consensus.cc:385] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.425343 23230 raft_consensus.cc:740] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.426514 23230 consensus_queue.cc:260] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.427728 23231 tablet_bootstrap.cc:654] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.430253 23256 raft_consensus.cc:493] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.430876 23256 raft_consensus.cc:515] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.432852 23230 ts_tablet_manager.cc:1434] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:15:52.433200 23256 leader_election.cc:290] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.434293 23230 tablet_bootstrap.cc:492] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0: Bootstrap starting.
I20260709 12:15:52.435182 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
W20260709 12:15:52.439302 23079 leader_election.cc:343] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.439602 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.440290 23186 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 0.
I20260709 12:15:52.442435 23077 leader_election.cc:304] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 644a670f55a9495b97a3621521f9493a
I20260709 12:15:52.443399 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:52.443992 23113 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.448395 23256 raft_consensus.cc:2804] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.449026 23256 raft_consensus.cc:493] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.449582 23256 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.459298 23113 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 1.
I20260709 12:15:52.459698 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:52.461270 23253 leader_election.cc:290] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.462915 23001 leader_election.cc:304] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.466670 23253 raft_consensus.cc:2804] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:15:52.466679 23002 leader_election.cc:343] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.467419 23253 raft_consensus.cc:697] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:52.469944 23233 tablet_bootstrap.cc:492] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a: No bootstrap required, opened a new log
I20260709 12:15:52.470499 23233 ts_tablet_manager.cc:1403] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a: Time spent bootstrapping tablet: real 0.058s	user 0.020s	sys 0.031s
I20260709 12:15:52.471203 23231 tablet_bootstrap.cc:492] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f: No bootstrap required, opened a new log
I20260709 12:15:52.468822 23253 consensus_queue.cc:237] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.471761 23231 ts_tablet_manager.cc:1403] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.016s
I20260709 12:15:52.472558 23256 raft_consensus.cc:515] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.473331 23230 tablet_bootstrap.cc:654] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.476318 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:52.476687 23231 raft_consensus.cc:359] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.477785 23231 raft_consensus.cc:385] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:15:52.478024 23079 leader_election.cc:343] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.478223 23231 raft_consensus.cc:740] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.485872 23231 consensus_queue.cc:260] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.488356 23256 leader_election.cc:290] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.488802 23231 ts_tablet_manager.cc:1434] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.009s
I20260709 12:15:52.489969 23231 tablet_bootstrap.cc:492] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f: Bootstrap starting.
I20260709 12:15:52.486963 23233 raft_consensus.cc:359] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.490695 23233 raft_consensus.cc:385] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.490557 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:52.491080 23233 raft_consensus.cc:740] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.491357 23186 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.491945 23233 consensus_queue.cc:260] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.496668 23233 ts_tablet_manager.cc:1434] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:15:52.497839 23233 tablet_bootstrap.cc:492] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a: Bootstrap starting.
I20260709 12:15:52.497933 23231 tablet_bootstrap.cc:654] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.499130 23230 tablet_bootstrap.cc:492] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0: No bootstrap required, opened a new log
I20260709 12:15:52.500200 23230 ts_tablet_manager.cc:1403] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.012s
I20260709 12:15:52.504153 23230 raft_consensus.cc:359] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.504971 23230 raft_consensus.cc:385] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.505295 23230 raft_consensus.cc:740] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.506227 23230 consensus_queue.cc:260] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.513166 23230 ts_tablet_manager.cc:1434] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 12:15:52.514705 23230 tablet_bootstrap.cc:492] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0: Bootstrap starting.
I20260709 12:15:52.517148 23233 tablet_bootstrap.cc:654] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.525087 23186 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 1.
I20260709 12:15:52.531741 23230 tablet_bootstrap.cc:654] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.532521 23256 raft_consensus.cc:493] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.535665 23256 raft_consensus.cc:515] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.535426 22935 catalog_manager.cc:5697] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 0 to 1, leader changed from <none> to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 1 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.537557 23077 leader_election.cc:304] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 644a670f55a9495b97a3621521f9493a
I20260709 12:15:52.538015 23256 leader_election.cc:290] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.538591 23256 raft_consensus.cc:2804] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.539008 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
I20260709 12:15:52.540073 23256 raft_consensus.cc:697] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:15:52.541250 23233 tablet_bootstrap.cc:492] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a: No bootstrap required, opened a new log
I20260709 12:15:52.541240 23256 consensus_queue.cc:237] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.541945 23233 ts_tablet_manager.cc:1403] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a: Time spent bootstrapping tablet: real 0.044s	user 0.021s	sys 0.000s
I20260709 12:15:52.542337 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
W20260709 12:15:52.543146 23079 leader_election.cc:343] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:52.544220 23077 leader_election.cc:343] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.544667 23077 leader_election.cc:304] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9acc9ee56e54412c933503a95e6074b0; no voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a
I20260709 12:15:52.545866 23235 raft_consensus.cc:2749] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.549593 23233 raft_consensus.cc:359] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.550683 23233 raft_consensus.cc:385] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.551164 23233 raft_consensus.cc:740] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.552191 23233 consensus_queue.cc:260] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
W20260709 12:15:52.563041 22983 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:52.568135 23233 ts_tablet_manager.cc:1434] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260709 12:15:52.569725 23233 tablet_bootstrap.cc:492] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a: Bootstrap starting.
I20260709 12:15:52.586429 23231 tablet_bootstrap.cc:492] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f: No bootstrap required, opened a new log
I20260709 12:15:52.587530 23231 ts_tablet_manager.cc:1403] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f: Time spent bootstrapping tablet: real 0.098s	user 0.020s	sys 0.050s
I20260709 12:15:52.591162 22933 catalog_manager.cc:5697] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.593719 23230 tablet_bootstrap.cc:492] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0: No bootstrap required, opened a new log
I20260709 12:15:52.594525 23230 ts_tablet_manager.cc:1403] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.006s
I20260709 12:15:52.593672 23231 raft_consensus.cc:359] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.596017 23231 raft_consensus.cc:385] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.596685 23233 tablet_bootstrap.cc:654] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.596536 23231 raft_consensus.cc:740] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.597645 23231 consensus_queue.cc:260] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.604192 23231 ts_tablet_manager.cc:1434] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:15:52.605315 23231 tablet_bootstrap.cc:492] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f: Bootstrap starting.
I20260709 12:15:52.612037 23230 raft_consensus.cc:359] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.612989 23230 raft_consensus.cc:385] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.613555 23230 raft_consensus.cc:740] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.613917 23253 raft_consensus.cc:493] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.614470 23230 consensus_queue.cc:260] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.614595 23253 raft_consensus.cc:515] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.617105 23230 ts_tablet_manager.cc:1434] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:15:52.618188 23230 tablet_bootstrap.cc:492] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0: Bootstrap starting.
I20260709 12:15:52.627236 23231 tablet_bootstrap.cc:654] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.629366 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3785b4b18447e5810e769747b1e306" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:52.629709 23253 leader_election.cc:290] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.630451 23239 raft_consensus.cc:493] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.631093 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3785b4b18447e5810e769747b1e306" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.631155 23239 raft_consensus.cc:515] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
W20260709 12:15:52.631094 23001 leader_election.cc:343] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:15:52.633353 23002 leader_election.cc:343] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.634938 23239 leader_election.cc:290] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.633801 23002 leader_election.cc:304] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 644a670f55a9495b97a3621521f9493a; no voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0
I20260709 12:15:52.637840 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:52.638691 23113 raft_consensus.cc:2468] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 0.
I20260709 12:15:52.638831 23239 raft_consensus.cc:2749] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.640210 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.640393 23001 leader_election.cc:304] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.641490 23239 raft_consensus.cc:2804] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.641937 23239 raft_consensus.cc:493] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.642191 23233 tablet_bootstrap.cc:492] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a: No bootstrap required, opened a new log
I20260709 12:15:52.642388 23239 raft_consensus.cc:3060] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:15:52.642293 23002 leader_election.cc:343] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.642781 23233 ts_tablet_manager.cc:1403] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.014s
I20260709 12:15:52.649643 23233 raft_consensus.cc:359] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.650489 23233 raft_consensus.cc:385] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.650843 23233 raft_consensus.cc:740] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.651750 23233 consensus_queue.cc:260] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.660756 23230 tablet_bootstrap.cc:654] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.663635 23239 raft_consensus.cc:515] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.665256 23233 ts_tablet_manager.cc:1434] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 12:15:52.666285 23231 tablet_bootstrap.cc:492] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f: No bootstrap required, opened a new log
I20260709 12:15:52.667092 23231 ts_tablet_manager.cc:1403] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f: Time spent bootstrapping tablet: real 0.062s	user 0.019s	sys 0.007s
I20260709 12:15:52.668100 23233 tablet_bootstrap.cc:492] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a: Bootstrap starting.
I20260709 12:15:52.670936 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:52.670687 23231 raft_consensus.cc:359] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.671609 23113 raft_consensus.cc:3060] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.671648 23231 raft_consensus.cc:385] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.672163 23231 raft_consensus.cc:740] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.673192 23231 consensus_queue.cc:260] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.675992 23231 ts_tablet_manager.cc:1434] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.005s
I20260709 12:15:52.677172 23231 tablet_bootstrap.cc:492] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f: Bootstrap starting.
I20260709 12:15:52.679659 23233 tablet_bootstrap.cc:654] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.685930 23231 tablet_bootstrap.cc:654] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.688405 23230 tablet_bootstrap.cc:492] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0: No bootstrap required, opened a new log
I20260709 12:15:52.689103 23230 ts_tablet_manager.cc:1403] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.005s
I20260709 12:15:52.692193 23230 raft_consensus.cc:359] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.692982 23230 raft_consensus.cc:385] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.693256 23230 raft_consensus.cc:740] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.693967 23230 consensus_queue.cc:260] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.696528 23230 ts_tablet_manager.cc:1434] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:15:52.700891 23230 tablet_bootstrap.cc:492] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0: Bootstrap starting.
I20260709 12:15:52.700891 23113 raft_consensus.cc:2468] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 1.
I20260709 12:15:52.702680 23001 leader_election.cc:304] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.703629 23253 raft_consensus.cc:2804] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.710166 23230 tablet_bootstrap.cc:654] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.711454 23239 leader_election.cc:290] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.711910 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
W20260709 12:15:52.714707 23002 leader_election.cc:343] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.716931 23253 raft_consensus.cc:697] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:52.718108 23253 consensus_queue.cc:237] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.720914 23256 raft_consensus.cc:493] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.721611 23256 raft_consensus.cc:515] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.724529 23256 leader_election.cc:290] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.725473 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3785b4b18447e5810e769747b1e306" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
I20260709 12:15:52.726202 23038 raft_consensus.cc:2468] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 0.
I20260709 12:15:52.726280 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3785b4b18447e5810e769747b1e306" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.726966 23186 raft_consensus.cc:2468] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 0.
I20260709 12:15:52.727504 23079 leader_election.cc:304] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.730268 23256 raft_consensus.cc:2804] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.730793 23256 raft_consensus.cc:493] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.731288 23256 raft_consensus.cc:3060] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.732197 23233 tablet_bootstrap.cc:492] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a: No bootstrap required, opened a new log
I20260709 12:15:52.732904 23233 ts_tablet_manager.cc:1403] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.044s
I20260709 12:15:52.739176 23233 raft_consensus.cc:359] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.740028 23233 raft_consensus.cc:385] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.740389 23233 raft_consensus.cc:740] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.741429 23233 consensus_queue.cc:260] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.742494 23253 raft_consensus.cc:493] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.743019 23253 raft_consensus.cc:515] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.743510 22935 catalog_manager.cc:5697] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 0 to 1, leader changed from <none> to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 1 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.750299 23230 tablet_bootstrap.cc:492] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0: No bootstrap required, opened a new log
I20260709 12:15:52.750751 23230 ts_tablet_manager.cc:1403] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.004s
I20260709 12:15:52.751734 23237 raft_consensus.cc:493] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.752287 23237 raft_consensus.cc:515] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.749091 23277 raft_consensus.cc:493] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.753625 23230 raft_consensus.cc:359] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.753551 23277 raft_consensus.cc:515] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.754230 23230 raft_consensus.cc:385] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.754523 23230 raft_consensus.cc:740] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.754652 23237 leader_election.cc:290] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:52.755776 23256 raft_consensus.cc:515] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.756122 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:52.758116 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.758818 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:52.759171 23186 raft_consensus.cc:2468] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 0.
I20260709 12:15:52.759438 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
I20260709 12:15:52.760290 23113 raft_consensus.cc:2393] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00913dfef0304840b0b59b385a3c571f in current term 1: Already voted for candidate 644a670f55a9495b97a3621521f9493a in this term.
I20260709 12:15:52.760977 23230 consensus_queue.cc:260] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.759554 23112 raft_consensus.cc:2468] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 0.
I20260709 12:15:52.762585 23150 leader_election.cc:304] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f; no voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0
I20260709 12:15:52.758296 23277 leader_election.cc:290] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.763552 23230 ts_tablet_manager.cc:1434] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:15:52.763955 23237 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.765304 23233 ts_tablet_manager.cc:1434] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:15:52.760658 23002 leader_election.cc:304] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:15:52.766319 23233 tablet_bootstrap.cc:492] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a: Bootstrap starting.
I20260709 12:15:52.770056 23235 raft_consensus.cc:493] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.770604 23235 raft_consensus.cc:515] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.772862 23235 leader_election.cc:290] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.773919 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e091cad3d2d64ea08c86210eec7729e2" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
I20260709 12:15:52.775068 23233 tablet_bootstrap.cc:654] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a: Neither blocks nor log segments found. Creating new log.
W20260709 12:15:52.775597 23079 leader_election.cc:343] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.774854 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e091cad3d2d64ea08c86210eec7729e2" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
W20260709 12:15:52.780283 23077 leader_election.cc:343] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:15:52.780982 23231 tablet_bootstrap.cc:492] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f: No bootstrap required, opened a new log
I20260709 12:15:52.780800 23077 leader_election.cc:304] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9acc9ee56e54412c933503a95e6074b0; no voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a
I20260709 12:15:52.782166 23235 raft_consensus.cc:2749] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.782572 23277 raft_consensus.cc:2804] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.782974 23277 raft_consensus.cc:493] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.783386 23277 raft_consensus.cc:3060] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.786092 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.786811 23186 raft_consensus.cc:2468] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 0.
I20260709 12:15:52.788672 23002 leader_election.cc:304] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:15:52.783248 23231 ts_tablet_manager.cc:1403] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.027s
I20260709 12:15:52.789559 23239 raft_consensus.cc:2804] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.790159 23239 raft_consensus.cc:493] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.790529 23239 raft_consensus.cc:3060] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.791886 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:52.792590 23112 raft_consensus.cc:2468] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 0.
I20260709 12:15:52.794099 23253 leader_election.cc:290] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:52.797874 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3785b4b18447e5810e769747b1e306" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:52.798839 23186 raft_consensus.cc:3060] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.797951 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af3785b4b18447e5810e769747b1e306" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:52.802186 23038 raft_consensus.cc:3060] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.798501 23239 raft_consensus.cc:515] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.805342 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:52.805984 23187 raft_consensus.cc:3060] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.812996 23256 leader_election.cc:290] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.813756 23187 raft_consensus.cc:2468] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 1.
I20260709 12:15:52.815263 23002 leader_election.cc:304] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:15:52.816107 23253 raft_consensus.cc:2804] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.811998 23186 raft_consensus.cc:2468] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 1.
I20260709 12:15:52.801679 23237 raft_consensus.cc:2749] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.820091 23077 leader_election.cc:304] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.821149 23239 leader_election.cc:290] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Requested vote from peers 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:52.822526 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:52.823338 23112 raft_consensus.cc:3060] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.824625 23277 raft_consensus.cc:515] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.828013 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:52.828176 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:52.828665 23113 raft_consensus.cc:3060] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.828861 23187 raft_consensus.cc:3060] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.822365 23231 raft_consensus.cc:359] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.835240 23231 raft_consensus.cc:385] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.835644 23231 raft_consensus.cc:740] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.836697 23231 consensus_queue.cc:260] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.839730 23231 ts_tablet_manager.cc:1434] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 12:15:52.820989 23256 raft_consensus.cc:2804] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.841364 23277 leader_election.cc:290] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.843101 23233 tablet_bootstrap.cc:492] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a: No bootstrap required, opened a new log
I20260709 12:15:52.843716 23233 ts_tablet_manager.cc:1403] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.054s
I20260709 12:15:52.844280 23256 raft_consensus.cc:697] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:15:52.843104 23231 tablet_bootstrap.cc:492] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f: Bootstrap starting.
I20260709 12:15:52.844863 23113 raft_consensus.cc:2468] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 1.
I20260709 12:15:52.844506 23187 raft_consensus.cc:2468] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 1.
I20260709 12:15:52.846148 23001 leader_election.cc:304] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.848814 23277 raft_consensus.cc:2804] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.848629 23256 consensus_queue.cc:237] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.849575 23277 raft_consensus.cc:697] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:52.850509 23277 consensus_queue.cc:237] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.847486 23112 raft_consensus.cc:2468] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 1.
I20260709 12:15:52.854763 23235 raft_consensus.cc:493] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.846652 23233 raft_consensus.cc:359] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.855336 23235 raft_consensus.cc:515] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.855885 23233 raft_consensus.cc:385] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.856228 23233 raft_consensus.cc:740] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.856928 23233 consensus_queue.cc:260] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.859026 23233 ts_tablet_manager.cc:1434] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:15:52.858914 23037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
I20260709 12:15:52.859839 23037 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 0.
I20260709 12:15:52.860067 23233 tablet_bootstrap.cc:492] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a: Bootstrap starting.
I20260709 12:15:52.852252 23038 raft_consensus.cc:2468] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 1.
I20260709 12:15:52.861127 23079 leader_election.cc:304] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.866928 23235 leader_election.cc:290] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.867877 23235 raft_consensus.cc:2804] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:52.868378 23235 raft_consensus.cc:493] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:52.868633 23233 tablet_bootstrap.cc:654] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.868698 23231 tablet_bootstrap.cc:654] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.869055 23235 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.876348 23239 raft_consensus.cc:493] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:52.876907 23239 raft_consensus.cc:515] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.880154 23253 raft_consensus.cc:697] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:52.880941 23239 leader_election.cc:290] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.881428 23253 consensus_queue.cc:237] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:15:52.881908 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.882464 23233 tablet_bootstrap.cc:492] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a: No bootstrap required, opened a new log
I20260709 12:15:52.882682 23187 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 0.
I20260709 12:15:52.882934 23233 ts_tablet_manager.cc:1403] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 12:15:52.884805 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:52.885673 23186 raft_consensus.cc:2393] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 644a670f55a9495b97a3621521f9493a in current term 1: Already voted for candidate 9acc9ee56e54412c933503a95e6074b0 in this term.
I20260709 12:15:52.886014 23233 raft_consensus.cc:359] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.886718 23233 raft_consensus.cc:385] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.883841 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:52.887013 23233 raft_consensus.cc:740] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.888314 23001 leader_election.cc:304] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 644a670f55a9495b97a3621521f9493a; no voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0
I20260709 12:15:52.888520 23233 consensus_queue.cc:260] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.890621 23239 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.890637 23233 ts_tablet_manager.cc:1434] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:15:52.894165 23235 raft_consensus.cc:515] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.901886 23239 raft_consensus.cc:2749] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:52.904940 23277 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:52.908181 23231 tablet_bootstrap.cc:492] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f: No bootstrap required, opened a new log
I20260709 12:15:52.909397 23231 ts_tablet_manager.cc:1403] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.000s
I20260709 12:15:52.911861 22935 catalog_manager.cc:5697] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.912549 23231 raft_consensus.cc:359] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.913305 23231 raft_consensus.cc:385] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.913661 23231 raft_consensus.cc:740] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.913738 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:52.914672 23186 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.914513 23231 consensus_queue.cc:260] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.916782 23231 ts_tablet_manager.cc:1434] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:15:52.917546 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:52.918165 23038 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:52.925231 23186 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 1.
I20260709 12:15:52.926632 23077 leader_election.cc:304] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:52.927736 23256 raft_consensus.cc:2804] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:52.928020 23231 tablet_bootstrap.cc:492] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f: Bootstrap starting.
I20260709 12:15:52.928534 23235 leader_election.cc:290] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 1 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:52.929278 23256 raft_consensus.cc:697] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:15:52.930485 23256 consensus_queue.cc:237] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.937678 22932 catalog_manager.cc:5697] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 0 to 1, leader changed from <none> to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 1 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:52.942613 23231 tablet_bootstrap.cc:654] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f: Neither blocks nor log segments found. Creating new log.
I20260709 12:15:52.925594 23038 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 1.
I20260709 12:15:52.949982 23277 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:52.950572 23231 tablet_bootstrap.cc:492] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f: No bootstrap required, opened a new log
I20260709 12:15:52.951191 23231 ts_tablet_manager.cc:1403] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 12:15:52.954315 23231 raft_consensus.cc:359] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.955686 23231 raft_consensus.cc:385] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:15:52.956040 23231 raft_consensus.cc:740] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Initialized, Role: FOLLOWER
I20260709 12:15:52.957010 23231 consensus_queue.cc:260] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:52.959951 23231 ts_tablet_manager.cc:1434] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:15:52.964188 22934 catalog_manager.cc:5697] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:52.978250 22932 catalog_manager.cc:5697] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 0 to 1, leader changed from <none> to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 1 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:53.041848 23237 raft_consensus.cc:493] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.042454 23237 raft_consensus.cc:515] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:53.044502 23256 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.045707 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e091cad3d2d64ea08c86210eec7729e2" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
I20260709 12:15:53.046519 23038 raft_consensus.cc:2468] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 0.
I20260709 12:15:53.046734 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e091cad3d2d64ea08c86210eec7729e2" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:53.047434 23113 raft_consensus.cc:2468] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 0.
I20260709 12:15:53.048123 23153 leader_election.cc:304] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:15:53.048868 23237 leader_election.cc:290] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:53.050051 23237 raft_consensus.cc:2804] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:15:53.050570 23237 raft_consensus.cc:493] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:53.051153 23237 raft_consensus.cc:3060] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:53.062355 23237 raft_consensus.cc:515] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:53.065670 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e091cad3d2d64ea08c86210eec7729e2" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:53.066424 23038 raft_consensus.cc:3060] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:53.072340 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e091cad3d2d64ea08c86210eec7729e2" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:53.073042 23113 raft_consensus.cc:3060] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:53.072328 23283 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.074800 23038 raft_consensus.cc:2468] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 1.
I20260709 12:15:53.076197 23153 leader_election.cc:304] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:15:53.077755 23295 raft_consensus.cc:2804] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:15:53.078449 23295 raft_consensus.cc:697] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 1 LEADER]: Becoming Leader. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Running, Role: LEADER
I20260709 12:15:53.079473 23295 consensus_queue.cc:237] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:53.080421 23113 raft_consensus.cc:2468] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 1.
I20260709 12:15:53.081275 23237 leader_election.cc:290] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:53.094930 22932 catalog_manager.cc:5697] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f reported cstate change: term changed from 0 to 1, leader changed from <none> to 00913dfef0304840b0b59b385a3c571f (127.22.93.195). New cstate: current_term: 1 leader_uuid: "00913dfef0304840b0b59b385a3c571f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:53.101140 23295 raft_consensus.cc:493] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:53.101765 23295 raft_consensus.cc:515] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:53.104212 23295 leader_election.cc:290] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:53.105906 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:53.106599 23037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "644a670f55a9495b97a3621521f9493a" is_pre_election: true
I20260709 12:15:53.106889 23113 raft_consensus.cc:2393] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00913dfef0304840b0b59b385a3c571f in current term 1: Already voted for candidate 9acc9ee56e54412c933503a95e6074b0 in this term.
I20260709 12:15:53.108079 23037 raft_consensus.cc:2393] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00913dfef0304840b0b59b385a3c571f in current term 1: Already voted for candidate 644a670f55a9495b97a3621521f9493a in this term.
I20260709 12:15:53.109689 23153 leader_election.cc:304] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f; no voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0
I20260709 12:15:53.110535 23295 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:53.111490 23187 raft_consensus.cc:3060] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:15:53.119375 23277 consensus_queue.cc:1048] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.120757 23295 raft_consensus.cc:2749] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:15:53.133723 23281 consensus_queue.cc:1048] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.279547 23281 consensus_queue.cc:1048] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.296336 23253 consensus_queue.cc:1048] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.300176 23253 consensus_queue.cc:1048] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.319972 23283 consensus_queue.cc:1048] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.327200 23277 consensus_queue.cc:1048] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.358142 23256 consensus_queue.cc:1048] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.518260 23295 consensus_queue.cc:1048] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:53.528497 23235 consensus_queue.cc:1048] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.534361 23256 consensus_queue.cc:1048] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:53.534744 23295 consensus_queue.cc:1048] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:15:53.573299 22983 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:15:54.288158 23239 raft_consensus.cc:493] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:15:54.288717 23239 raft_consensus.cc:515] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:54.291810 23239 leader_election.cc:290] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:54.292804 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0" is_pre_election: true
I20260709 12:15:54.293087 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f" is_pre_election: true
I20260709 12:15:54.293428 23112 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 1.
I20260709 12:15:54.293773 23187 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 1.
I20260709 12:15:54.294682 23001 leader_election.cc:304] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:54.295632 23239 raft_consensus.cc:2804] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:15:54.296051 23239 raft_consensus.cc:493] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:15:54.296319 23239 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.302323 23239 raft_consensus.cc:515] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:54.304316 23239 leader_election.cc:290] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 2 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:54.305172 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:54.305389 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:54.305873 23112 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.305889 23187 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:54.314091 23187 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 2.
I20260709 12:15:54.314091 23112 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 2.
I20260709 12:15:54.315831 23002 leader_election.cc:304] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:15:54.316617 23239 raft_consensus.cc:2804] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:54.317071 23239 raft_consensus.cc:697] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:54.317785 23239 consensus_queue.cc:237] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:54.326432 22934 catalog_manager.cc:5697] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 0 to 2, leader changed from <none> to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 2 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:54.857681 23187 raft_consensus.cc:1275] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:54.859570 23239 consensus_queue.cc:1048] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:15:54.875262 23112 raft_consensus.cc:1275] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:15:54.877593 23239 consensus_queue.cc:1048] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:15:54.943447 23112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
mode: GRACEFUL
new_leader_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:47860
I20260709 12:15:54.944518 23112 raft_consensus.cc:606] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Received request to transfer leadership to TS 644a670f55a9495b97a3621521f9493a
I20260709 12:15:54.953903 23112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
mode: GRACEFUL
new_leader_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:47860
I20260709 12:15:54.954645 23112 raft_consensus.cc:606] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Received request to transfer leadership to TS 644a670f55a9495b97a3621521f9493a
I20260709 12:15:54.973505 23037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f25518694a414583a82b55d28454d6"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
mode: GRACEFUL
new_leader_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:50774
I20260709 12:15:54.974222 23037 raft_consensus.cc:606] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Received request to transfer leadership to TS 9acc9ee56e54412c933503a95e6074b0
I20260709 12:15:54.981928 23037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
mode: GRACEFUL
new_leader_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:50774
I20260709 12:15:54.982710 23037 raft_consensus.cc:606] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Received request to transfer leadership to TS 9acc9ee56e54412c933503a95e6074b0
I20260709 12:15:54.992226 23037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
mode: GRACEFUL
new_leader_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:50774
I20260709 12:15:54.992952 23037 raft_consensus.cc:606] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Received request to transfer leadership to TS 9acc9ee56e54412c933503a95e6074b0
I20260709 12:15:55.299270 23256 raft_consensus.cc:993] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0: : Instructing follower 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:15:55.299847 23326 raft_consensus.cc:1081] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Signalling peer 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:15:55.301849 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:50756
I20260709 12:15:55.302426 23037 raft_consensus.cc:493] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:55.302747 23037 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.308890 23037 raft_consensus.cc:515] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.311170 23319 raft_consensus.cc:993] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a: : Instructing follower 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:15:55.311484 23037 leader_election.cc:290] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 2 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:55.311785 23239 raft_consensus.cc:1081] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Signalling peer 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:15:55.312275 23112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:55.312975 23112 raft_consensus.cc:3055] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:55.313328 23112 raft_consensus.cc:740] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:15:55.313349 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:55.313771 23113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00f25518694a414583a82b55d28454d6"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:15:55.314250 23187 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.314383 23113 raft_consensus.cc:493] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:55.314324 23112 consensus_queue.cc:260] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.314935 23113 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.316154 23112 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.320428 23187 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 2.
I20260709 12:15:55.321794 23002 leader_election.cc:304] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:15:55.322633 23319 raft_consensus.cc:2804] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:55.322489 23113 raft_consensus.cc:515] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.323246 23319 raft_consensus.cc:697] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:55.323482 23112 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 2.
I20260709 12:15:55.324358 23319 consensus_queue.cc:237] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.325918 23113 leader_election.cc:290] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 2 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:55.325891 23037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:55.326218 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:55.326841 23037 raft_consensus.cc:3055] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:55.326942 23187 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.327283 23037 raft_consensus.cc:740] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:55.328498 23037 consensus_queue.cc:260] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.330024 23037 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.334924 22935 catalog_manager.cc:5697] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 1 to 2, leader changed from 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194) to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 2 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:55.337028 23037 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 2.
I20260709 12:15:55.338536 23079 leader_election.cc:304] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:55.339135 23187 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 2.
I20260709 12:15:55.339458 23326 raft_consensus.cc:2804] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:55.339998 23326 raft_consensus.cc:697] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:15:55.340907 23326 consensus_queue.cc:237] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.351389 22934 catalog_manager.cc:5697] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 1 to 2, leader changed from 644a670f55a9495b97a3621521f9493a (127.22.93.193) to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:55.365587 23239 raft_consensus.cc:993] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a: : Instructing follower 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:15:55.366143 23319 raft_consensus.cc:1081] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Signalling peer 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:15:55.367820 23113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:15:55.368330 23113 raft_consensus.cc:493] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:55.368602 23113 raft_consensus.cc:3060] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.374624 23113 raft_consensus.cc:515] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.376689 23113 leader_election.cc:290] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 2 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:55.377781 23037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:55.377995 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47a40fd692cb46e9a97550802a74d4ed" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:55.378473 23037 raft_consensus.cc:3055] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:55.378549 23187 raft_consensus.cc:3060] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.378786 23037 raft_consensus.cc:740] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:55.379726 23037 consensus_queue.cc:260] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.380836 23037 raft_consensus.cc:3060] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.384431 23187 raft_consensus.cc:2468] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 2.
I20260709 12:15:55.385845 23077 leader_election.cc:304] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:55.386546 23037 raft_consensus.cc:2468] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 2.
I20260709 12:15:55.386655 23326 raft_consensus.cc:2804] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:55.387198 23326 raft_consensus.cc:697] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:15:55.388140 23326 consensus_queue.cc:237] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.392369 23239 raft_consensus.cc:993] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a: : Instructing follower 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:15:55.393055 23239 raft_consensus.cc:1081] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Signalling peer 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:15:55.395684 23113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:15:55.396502 23113 raft_consensus.cc:493] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:55.397049 23113 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:55.401335 22934 catalog_manager.cc:5697] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 1 to 2, leader changed from 644a670f55a9495b97a3621521f9493a (127.22.93.193) to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:55.404886 23113 raft_consensus.cc:515] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.407410 23113 leader_election.cc:290] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 3 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:55.408211 23037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:55.408864 23037 raft_consensus.cc:3055] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:55.409220 23037 raft_consensus.cc:740] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:55.409137 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:55.409932 23187 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:55.410157 23037 consensus_queue.cc:260] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.411577 23037 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:55.416096 23187 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 3.
I20260709 12:15:55.417250 23077 leader_election.cc:304] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:55.417891 23037 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 3.
I20260709 12:15:55.418188 23326 raft_consensus.cc:2804] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:55.418752 23326 raft_consensus.cc:697] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:15:55.419740 23326 consensus_queue.cc:237] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.426059 22934 catalog_manager.cc:5697] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 2 to 3, leader changed from 644a670f55a9495b97a3621521f9493a (127.22.93.193) to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 3 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:55.539862 23256 raft_consensus.cc:993] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0: : Instructing follower 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:15:55.540335 23326 raft_consensus.cc:1081] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Signalling peer 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:15:55.541967 23037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:50756
I20260709 12:15:55.542506 23037 raft_consensus.cc:493] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:55.542795 23037 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.548601 23037 raft_consensus.cc:515] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.550319 23037 leader_election.cc:290] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 2 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:15:55.551656 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:55.551667 23187 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:15:55.552291 23113 raft_consensus.cc:3055] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:15:55.552369 23187 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.552604 23113 raft_consensus.cc:740] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:15:55.553432 23113 consensus_queue.cc:260] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.554455 23113 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:15:55.557928 23187 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 2.
I20260709 12:15:55.559247 23002 leader_election.cc:304] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:15:55.560271 23333 raft_consensus.cc:2804] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:15:55.560269 23113 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 2.
I20260709 12:15:55.560866 23333 raft_consensus.cc:697] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:55.561605 23333 consensus_queue.cc:237] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:55.569222 22934 catalog_manager.cc:5697] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 1 to 2, leader changed from 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194) to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 2 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:15:55.806571 23187 raft_consensus.cc:1275] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:55.808109 23326 consensus_queue.cc:1048] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:55.826021 23037 raft_consensus.cc:1275] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:15:55.827740 23339 consensus_queue.cc:1048] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:55.840932 23187 raft_consensus.cc:1275] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:55.842497 23333 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:55.849869 23037 raft_consensus.cc:1275] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:55.854192 23113 raft_consensus.cc:1275] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:55.854290 23339 consensus_queue.cc:1048] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:55.856022 23333 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:15:55.866791 23187 raft_consensus.cc:1275] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:55.870069 23256 consensus_queue.cc:1048] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:55.896275 23187 raft_consensus.cc:1275] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:55.897483 23256 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:55.907378 23037 raft_consensus.cc:1275] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:55.908828 23256 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:55.998651 23187 raft_consensus.cc:1275] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:56.000087 23333 consensus_queue.cc:1048] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:56.009491 23113 raft_consensus.cc:1275] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:15:56.011021 23333 consensus_queue.cc:1048] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:15:58.027051 22903 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:15:58.027987 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:58.045457 23113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f25518694a414583a82b55d28454d6"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
mode: GRACEFUL
new_leader_uuid: "00913dfef0304840b0b59b385a3c571f"
 from {username='slave'} at 127.0.0.1:47874
I20260709 12:15:58.046106 23113 raft_consensus.cc:606] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Received request to transfer leadership to TS 00913dfef0304840b0b59b385a3c571f
I20260709 12:15:58.057996 23038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
mode: GRACEFUL
new_leader_uuid: "00913dfef0304840b0b59b385a3c571f"
 from {username='slave'} at 127.0.0.1:50786
I20260709 12:15:58.058579 23038 raft_consensus.cc:606] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Received request to transfer leadership to TS 00913dfef0304840b0b59b385a3c571f
I20260709 12:15:58.059798 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:15:58.060348 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:15:58.172679 23256 raft_consensus.cc:993] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0: : Instructing follower 00913dfef0304840b0b59b385a3c571f to start an election
I20260709 12:15:58.173272 23354 raft_consensus.cc:1081] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Signalling peer 00913dfef0304840b0b59b385a3c571f to start an election
I20260709 12:15:58.174926 23187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00f25518694a414583a82b55d28454d6"
dest_uuid: "00913dfef0304840b0b59b385a3c571f"
 from {username='slave'} at 127.0.0.1:47680
I20260709 12:15:58.175475 23187 raft_consensus.cc:493] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.175770 23187 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.180712 23187 raft_consensus.cc:515] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:58.182226 23187 leader_election.cc:290] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 3 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:58.183301 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:58.184123 23038 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.183301 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:58.185243 23113 raft_consensus.cc:3055] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:58.185649 23113 raft_consensus.cc:740] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:15:58.186582 23113 consensus_queue.cc:260] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:58.187827 23113 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.190114 23038 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 3.
I20260709 12:15:58.191298 23153 leader_election.cc:304] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:15:58.192051 23336 raft_consensus.cc:2804] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:58.193117 23113 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 3.
I20260709 12:15:58.193457 23336 raft_consensus.cc:697] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Becoming Leader. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Running, Role: LEADER
I20260709 12:15:58.194443 23336 consensus_queue.cc:237] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:58.202696 22935 catalog_manager.cc:5697] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f reported cstate change: term changed from 2 to 3, leader changed from 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194) to 00913dfef0304840b0b59b385a3c571f (127.22.93.195). New cstate: current_term: 3 leader_uuid: "00913dfef0304840b0b59b385a3c571f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:58.240782 23333 raft_consensus.cc:993] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a: : Instructing follower 00913dfef0304840b0b59b385a3c571f to start an election
I20260709 12:15:58.241283 23361 raft_consensus.cc:1081] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Signalling peer 00913dfef0304840b0b59b385a3c571f to start an election
I20260709 12:15:58.242906 23187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02"
dest_uuid: "00913dfef0304840b0b59b385a3c571f"
 from {username='slave'} at 127.0.0.1:47686
I20260709 12:15:58.243453 23187 raft_consensus.cc:493] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:15:58.243803 23187 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.248697 23187 raft_consensus.cc:515] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:58.250243 23187 leader_election.cc:290] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 3 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:15:58.251466 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:15:58.251463 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:15:58.252131 23038 raft_consensus.cc:3055] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:15:58.252200 23113 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.252494 23038 raft_consensus.cc:740] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:15:58.253242 23038 consensus_queue.cc:260] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:58.254304 23038 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:15:58.258675 23113 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 3.
I20260709 12:15:58.259855 23150 leader_election.cc:304] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:15:58.260712 23336 raft_consensus.cc:2804] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:15:58.261234 23336 raft_consensus.cc:697] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Becoming Leader. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Running, Role: LEADER
I20260709 12:15:58.261777 23038 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 3.
I20260709 12:15:58.262045 23336 consensus_queue.cc:237] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:15:58.270005 22935 catalog_manager.cc:5697] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f reported cstate change: term changed from 2 to 3, leader changed from 644a670f55a9495b97a3621521f9493a (127.22.93.193) to 00913dfef0304840b0b59b385a3c571f (127.22.93.195). New cstate: current_term: 3 leader_uuid: "00913dfef0304840b0b59b385a3c571f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: HEALTHY } } }
I20260709 12:15:58.613660 23038 raft_consensus.cc:1275] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Refusing update from remote peer 00913dfef0304840b0b59b385a3c571f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:58.615166 23336 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:58.626302 23113 raft_consensus.cc:1275] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Refusing update from remote peer 00913dfef0304840b0b59b385a3c571f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:58.628027 23336 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:58.681416 23112 raft_consensus.cc:1275] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Refusing update from remote peer 00913dfef0304840b0b59b385a3c571f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:58.682948 23336 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:15:58.693233 23038 raft_consensus.cc:1275] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Refusing update from remote peer 00913dfef0304840b0b59b385a3c571f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:15:58.695344 23336 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:15:59.075675 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:15:59.086313 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:15:59.087090 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:00.088459 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:00.093751 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:00.094295 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:01.095428 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:01.100595 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:01.101225 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:02.192414 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:02.197674 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:02.198173 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:02.450122 23134 debug-util.cc:398] Leaking SignalData structure 0x7b080012c060 after lost signal to thread 22906
W20260709 12:16:02.451252 23134 debug-util.cc:398] Leaking SignalData structure 0x7b080012c740 after lost signal to thread 22969
W20260709 12:16:02.452215 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08001aff80 after lost signal to thread 23062
W20260709 12:16:02.453133 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08001b12c0 after lost signal to thread 23137
W20260709 12:16:02.454005 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08000bda00 after lost signal to thread 23211
I20260709 12:16:03.199486 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:03.208170 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:03.208940 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:04.372865 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:04.378329 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:04.378846 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:04.692751 23208 debug-util.cc:398] Leaking SignalData structure 0x7b080016c060 after lost signal to thread 22906
W20260709 12:16:04.693816 23208 debug-util.cc:398] Leaking SignalData structure 0x7b080016c740 after lost signal to thread 22969
W20260709 12:16:04.694770 23208 debug-util.cc:398] Leaking SignalData structure 0x7b080018d9a0 after lost signal to thread 23062
W20260709 12:16:04.695653 23208 debug-util.cc:398] Leaking SignalData structure 0x7b0800132b40 after lost signal to thread 23137
W20260709 12:16:04.696445 23208 debug-util.cc:398] Leaking SignalData structure 0x7b0800107ca0 after lost signal to thread 23211
I20260709 12:16:05.380151 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:05.389045 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:05.389770 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:06.391122 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:06.399677 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:06.400333 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:07.506029 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:07.514955 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:07.515605 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:08.246624 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08000bd900 after lost signal to thread 22906
W20260709 12:16:08.247668 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08001b12a0 after lost signal to thread 22969
W20260709 12:16:08.248653 23134 debug-util.cc:398] Leaking SignalData structure 0x7b080012c1a0 after lost signal to thread 23062
W20260709 12:16:08.249490 23134 debug-util.cc:398] Leaking SignalData structure 0x7b08000c15e0 after lost signal to thread 23137
W20260709 12:16:08.250363 23134 debug-util.cc:398] Leaking SignalData structure 0x7b080018d020 after lost signal to thread 23211
I20260709 12:16:08.552762 22903 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:16:08.558506 23038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
mode: GRACEFUL
new_leader_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:50774
I20260709 12:16:08.559487 23038 raft_consensus.cc:606] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Received request to transfer leadership to TS 9acc9ee56e54412c933503a95e6074b0
I20260709 12:16:08.565900 23038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
mode: GRACEFUL
new_leader_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:50774
I20260709 12:16:08.566447 23038 raft_consensus.cc:606] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Received request to transfer leadership to TS 9acc9ee56e54412c933503a95e6074b0
I20260709 12:16:08.572891 23038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
mode: GRACEFUL
new_leader_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:50774
I20260709 12:16:08.573783 23038 raft_consensus.cc:606] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Received request to transfer leadership to TS 9acc9ee56e54412c933503a95e6074b0
I20260709 12:16:08.586453 23385 raft_consensus.cc:993] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a: : Instructing follower 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.587368 23382 raft_consensus.cc:1081] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Signalling peer 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.589802 23113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:16:08.590669 23113 raft_consensus.cc:493] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:08.591109 23113 raft_consensus.cc:3060] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.600243 23113 raft_consensus.cc:515] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.605218 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:16:08.605820 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:16:08.606184 23038 raft_consensus.cc:3055] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:08.606518 23186 raft_consensus.cc:3060] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.606608 23038 raft_consensus.cc:740] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:16:08.608850 23187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02"
dest_uuid: "00913dfef0304840b0b59b385a3c571f"
mode: GRACEFUL
new_leader_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:59724
I20260709 12:16:08.609377 23187 raft_consensus.cc:606] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Received request to transfer leadership to TS 9acc9ee56e54412c933503a95e6074b0
I20260709 12:16:08.607739 23038 consensus_queue.cc:260] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.611954 23038 raft_consensus.cc:3060] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.616772 23187 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f25518694a414583a82b55d28454d6"
dest_uuid: "00913dfef0304840b0b59b385a3c571f"
mode: GRACEFUL
new_leader_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:59724
I20260709 12:16:08.617328 23187 raft_consensus.cc:606] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Received request to transfer leadership to TS 9acc9ee56e54412c933503a95e6074b0
I20260709 12:16:08.619202 23186 raft_consensus.cc:2468] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 2.
I20260709 12:16:08.619800 23113 leader_election.cc:290] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 2 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:16:08.622354 23038 raft_consensus.cc:2468] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 2.
I20260709 12:16:08.625504 23077 leader_election.cc:304] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:16:08.629604 23379 raft_consensus.cc:2804] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:08.631208 23379 raft_consensus.cc:697] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:08.634851 23379 consensus_queue.cc:237] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.653918 22934 catalog_manager.cc:5697] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 1 to 2, leader changed from 644a670f55a9495b97a3621521f9493a (127.22.93.193) to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.774511 23336 raft_consensus.cc:993] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f: : Instructing follower 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.774945 23336 raft_consensus.cc:1081] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Signalling peer 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.776491 23113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00f25518694a414583a82b55d28454d6"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:47856
I20260709 12:16:08.777030 23113 raft_consensus.cc:493] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:08.777367 23113 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:08.782406 23113 raft_consensus.cc:515] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.783882 23113 leader_election.cc:290] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 4 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:16:08.784857 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:16:08.784998 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:16:08.785416 23038 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:08.785558 23186 raft_consensus.cc:3055] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:08.785965 23186 raft_consensus.cc:740] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Running, Role: LEADER
I20260709 12:16:08.786809 23186 consensus_queue.cc:260] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.788020 23186 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:08.790022 23382 raft_consensus.cc:993] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a: : Instructing follower 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.790534 23382 raft_consensus.cc:1081] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Signalling peer 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.792500 23038 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 4.
I20260709 12:16:08.793507 23113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:16:08.794060 23113 raft_consensus.cc:493] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:08.794155 23079 leader_election.cc:304] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:16:08.794443 23113 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.795253 23379 raft_consensus.cc:2804] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:08.795511 23186 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 4.
I20260709 12:16:08.795801 23379 raft_consensus.cc:697] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:08.796778 23379 consensus_queue.cc:237] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.801210 23113 raft_consensus.cc:515] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.805783 23113 leader_election.cc:290] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 3 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:16:08.806650 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:16:08.807030 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:16:08.807322 23038 raft_consensus.cc:3055] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:08.807597 23186 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.807699 23038 raft_consensus.cc:740] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:16:08.808720 23038 consensus_queue.cc:260] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.810016 23038 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:08.810169 22934 catalog_manager.cc:5697] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 3 to 4, leader changed from 00913dfef0304840b0b59b385a3c571f (127.22.93.195) to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 4 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.814675 23186 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 3.
I20260709 12:16:08.815824 23077 leader_election.cc:304] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:16:08.816589 23379 raft_consensus.cc:2804] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:08.816740 23038 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 3.
I20260709 12:16:08.817147 23379 raft_consensus.cc:697] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:08.818176 23379 consensus_queue.cc:237] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.826699 22934 catalog_manager.cc:5697] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 2 to 3, leader changed from 644a670f55a9495b97a3621521f9493a (127.22.93.193) to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 3 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.868368 23392 raft_consensus.cc:993] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f: : Instructing follower 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.869062 23336 raft_consensus.cc:1081] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Signalling peer 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.870692 23113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:47856
I20260709 12:16:08.871243 23113 raft_consensus.cc:493] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:08.871555 23113 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:08.876549 23113 raft_consensus.cc:515] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.878417 23113 leader_election.cc:290] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 4 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:16:08.879429 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:16:08.879617 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:16:08.880090 23186 raft_consensus.cc:3055] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:08.880061 23038 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:08.880611 23186 raft_consensus.cc:740] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Running, Role: LEADER
I20260709 12:16:08.881474 23186 consensus_queue.cc:260] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.882691 23186 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:08.887512 23038 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 4.
I20260709 12:16:08.888639 23079 leader_election.cc:304] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 644a670f55a9495b97a3621521f9493a, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:16:08.889422 23186 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 4.
I20260709 12:16:08.889556 23379 raft_consensus.cc:2804] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:08.890120 23379 raft_consensus.cc:697] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:08.891077 23379 consensus_queue.cc:237] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:08.898512 22934 catalog_manager.cc:5697] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 3 to 4, leader changed from 00913dfef0304840b0b59b385a3c571f (127.22.93.195) to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 4 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:08.904906 23385 raft_consensus.cc:993] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a: : Instructing follower 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.905570 23385 raft_consensus.cc:1081] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Signalling peer 9acc9ee56e54412c933503a95e6074b0 to start an election
I20260709 12:16:08.907748 23113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
 from {username='slave'} at 127.0.0.1:47840
I20260709 12:16:08.908344 23113 raft_consensus.cc:493] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:08.908609 23113 raft_consensus.cc:3060] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.913695 23113 raft_consensus.cc:515] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:16:08.915328 23113 leader_election.cc:290] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 2 election: Requested vote from peers 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833), 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131)
I20260709 12:16:08.916276 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:16:08.916468 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b99eb1c94d9406a9a5235850c23a334" candidate_uuid: "9acc9ee56e54412c933503a95e6074b0" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:16:08.916930 23186 raft_consensus.cc:3060] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.916963 23038 raft_consensus.cc:3055] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:08.917464 23038 raft_consensus.cc:740] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:16:08.918381 23038 consensus_queue.cc:260] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:16:08.919620 23038 raft_consensus.cc:3060] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:08.924466 23186 raft_consensus.cc:2468] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 2.
I20260709 12:16:08.925956 23077 leader_election.cc:304] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 9acc9ee56e54412c933503a95e6074b0; no voters: 
I20260709 12:16:08.926755 23038 raft_consensus.cc:2468] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9acc9ee56e54412c933503a95e6074b0 in term 2.
I20260709 12:16:08.926852 23386 raft_consensus.cc:2804] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:08.927516 23386 raft_consensus.cc:697] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Becoming Leader. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:08.928524 23386 consensus_queue.cc:237] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } }
I20260709 12:16:08.936305 22934 catalog_manager.cc:5697] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 reported cstate change: term changed from 1 to 2, leader changed from 644a670f55a9495b97a3621521f9493a (127.22.93.193) to 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "9acc9ee56e54412c933503a95e6074b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:09.061718 23038 raft_consensus.cc:1275] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.063190 23386 consensus_queue.cc:1048] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.074841 23186 raft_consensus.cc:1275] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.076891 23379 consensus_queue.cc:1048] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.233645 23186 raft_consensus.cc:1275] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:09.235944 23379 consensus_queue.cc:1048] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:09.247984 23186 raft_consensus.cc:1275] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.250944 23037 raft_consensus.cc:1275] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:09.251096 23386 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:09.252756 23379 consensus_queue.cc:1048] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:09.265982 23038 raft_consensus.cc:1275] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.271770 23386 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:09.412846 23038 raft_consensus.cc:1275] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.414237 23386 consensus_queue.cc:1048] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.426082 23186 raft_consensus.cc:1275] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:09.427510 23379 consensus_queue.cc:1048] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:09.466751 23186 raft_consensus.cc:1275] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.468197 23379 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:09.480682 23038 raft_consensus.cc:1275] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Refusing update from remote peer 9acc9ee56e54412c933503a95e6074b0: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:09.482587 23386 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:11.688819 22903 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:16:11.689847 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:11.697829 23113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "00f25518694a414583a82b55d28454d6"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
mode: GRACEFUL
new_leader_uuid: "00913dfef0304840b0b59b385a3c571f"
 from {username='slave'} at 127.0.0.1:47874
I20260709 12:16:11.698494 23113 raft_consensus.cc:606] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Received request to transfer leadership to TS 00913dfef0304840b0b59b385a3c571f
I20260709 12:16:11.701333 23113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
mode: GRACEFUL
new_leader_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:47874
I20260709 12:16:11.701872 23113 raft_consensus.cc:606] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Received request to transfer leadership to TS 644a670f55a9495b97a3621521f9493a
I20260709 12:16:11.704131 23113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
mode: GRACEFUL
new_leader_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:47874
I20260709 12:16:11.704564 23113 raft_consensus.cc:606] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Received request to transfer leadership to TS 644a670f55a9495b97a3621521f9493a
I20260709 12:16:11.706795 23113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
mode: GRACEFUL
new_leader_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:47874
I20260709 12:16:11.707280 23113 raft_consensus.cc:606] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Received request to transfer leadership to TS 644a670f55a9495b97a3621521f9493a
I20260709 12:16:11.709443 23113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969"
dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
mode: GRACEFUL
new_leader_uuid: "00913dfef0304840b0b59b385a3c571f"
 from {username='slave'} at 127.0.0.1:47874
I20260709 12:16:11.709868 23113 raft_consensus.cc:606] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Received request to transfer leadership to TS 00913dfef0304840b0b59b385a3c571f
I20260709 12:16:11.710944 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:16:11.711562 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:11.798750 23413 raft_consensus.cc:993] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0: : Instructing follower 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:16:11.799616 23414 raft_consensus.cc:1081] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Signalling peer 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:16:11.801383 23038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:50756
I20260709 12:16:11.801940 23038 raft_consensus.cc:493] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.802217 23038 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.808696 23038 raft_consensus.cc:515] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.811345 23038 leader_election.cc:290] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 4 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:16:11.812472 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:16:11.812781 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a41e0f548cfc4b239e855069d87af82c" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:16:11.813351 23113 raft_consensus.cc:3055] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:11.813414 23186 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.813778 23113 raft_consensus.cc:740] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:11.814711 23113 consensus_queue.cc:260] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.816154 23113 raft_consensus.cc:3060] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.821381 23186 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 4.
I20260709 12:16:11.823415 23002 leader_election.cc:304] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:16:11.824082 23113 raft_consensus.cc:2468] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 4.
I20260709 12:16:11.825592 23415 raft_consensus.cc:2804] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:11.826920 23415 raft_consensus.cc:697] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 4 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:16:11.827732 23414 raft_consensus.cc:993] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0: : Instructing follower 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:16:11.828233 23414 raft_consensus.cc:1081] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Signalling peer 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:16:11.827867 23415 consensus_queue.cc:237] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.829854 23038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:50756
I20260709 12:16:11.830379 23038 raft_consensus.cc:493] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.830698 23038 raft_consensus.cc:3060] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.838357 23038 raft_consensus.cc:515] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.840756 23038 leader_election.cc:290] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 3 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:16:11.841975 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:16:11.842002 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41f6cb2b474b4ebe8c74377bfd9efcb7" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:16:11.842572 23186 raft_consensus.cc:3060] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.842860 23113 raft_consensus.cc:3055] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:11.843179 23113 raft_consensus.cc:740] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:11.843881 23113 consensus_queue.cc:260] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.845264 23113 raft_consensus.cc:3060] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:11.847103 22935 catalog_manager.cc:5697] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 3 to 4, leader changed from 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194) to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 4 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.849213 23186 raft_consensus.cc:2468] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 3.
I20260709 12:16:11.850426 23002 leader_election.cc:304] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:16:11.850873 23113 raft_consensus.cc:2468] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 3.
I20260709 12:16:11.851534 23415 raft_consensus.cc:2804] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:11.852038 23415 raft_consensus.cc:697] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 3 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:16:11.852993 23415 consensus_queue.cc:237] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.869692 22935 catalog_manager.cc:5697] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 2 to 3, leader changed from 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194) to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 3 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.876746 23413 raft_consensus.cc:993] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0: : Instructing follower 00913dfef0304840b0b59b385a3c571f to start an election
I20260709 12:16:11.877321 23413 raft_consensus.cc:1081] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Signalling peer 00913dfef0304840b0b59b385a3c571f to start an election
I20260709 12:16:11.879220 23186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "00f25518694a414583a82b55d28454d6"
dest_uuid: "00913dfef0304840b0b59b385a3c571f"
 from {username='slave'} at 127.0.0.1:47680
I20260709 12:16:11.879786 23186 raft_consensus.cc:493] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.880167 23186 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:11.884994 23186 raft_consensus.cc:515] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.886966 23186 leader_election.cc:290] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 5 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:16:11.887921 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:16:11.888059 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00f25518694a414583a82b55d28454d6" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:16:11.888453 23038 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:11.888633 23113 raft_consensus.cc:3055] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:11.888991 23113 raft_consensus.cc:740] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:11.889700 23113 consensus_queue.cc:260] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.890657 23113 raft_consensus.cc:3060] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:11.893608 23038 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 5.
I20260709 12:16:11.894906 23153 leader_election.cc:304] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:16:11.895887 23412 raft_consensus.cc:2804] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:11.895946 23113 raft_consensus.cc:2468] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 5.
I20260709 12:16:11.897181 23412 raft_consensus.cc:697] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 5 LEADER]: Becoming Leader. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Running, Role: LEADER
I20260709 12:16:11.898097 23412 consensus_queue.cc:237] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.905738 22935 catalog_manager.cc:5697] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f reported cstate change: term changed from 4 to 5, leader changed from 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194) to 00913dfef0304840b0b59b385a3c571f (127.22.93.195). New cstate: current_term: 5 leader_uuid: "00913dfef0304840b0b59b385a3c571f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:11.930056 23414 raft_consensus.cc:993] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0: : Instructing follower 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:16:11.930546 23413 raft_consensus.cc:1081] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Signalling peer 644a670f55a9495b97a3621521f9493a to start an election
I20260709 12:16:11.932058 23038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02"
dest_uuid: "644a670f55a9495b97a3621521f9493a"
 from {username='slave'} at 127.0.0.1:50756
I20260709 12:16:11.932549 23038 raft_consensus.cc:493] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.932859 23038 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:11.938097 23038 raft_consensus.cc:515] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.939922 23038 leader_election.cc:290] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 5 election: Requested vote from peers 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419), 00913dfef0304840b0b59b385a3c571f (127.22.93.195:34833)
I20260709 12:16:11.940811 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:16:11.941064 23186 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d096557add543d19d63cb64c9c15f02" candidate_uuid: "644a670f55a9495b97a3621521f9493a" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "00913dfef0304840b0b59b385a3c571f"
I20260709 12:16:11.941342 23113 raft_consensus.cc:3055] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:16:11.941627 23186 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:11.941653 23113 raft_consensus.cc:740] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:11.942564 23113 consensus_queue.cc:260] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.943621 23113 raft_consensus.cc:3060] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:16:11.946834 23186 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 5.
I20260709 12:16:11.947939 23002 leader_election.cc:304] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:16:11.948472 23113 raft_consensus.cc:2468] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 644a670f55a9495b97a3621521f9493a in term 5.
I20260709 12:16:11.948616 23415 raft_consensus.cc:2804] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:16:11.949157 23415 raft_consensus.cc:697] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 5 LEADER]: Becoming Leader. State: Replica: 644a670f55a9495b97a3621521f9493a, State: Running, Role: LEADER
I20260709 12:16:11.950073 23415 consensus_queue.cc:237] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.957267 22935 catalog_manager.cc:5697] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a reported cstate change: term changed from 4 to 5, leader changed from 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194) to 644a670f55a9495b97a3621521f9493a (127.22.93.193). New cstate: current_term: 5 leader_uuid: "644a670f55a9495b97a3621521f9493a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:11.963454 23414 raft_consensus.cc:993] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0: : Instructing follower 00913dfef0304840b0b59b385a3c571f to start an election
I20260709 12:16:11.963963 23413 raft_consensus.cc:1081] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Signalling peer 00913dfef0304840b0b59b385a3c571f to start an election
I20260709 12:16:11.965725 23186 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969"
dest_uuid: "00913dfef0304840b0b59b385a3c571f"
 from {username='slave'} at 127.0.0.1:47680
I20260709 12:16:11.966266 23186 raft_consensus.cc:493] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:11.966630 23186 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.971462 23186 raft_consensus.cc:515] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.973058 23186 leader_election.cc:290] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 4 election: Requested vote from peers 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131), 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194:38419)
I20260709 12:16:11.974028 23038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "644a670f55a9495b97a3621521f9493a"
I20260709 12:16:11.974097 23113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea5bbd78cc174df8a53a1cc887fb6969" candidate_uuid: "00913dfef0304840b0b59b385a3c571f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9acc9ee56e54412c933503a95e6074b0"
I20260709 12:16:11.974705 23038 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.974788 23113 raft_consensus.cc:3055] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:11.975224 23113 raft_consensus.cc:740] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9acc9ee56e54412c933503a95e6074b0, State: Running, Role: LEADER
I20260709 12:16:11.975958 23113 consensus_queue.cc:260] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.977222 23113 raft_consensus.cc:3060] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:11.980782 23038 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 4.
I20260709 12:16:11.981743 23153 leader_election.cc:304] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00913dfef0304840b0b59b385a3c571f, 644a670f55a9495b97a3621521f9493a; no voters: 
I20260709 12:16:11.982468 23113 raft_consensus.cc:2468] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00913dfef0304840b0b59b385a3c571f in term 4.
I20260709 12:16:11.982529 23412 raft_consensus.cc:2804] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:11.983140 23412 raft_consensus.cc:697] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 4 LEADER]: Becoming Leader. State: Replica: 00913dfef0304840b0b59b385a3c571f, State: Running, Role: LEADER
I20260709 12:16:11.984000 23412 consensus_queue.cc:237] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } }
I20260709 12:16:11.992024 22935 catalog_manager.cc:5697] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f reported cstate change: term changed from 3 to 4, leader changed from 9acc9ee56e54412c933503a95e6074b0 (127.22.93.194) to 00913dfef0304840b0b59b385a3c571f (127.22.93.195). New cstate: current_term: 4 leader_uuid: "00913dfef0304840b0b59b385a3c571f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:12.208045 23186 raft_consensus.cc:1275] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:12.209272 23415 consensus_queue.cc:1048] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:12.219883 23113 raft_consensus.cc:1275] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:12.221608 23429 consensus_queue.cc:1048] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:16:12.310611 23113 raft_consensus.cc:1275] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:12.312098 23429 consensus_queue.cc:1048] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:12.317209 23112 raft_consensus.cc:1275] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 5 FOLLOWER]: Refusing update from remote peer 00913dfef0304840b0b59b385a3c571f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:12.318827 23412 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:12.322739 23186 raft_consensus.cc:1275] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:12.325143 23429 consensus_queue.cc:1048] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:12.338543 23038 raft_consensus.cc:1275] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 5 FOLLOWER]: Refusing update from remote peer 00913dfef0304840b0b59b385a3c571f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:12.340162 23412 consensus_queue.cc:1048] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:12.450834 23113 raft_consensus.cc:1275] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 5 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:12.452384 23434 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:12.462895 23187 raft_consensus.cc:1275] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 5 FOLLOWER]: Refusing update from remote peer 644a670f55a9495b97a3621521f9493a: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:16:12.465723 23429 consensus_queue.cc:1048] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [LEADER]: Connected to new peer: Peer: permanent_uuid: "00913dfef0304840b0b59b385a3c571f" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 34833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:16:12.514358 23113 raft_consensus.cc:1275] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Refusing update from remote peer 00913dfef0304840b0b59b385a3c571f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:12.515952 23423 consensus_queue.cc:1048] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9acc9ee56e54412c933503a95e6074b0" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:12.524983 23038 raft_consensus.cc:1275] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Refusing update from remote peer 00913dfef0304840b0b59b385a3c571f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:16:12.526877 23437 consensus_queue.cc:1048] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [LEADER]: Connected to new peer: Peer: permanent_uuid: "644a670f55a9495b97a3621521f9493a" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 42131 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:12.713253 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:12.718732 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:12.719296 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:13.720523 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:13.726863 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:13.727293 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:14.728451 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:14.734366 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:14.734890 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:15.736227 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:15.742344 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:15.742967 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:16.744378 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:16.749914 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:16.750425 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:17.751652 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:17.758505 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:17.759056 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:18.760207 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:18.765587 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:18.766108 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:19.767729 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:19.773872 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:19.774443 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:20.775842 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:20.781198 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:20.781733 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:21.812587 22903 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:16:21.813333 22903 tablet_server.cc:179] TabletServer@127.22.93.193:0 shutting down...
I20260709 12:16:21.857625 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:21.858453 22903 tablet_replica.cc:333] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a: stopping tablet replica
I20260709 12:16:21.859323 22903 raft_consensus.cc:2243] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:21.860561 22903 raft_consensus.cc:2272] T a41e0f548cfc4b239e855069d87af82c P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:21.863803 22903 tablet_replica.cc:333] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a: stopping tablet replica
I20260709 12:16:21.864455 22903 raft_consensus.cc:2243] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:21.864969 22903 raft_consensus.cc:2272] T 1b99eb1c94d9406a9a5235850c23a334 P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:21.866797 22903 tablet_replica.cc:333] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a: stopping tablet replica
I20260709 12:16:21.867408 22903 raft_consensus.cc:2243] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:21.868297 22903 raft_consensus.cc:2272] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 644a670f55a9495b97a3621521f9493a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:21.870132 22903 tablet_replica.cc:333] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a: stopping tablet replica
I20260709 12:16:21.870667 22903 raft_consensus.cc:2243] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:21.871255 22903 raft_consensus.cc:2272] T 00f25518694a414583a82b55d28454d6 P 644a670f55a9495b97a3621521f9493a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:21.873167 22903 tablet_replica.cc:333] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a: stopping tablet replica
I20260709 12:16:21.873698 22903 raft_consensus.cc:2243] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:21.874786 22903 raft_consensus.cc:2272] T 1d096557add543d19d63cb64c9c15f02 P 644a670f55a9495b97a3621521f9493a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:21.877115 22903 tablet_replica.cc:333] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a: stopping tablet replica
I20260709 12:16:21.877713 22903 raft_consensus.cc:2243] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:21.878123 22903 raft_consensus.cc:2272] T 47a40fd692cb46e9a97550802a74d4ed P 644a670f55a9495b97a3621521f9493a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:21.879874 22903 tablet_replica.cc:333] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a: stopping tablet replica
I20260709 12:16:21.880366 22903 raft_consensus.cc:2243] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:21.880771 22903 raft_consensus.cc:2272] T e091cad3d2d64ea08c86210eec7729e2 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:21.882385 22903 tablet_replica.cc:333] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a: stopping tablet replica
I20260709 12:16:21.882838 22903 raft_consensus.cc:2243] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:21.883276 22903 raft_consensus.cc:2272] T af3785b4b18447e5810e769747b1e306 P 644a670f55a9495b97a3621521f9493a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:21.885001 22903 tablet_replica.cc:333] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a: stopping tablet replica
I20260709 12:16:21.885406 22903 raft_consensus.cc:2243] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:21.885805 22903 raft_consensus.cc:2272] T ea5bbd78cc174df8a53a1cc887fb6969 P 644a670f55a9495b97a3621521f9493a [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:22.002920 23153 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.93.193:42131: connect: Connection refused (error 111)
I20260709 12:16:22.004992 22903 tablet_server.cc:196] TabletServer@127.22.93.193:0 shutdown complete.
W20260709 12:16:22.009132 23153 consensus_peers.cc:597] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f -> Peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Couldn't send request to peer 644a670f55a9495b97a3621521f9493a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:42131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:22.009428 23079 consensus_peers.cc:597] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 -> Peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Couldn't send request to peer 644a670f55a9495b97a3621521f9493a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:42131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:16:22.026803 23079 consensus_peers.cc:597] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 -> Peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Couldn't send request to peer 644a670f55a9495b97a3621521f9493a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:42131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.034662 22903 tablet_server.cc:179] TabletServer@127.22.93.194:0 shutting down...
I20260709 12:16:22.067953 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:22.068754 22903 tablet_replica.cc:333] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0: stopping tablet replica
I20260709 12:16:22.069491 22903 raft_consensus.cc:2243] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.070024 22903 raft_consensus.cc:2272] T e091cad3d2d64ea08c86210eec7729e2 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.072197 22903 tablet_replica.cc:333] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0: stopping tablet replica
I20260709 12:16:22.072753 22903 raft_consensus.cc:2243] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.073624 22903 raft_consensus.cc:2272] T af3785b4b18447e5810e769747b1e306 P 9acc9ee56e54412c933503a95e6074b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.075678 22903 tablet_replica.cc:333] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0: stopping tablet replica
I20260709 12:16:22.076418 22903 raft_consensus.cc:2243] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.077310 22903 raft_consensus.cc:2272] T 47a40fd692cb46e9a97550802a74d4ed P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.079319 22903 tablet_replica.cc:333] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0: stopping tablet replica
I20260709 12:16:22.079911 22903 raft_consensus.cc:2243] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.080394 22903 raft_consensus.cc:2272] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 9acc9ee56e54412c933503a95e6074b0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.082223 22903 tablet_replica.cc:333] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0: stopping tablet replica
I20260709 12:16:22.082778 22903 raft_consensus.cc:2243] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.083316 22903 raft_consensus.cc:2272] T 1d096557add543d19d63cb64c9c15f02 P 9acc9ee56e54412c933503a95e6074b0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.085228 22903 tablet_replica.cc:333] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0: stopping tablet replica
I20260709 12:16:22.085757 22903 raft_consensus.cc:2243] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.086216 22903 raft_consensus.cc:2272] T 00f25518694a414583a82b55d28454d6 P 9acc9ee56e54412c933503a95e6074b0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.088068 22903 tablet_replica.cc:333] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0: stopping tablet replica
I20260709 12:16:22.088598 22903 raft_consensus.cc:2243] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.089038 22903 raft_consensus.cc:2272] T a41e0f548cfc4b239e855069d87af82c P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.091399 22903 tablet_replica.cc:333] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0: stopping tablet replica
I20260709 12:16:22.091928 22903 raft_consensus.cc:2243] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.092818 22903 raft_consensus.cc:2272] T 1b99eb1c94d9406a9a5235850c23a334 P 9acc9ee56e54412c933503a95e6074b0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.094559 22903 tablet_replica.cc:333] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0: stopping tablet replica
I20260709 12:16:22.095121 22903 raft_consensus.cc:2243] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.095570 22903 raft_consensus.cc:2272] T ea5bbd78cc174df8a53a1cc887fb6969 P 9acc9ee56e54412c933503a95e6074b0 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:22.111999 23153 consensus_peers.cc:597] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f -> Peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Couldn't send request to peer 644a670f55a9495b97a3621521f9493a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:42131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.152020 22903 tablet_server.cc:196] TabletServer@127.22.93.194:0 shutdown complete.
I20260709 12:16:22.175696 22903 tablet_server.cc:179] TabletServer@127.22.93.195:0 shutting down...
W20260709 12:16:22.184998 23153 consensus_peers.cc:597] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f -> Peer 644a670f55a9495b97a3621521f9493a (127.22.93.193:42131): Couldn't send request to peer 644a670f55a9495b97a3621521f9493a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:42131: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:22.213387 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:22.214388 22903 tablet_replica.cc:333] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f: stopping tablet replica
I20260709 12:16:22.215420 22903 raft_consensus.cc:2243] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.216562 22903 raft_consensus.cc:2272] T ea5bbd78cc174df8a53a1cc887fb6969 P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.218828 22903 tablet_replica.cc:333] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f: stopping tablet replica
I20260709 12:16:22.219424 22903 raft_consensus.cc:2243] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.220252 22903 raft_consensus.cc:2272] T e091cad3d2d64ea08c86210eec7729e2 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.222229 22903 tablet_replica.cc:333] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f: stopping tablet replica
I20260709 12:16:22.222685 22903 raft_consensus.cc:2243] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.223158 22903 raft_consensus.cc:2272] T af3785b4b18447e5810e769747b1e306 P 00913dfef0304840b0b59b385a3c571f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.224917 22903 tablet_replica.cc:333] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f: stopping tablet replica
I20260709 12:16:22.225440 22903 raft_consensus.cc:2243] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.225903 22903 raft_consensus.cc:2272] T a41e0f548cfc4b239e855069d87af82c P 00913dfef0304840b0b59b385a3c571f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.227751 22903 tablet_replica.cc:333] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f: stopping tablet replica
I20260709 12:16:22.228215 22903 raft_consensus.cc:2243] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.228574 22903 raft_consensus.cc:2272] T 1b99eb1c94d9406a9a5235850c23a334 P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.230414 22903 tablet_replica.cc:333] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f: stopping tablet replica
I20260709 12:16:22.230892 22903 raft_consensus.cc:2243] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.231325 22903 raft_consensus.cc:2272] T 47a40fd692cb46e9a97550802a74d4ed P 00913dfef0304840b0b59b385a3c571f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.232919 22903 tablet_replica.cc:333] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f: stopping tablet replica
I20260709 12:16:22.233355 22903 raft_consensus.cc:2243] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.233727 22903 raft_consensus.cc:2272] T 41f6cb2b474b4ebe8c74377bfd9efcb7 P 00913dfef0304840b0b59b385a3c571f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.235560 22903 tablet_replica.cc:333] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f: stopping tablet replica
I20260709 12:16:22.236101 22903 raft_consensus.cc:2243] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.236922 22903 raft_consensus.cc:2272] T 00f25518694a414583a82b55d28454d6 P 00913dfef0304840b0b59b385a3c571f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.238616 22903 tablet_replica.cc:333] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f: stopping tablet replica
I20260709 12:16:22.239125 22903 raft_consensus.cc:2243] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:22.239538 22903 raft_consensus.cc:2272] T 1d096557add543d19d63cb64c9c15f02 P 00913dfef0304840b0b59b385a3c571f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.288666 22903 tablet_server.cc:196] TabletServer@127.22.93.195:0 shutdown complete.
I20260709 12:16:22.311058 22903 master.cc:562] Master@127.22.93.254:40305 shutting down...
I20260709 12:16:22.540166 22903 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:22.540894 22903 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:22.541215 22903 tablet_replica.cc:333] T 00000000000000000000000000000000 P 13dd589a12404f71a4ab2518f1ae363d: stopping tablet replica
I20260709 12:16:22.562544 22903 master.cc:584] Master@127.22.93.254:40305 shutdown complete.
00913dfef0304840b0b59b385a3c571f  1
644a670f55a9495b97a3621521f9493a  4
9acc9ee56e54412c933503a95e6074b0  4
00913dfef0304840b0b59b385a3c571f  3
644a670f55a9495b97a3621521f9493a  3
9acc9ee56e54412c933503a95e6074b0  3
00913dfef0304840b0b59b385a3c571f  1
644a670f55a9495b97a3621521f9493a  0
9acc9ee56e54412c933503a95e6074b0  8
00913dfef0304840b0b59b385a3c571f  3
644a670f55a9495b97a3621521f9493a  3
9acc9ee56e54412c933503a95e6074b0  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (33589 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:16:22.612399 22903 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.93.254:35107
I20260709 12:16:22.613852 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:22.620464 23457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:22.621606 23460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:22.621693 23458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:22.622928 22903 server_base.cc:1061] running on GCE node
I20260709 12:16:22.624394 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:22.624588 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:22.624724 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599382624698 us; error 0 us; skew 500 ppm
I20260709 12:16:22.625236 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:22.628021 22903 webserver.cc:533] Webserver started at http://127.22.93.254:45307/ using document root <none> and password file <none>
I20260709 12:16:22.628571 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:22.628780 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:22.629086 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:22.630422 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/master-0-root/instance:
uuid: "200fb92e72654cbbb4012971a09d4586"
format_stamp: "Formatted at 2026-07-09 12:16:22 on dist-test-slave-k289"
I20260709 12:16:22.636371 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.005s
I20260709 12:16:22.640681 23465 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:22.641623 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:16:22.641944 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/master-0-root
uuid: "200fb92e72654cbbb4012971a09d4586"
format_stamp: "Formatted at 2026-07-09 12:16:22 on dist-test-slave-k289"
I20260709 12:16:22.642218 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:22.698356 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:22.699910 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:22.745064 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.254:35107
I20260709 12:16:22.745191 23516 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.254:35107 every 8 connection(s)
I20260709 12:16:22.749681 23517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:22.760903 23517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586: Bootstrap starting.
I20260709 12:16:22.766489 23517 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:22.771512 23517 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586: No bootstrap required, opened a new log
I20260709 12:16:22.774194 23517 raft_consensus.cc:359] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200fb92e72654cbbb4012971a09d4586" member_type: VOTER }
I20260709 12:16:22.774729 23517 raft_consensus.cc:385] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:22.775018 23517 raft_consensus.cc:740] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 200fb92e72654cbbb4012971a09d4586, State: Initialized, Role: FOLLOWER
I20260709 12:16:22.775660 23517 consensus_queue.cc:260] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200fb92e72654cbbb4012971a09d4586" member_type: VOTER }
I20260709 12:16:22.776173 23517 raft_consensus.cc:399] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:22.776419 23517 raft_consensus.cc:493] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:22.776669 23517 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:22.781351 23517 raft_consensus.cc:515] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200fb92e72654cbbb4012971a09d4586" member_type: VOTER }
I20260709 12:16:22.782105 23517 leader_election.cc:304] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 200fb92e72654cbbb4012971a09d4586; no voters: 
I20260709 12:16:22.783630 23517 leader_election.cc:290] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:22.784102 23520 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:22.785742 23520 raft_consensus.cc:697] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 1 LEADER]: Becoming Leader. State: Replica: 200fb92e72654cbbb4012971a09d4586, State: Running, Role: LEADER
I20260709 12:16:22.786548 23520 consensus_queue.cc:237] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200fb92e72654cbbb4012971a09d4586" member_type: VOTER }
I20260709 12:16:22.787248 23517 sys_catalog.cc:565] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:22.792562 23522 sys_catalog.cc:455] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 200fb92e72654cbbb4012971a09d4586. Latest consensus state: current_term: 1 leader_uuid: "200fb92e72654cbbb4012971a09d4586" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200fb92e72654cbbb4012971a09d4586" member_type: VOTER } }
I20260709 12:16:22.793500 23522 sys_catalog.cc:458] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:22.793453 23521 sys_catalog.cc:455] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "200fb92e72654cbbb4012971a09d4586" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "200fb92e72654cbbb4012971a09d4586" member_type: VOTER } }
I20260709 12:16:22.794268 23521 sys_catalog.cc:458] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:22.801681 23528 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:22.811316 23528 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:22.812501 22903 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:22.821841 23528 catalog_manager.cc:1383] Generated new cluster ID: 4d57c6b919c147baaa316e70370f395b
I20260709 12:16:22.822171 23528 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:22.836555 23528 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:22.837952 23528 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:22.852653 23528 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586: Generated new TSK 0
I20260709 12:16:22.853344 23528 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:22.879222 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:22.886276 23538 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:22.887857 23539 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:22.889380 23541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:22.890653 22903 server_base.cc:1061] running on GCE node
I20260709 12:16:22.891966 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:22.892185 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:22.892387 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599382892363 us; error 0 us; skew 500 ppm
I20260709 12:16:22.892992 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:22.895877 22903 webserver.cc:533] Webserver started at http://127.22.93.193:38375/ using document root <none> and password file <none>
I20260709 12:16:22.896461 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:22.896689 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:22.897029 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:22.898352 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-0-root/instance:
uuid: "330862e4eccf4112ba00dd6519a1c431"
format_stamp: "Formatted at 2026-07-09 12:16:22 on dist-test-slave-k289"
I20260709 12:16:22.903666 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:16:22.907527 23546 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:22.908310 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:16:22.908643 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "330862e4eccf4112ba00dd6519a1c431"
format_stamp: "Formatted at 2026-07-09 12:16:22 on dist-test-slave-k289"
I20260709 12:16:22.908943 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:22.922231 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:22.923854 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:22.925603 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:22.928236 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:22.928429 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:22.928738 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:22.928920 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:22.975780 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:41347
I20260709 12:16:22.975857 23608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:41347 every 8 connection(s)
I20260709 12:16:22.981346 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:22.989055 23613 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:22.990944 23614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:22.996599 23609 heartbeater.cc:344] Connected to a master server at 127.22.93.254:35107
I20260709 12:16:22.997159 23609 heartbeater.cc:461] Registering TS with master...
W20260709 12:16:22.998420 23616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:22.998458 22903 server_base.cc:1061] running on GCE node
I20260709 12:16:22.998534 23609 heartbeater.cc:507] Master 127.22.93.254:35107 requested a full tablet report, sending...
I20260709 12:16:23.000378 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.000629 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.000852 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599383000831 us; error 0 us; skew 500 ppm
I20260709 12:16:23.001551 23482 ts_manager.cc:194] Registered new tserver with Master: 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347)
I20260709 12:16:23.001693 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.004392 23482 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54248
I20260709 12:16:23.005167 22903 webserver.cc:533] Webserver started at http://127.22.93.194:37895/ using document root <none> and password file <none>
I20260709 12:16:23.005914 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.006172 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.006429 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.007721 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-1-root/instance:
uuid: "91b57400a7c74294b1b92de306b07de4"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-k289"
I20260709 12:16:23.012524 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:16:23.016085 23621 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.016851 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:23.017155 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-1-root
uuid: "91b57400a7c74294b1b92de306b07de4"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-k289"
I20260709 12:16:23.017449 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.036734 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.038123 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.039732 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:23.042085 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:23.042322 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.042582 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:23.042762 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.086825 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.194:34517
I20260709 12:16:23.086939 23683 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.194:34517 every 8 connection(s)
I20260709 12:16:23.092187 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:23.100322 23687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.102134 23688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:23.103811 23690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:23.104873 22903 server_base.cc:1061] running on GCE node
I20260709 12:16:23.106024 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:23.106217 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:23.106455 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599383106416 us; error 0 us; skew 500 ppm
I20260709 12:16:23.107111 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:23.107276 23684 heartbeater.cc:344] Connected to a master server at 127.22.93.254:35107
I20260709 12:16:23.107714 23684 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.108783 23684 heartbeater.cc:507] Master 127.22.93.254:35107 requested a full tablet report, sending...
I20260709 12:16:23.110224 22903 webserver.cc:533] Webserver started at http://127.22.93.195:46189/ using document root <none> and password file <none>
I20260709 12:16:23.110919 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:23.111209 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:23.111338 23482 ts_manager.cc:194] Registered new tserver with Master: 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:23.111523 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:23.112859 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-2-root/instance:
uuid: "79ecaafdb5ee4c3095ccf052f2079451"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-k289"
I20260709 12:16:23.112938 23482 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54258
I20260709 12:16:23.117704 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:23.121516 23695 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.122267 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:23.122617 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-2-root
uuid: "79ecaafdb5ee4c3095ccf052f2079451"
format_stamp: "Formatted at 2026-07-09 12:16:23 on dist-test-slave-k289"
I20260709 12:16:23.122977 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599348838328-22903-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:23.139568 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:23.141146 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:23.142813 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:23.145605 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:23.145864 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.146137 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:23.146327 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:23.192471 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.195:39333
I20260709 12:16:23.192593 23757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.195:39333 every 8 connection(s)
I20260709 12:16:23.208669 23758 heartbeater.cc:344] Connected to a master server at 127.22.93.254:35107
I20260709 12:16:23.209183 23758 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:23.210150 23758 heartbeater.cc:507] Master 127.22.93.254:35107 requested a full tablet report, sending...
I20260709 12:16:23.212399 23482 ts_manager.cc:194] Registered new tserver with Master: 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:23.213261 22903 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017184565s
I20260709 12:16:23.213958 23482 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54270
I20260709 12:16:23.243062 23482 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54282:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:23.246536 23482 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:23.344184 23723 tablet_service.cc:1511] Processing CreateTablet for tablet ebe53913015b4828b154e59e4a971617 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:23.345963 23723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe53913015b4828b154e59e4a971617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.352491 23722 tablet_service.cc:1511] Processing CreateTablet for tablet b8ca276fa91d404f8ad556bd666c0d01 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:23.352979 23721 tablet_service.cc:1511] Processing CreateTablet for tablet be694eb33fb04855b2299a61ed9d6689 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:23.354197 23722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ca276fa91d404f8ad556bd666c0d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.355383 23720 tablet_service.cc:1511] Processing CreateTablet for tablet aad041ed5f474ef69666a9c72d93a943 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:23.356308 23648 tablet_service.cc:1511] Processing CreateTablet for tablet b8ca276fa91d404f8ad556bd666c0d01 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:23.356910 23720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad041ed5f474ef69666a9c72d93a943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.357928 23648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ca276fa91d404f8ad556bd666c0d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.358841 23570 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca15dc948854a41bb785b223ab17a90 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:23.359781 23649 tablet_service.cc:1511] Processing CreateTablet for tablet ebe53913015b4828b154e59e4a971617 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:23.360311 23570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca15dc948854a41bb785b223ab17a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.361234 23649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe53913015b4828b154e59e4a971617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.360325 23647 tablet_service.cc:1511] Processing CreateTablet for tablet be694eb33fb04855b2299a61ed9d6689 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:23.364321 23643 tablet_service.cc:1511] Processing CreateTablet for tablet ee2ab659c8ee44b1a9ff34956ddd9abf (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:23.362907 23647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be694eb33fb04855b2299a61ed9d6689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.365697 23718 tablet_service.cc:1511] Processing CreateTablet for tablet f2ecab16e3c24bca9c01429e360d6cf3 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:23.366892 23644 tablet_service.cc:1511] Processing CreateTablet for tablet f2ecab16e3c24bca9c01429e360d6cf3 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:23.368347 23644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ecab16e3c24bca9c01429e360d6cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.368279 23574 tablet_service.cc:1511] Processing CreateTablet for tablet ebe53913015b4828b154e59e4a971617 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:16:23.369755 23574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ebe53913015b4828b154e59e4a971617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.372303 23573 tablet_service.cc:1511] Processing CreateTablet for tablet b8ca276fa91d404f8ad556bd666c0d01 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:16:23.373857 23573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8ca276fa91d404f8ad556bd666c0d01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.373517 23646 tablet_service.cc:1511] Processing CreateTablet for tablet aad041ed5f474ef69666a9c72d93a943 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:23.375059 23646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad041ed5f474ef69666a9c72d93a943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.376394 23572 tablet_service.cc:1511] Processing CreateTablet for tablet be694eb33fb04855b2299a61ed9d6689 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:16:23.377902 23572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be694eb33fb04855b2299a61ed9d6689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.379412 23643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2ab659c8ee44b1a9ff34956ddd9abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.380344 23571 tablet_service.cc:1511] Processing CreateTablet for tablet aad041ed5f474ef69666a9c72d93a943 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:16:23.381831 23571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aad041ed5f474ef69666a9c72d93a943. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.384353 23569 tablet_service.cc:1511] Processing CreateTablet for tablet f2ecab16e3c24bca9c01429e360d6cf3 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:16:23.385842 23569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ecab16e3c24bca9c01429e360d6cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.388309 23568 tablet_service.cc:1511] Processing CreateTablet for tablet ee2ab659c8ee44b1a9ff34956ddd9abf (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:23.389757 23568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2ab659c8ee44b1a9ff34956ddd9abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.372313 23645 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca15dc948854a41bb785b223ab17a90 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:23.392892 23645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca15dc948854a41bb785b223ab17a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.364338 23719 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca15dc948854a41bb785b223ab17a90 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:16:23.396885 23718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2ecab16e3c24bca9c01429e360d6cf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.399417 23721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be694eb33fb04855b2299a61ed9d6689. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.408546 23719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca15dc948854a41bb785b223ab17a90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.432639 23773 tablet_bootstrap.cc:492] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
I20260709 12:16:23.450265 23648 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa2747d4c204a44b2fe8c3e36f72a98 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:23.451897 23648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa2747d4c204a44b2fe8c3e36f72a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.457626 23567 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa2747d4c204a44b2fe8c3e36f72a98 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:23.460350 23566 tablet_service.cc:1511] Processing CreateTablet for tablet 540b0b5949df44c3b69ddd1ee4e9244c (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:23.462709 23567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa2747d4c204a44b2fe8c3e36f72a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.467470 23566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540b0b5949df44c3b69ddd1ee4e9244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.472369 23723 tablet_service.cc:1511] Processing CreateTablet for tablet 0fa2747d4c204a44b2fe8c3e36f72a98 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:16:23.473934 23723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fa2747d4c204a44b2fe8c3e36f72a98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.475911 23722 tablet_service.cc:1511] Processing CreateTablet for tablet ee2ab659c8ee44b1a9ff34956ddd9abf (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:16:23.478015 23644 tablet_service.cc:1511] Processing CreateTablet for tablet 540b0b5949df44c3b69ddd1ee4e9244c (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:23.479583 23644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540b0b5949df44c3b69ddd1ee4e9244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.489632 23774 tablet_bootstrap.cc:492] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:23.493422 23722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee2ab659c8ee44b1a9ff34956ddd9abf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.505592 23717 tablet_service.cc:1511] Processing CreateTablet for tablet 540b0b5949df44c3b69ddd1ee4e9244c (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:16:23.508889 23565 tablet_service.cc:1511] Processing CreateTablet for tablet 253d1f9706824309b87c80d03a20abb5 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:23.510453 23565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253d1f9706824309b87c80d03a20abb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.511186 23717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 540b0b5949df44c3b69ddd1ee4e9244c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.513178 23773 tablet_bootstrap.cc:654] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.524259 23643 tablet_service.cc:1511] Processing CreateTablet for tablet 253d1f9706824309b87c80d03a20abb5 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:23.528378 23716 tablet_service.cc:1511] Processing CreateTablet for tablet 253d1f9706824309b87c80d03a20abb5 (DEFAULT_TABLE table=test-workload [id=fbc82846e45048c891fb6991f5e24e6c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:16:23.529922 23716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253d1f9706824309b87c80d03a20abb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.532196 23643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 253d1f9706824309b87c80d03a20abb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:23.539152 23774 tablet_bootstrap.cc:654] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.621524 23776 tablet_bootstrap.cc:492] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:23.627144 23774 tablet_bootstrap.cc:492] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:23.627696 23774 ts_tablet_manager.cc:1403] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.139s	user 0.030s	sys 0.015s
I20260709 12:16:23.623555 23773 tablet_bootstrap.cc:492] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:23.629684 23773 ts_tablet_manager.cc:1403] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.198s	user 0.016s	sys 0.031s
I20260709 12:16:23.630790 23774 raft_consensus.cc:359] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.631618 23774 raft_consensus.cc:385] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.631930 23774 raft_consensus.cc:740] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.632539 23776 tablet_bootstrap.cc:654] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.632653 23774 consensus_queue.cc:260] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.633090 23773 raft_consensus.cc:359] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.633888 23773 raft_consensus.cc:385] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.634202 23773 raft_consensus.cc:740] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.635164 23684 heartbeater.cc:499] Master 127.22.93.254:35107 was elected leader, sending a full tablet report...
I20260709 12:16:23.635671 23774 ts_tablet_manager.cc:1434] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:23.636525 23774 tablet_bootstrap.cc:492] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:23.643190 23774 tablet_bootstrap.cc:654] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.644623 23776 tablet_bootstrap.cc:492] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:23.645185 23776 ts_tablet_manager.cc:1403] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.011s
I20260709 12:16:23.647090 23773 consensus_queue.cc:260] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.648541 23776 raft_consensus.cc:359] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.649209 23774 tablet_bootstrap.cc:492] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:23.649550 23776 raft_consensus.cc:385] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.649837 23774 ts_tablet_manager.cc:1403] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 12:16:23.649994 23776 raft_consensus.cc:740] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.651160 23776 consensus_queue.cc:260] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.653656 23774 raft_consensus.cc:359] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.654517 23774 raft_consensus.cc:385] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.654928 23774 raft_consensus.cc:740] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.655967 23774 consensus_queue.cc:260] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.658277 23774 ts_tablet_manager.cc:1434] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:23.659514 23774 tablet_bootstrap.cc:492] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:23.667027 23774 tablet_bootstrap.cc:654] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.677908 23758 heartbeater.cc:499] Master 127.22.93.254:35107 was elected leader, sending a full tablet report...
I20260709 12:16:23.678663 23773 ts_tablet_manager.cc:1434] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.049s	user 0.013s	sys 0.009s
I20260709 12:16:23.680207 23773 tablet_bootstrap.cc:492] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
W20260709 12:16:23.697172 23759 tablet.cc:2406] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:23.699599 23781 raft_consensus.cc:493] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.700380 23781 raft_consensus.cc:515] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.704291 23609 heartbeater.cc:499] Master 127.22.93.254:35107 was elected leader, sending a full tablet report...
I20260709 12:16:23.704871 23776 ts_tablet_manager.cc:1434] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.059s	user 0.035s	sys 0.021s
I20260709 12:16:23.706004 23776 tablet_bootstrap.cc:492] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:23.707962 23781 leader_election.cc:290] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:23.714221 23776 tablet_bootstrap.cc:654] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.704317 23782 raft_consensus.cc:493] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.702203 23773 tablet_bootstrap.cc:654] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.724411 23782 raft_consensus.cc:515] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.732041 23774 tablet_bootstrap.cc:492] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:23.732823 23774 ts_tablet_manager.cc:1403] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.003s
I20260709 12:16:23.737913 23774 raft_consensus.cc:359] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.738960 23774 raft_consensus.cc:385] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.739374 23774 raft_consensus.cc:740] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.740450 23774 consensus_queue.cc:260] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.749500 23774 ts_tablet_manager.cc:1434] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 12:16:23.750929 23774 tablet_bootstrap.cc:492] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:23.759910 23774 tablet_bootstrap.cc:654] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.780184 23782 leader_election.cc:290] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:23.786718 23776 tablet_bootstrap.cc:492] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:23.787137 23773 tablet_bootstrap.cc:492] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:23.787358 23776 ts_tablet_manager.cc:1403] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.082s	user 0.038s	sys 0.040s
I20260709 12:16:23.787693 23773 ts_tablet_manager.cc:1403] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.108s	user 0.007s	sys 0.010s
I20260709 12:16:23.789588 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:23.791065 23776 raft_consensus.cc:359] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.791296 23773 raft_consensus.cc:359] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:23.791869 23776 raft_consensus.cc:385] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.792094 23773 raft_consensus.cc:385] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.792215 23776 raft_consensus.cc:740] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.792462 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
I20260709 12:16:23.793183 23659 raft_consensus.cc:2468] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 0.
I20260709 12:16:23.793229 23776 consensus_queue.cc:260] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.792479 23773 raft_consensus.cc:740] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.795626 23776 ts_tablet_manager.cc:1434] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:16:23.795814 23697 leader_election.cc:304] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:23.796808 23781 raft_consensus.cc:2804] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.797158 23781 raft_consensus.cc:493] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.796094 23773 consensus_queue.cc:260] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:23.797573 23781 raft_consensus.cc:3060] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:23.799463 23696 leader_election.cc:343] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.800190 23776 tablet_bootstrap.cc:492] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:23.801179 23773 ts_tablet_manager.cc:1434] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
W20260709 12:16:23.805135 23530 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:23.807041 23778 raft_consensus.cc:493] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.807570 23778 raft_consensus.cc:515] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.809665 23776 tablet_bootstrap.cc:654] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.811602 23778 leader_election.cc:290] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:23.815354 23774 tablet_bootstrap.cc:492] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:23.815923 23774 ts_tablet_manager.cc:1403] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.017s
I20260709 12:16:23.819446 23774 raft_consensus.cc:359] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:23.820156 23774 raft_consensus.cc:385] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.820432 23774 raft_consensus.cc:740] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.821184 23774 consensus_queue.cc:260] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:23.830183 23781 raft_consensus.cc:515] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.831938 23773 tablet_bootstrap.cc:492] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
I20260709 12:16:23.832948 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
W20260709 12:16:23.834885 23548 leader_election.cc:343] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.836555 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
W20260709 12:16:23.838897 23547 leader_election.cc:343] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.839426 23547 leader_election.cc:304] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431; no voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4
I20260709 12:16:23.840801 23782 raft_consensus.cc:2749] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.843441 23774 ts_tablet_manager.cc:1434] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.001s
I20260709 12:16:23.846848 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:23.847591 23659 raft_consensus.cc:3060] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.843932 23781 leader_election.cc:290] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:23.848232 23774 tablet_bootstrap.cc:492] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:23.848752 23773 tablet_bootstrap.cc:654] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.854616 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
W20260709 12:16:23.856329 23696 leader_election.cc:343] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.859619 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
W20260709 12:16:23.861039 23622 leader_election.cc:343] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.861159 23774 tablet_bootstrap.cc:654] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.863806 23659 raft_consensus.cc:2468] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 1.
I20260709 12:16:23.864751 23776 tablet_bootstrap.cc:492] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:23.866604 23776 ts_tablet_manager.cc:1403] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.067s	user 0.021s	sys 0.014s
I20260709 12:16:23.870093 23776 raft_consensus.cc:359] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.870877 23776 raft_consensus.cc:385] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.871497 23776 raft_consensus.cc:740] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.871961 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:23.872332 23776 consensus_queue.cc:260] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
W20260709 12:16:23.873562 23622 leader_election.cc:343] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.874009 23774 tablet_bootstrap.cc:492] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:23.874028 23622 leader_election.cc:304] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91b57400a7c74294b1b92de306b07de4; no voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451
I20260709 12:16:23.874603 23776 ts_tablet_manager.cc:1434] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:16:23.874631 23774 ts_tablet_manager.cc:1403] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.001s
I20260709 12:16:23.874956 23778 raft_consensus.cc:2749] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.875819 23776 tablet_bootstrap.cc:492] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:23.878091 23774 raft_consensus.cc:359] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.865967 23773 tablet_bootstrap.cc:492] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:23.879981 23773 ts_tablet_manager.cc:1403] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.009s
I20260709 12:16:23.880431 23697 leader_election.cc:304] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:23.881700 23781 raft_consensus.cc:2804] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.882247 23781 raft_consensus.cc:697] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Becoming Leader. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:23.882468 23776 tablet_bootstrap.cc:654] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.883219 23781 consensus_queue.cc:237] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.884661 23773 raft_consensus.cc:359] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.885481 23773 raft_consensus.cc:385] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.885910 23773 raft_consensus.cc:740] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.886925 23773 consensus_queue.cc:260] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.878855 23774 raft_consensus.cc:385] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.888358 23774 raft_consensus.cc:740] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.889653 23774 consensus_queue.cc:260] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.893064 23774 ts_tablet_manager.cc:1434] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:16:23.894539 23774 tablet_bootstrap.cc:492] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:23.894481 23481 catalog_manager.cc:5697] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195). New cstate: current_term: 1 leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:23.901321 23773 ts_tablet_manager.cc:1434] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:16:23.902944 23773 tablet_bootstrap.cc:492] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
I20260709 12:16:23.908345 23776 tablet_bootstrap.cc:492] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:23.908957 23776 ts_tablet_manager.cc:1403] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.019s
I20260709 12:16:23.910495 23773 tablet_bootstrap.cc:654] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.912348 23776 raft_consensus.cc:359] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.913213 23776 raft_consensus.cc:385] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.913599 23776 raft_consensus.cc:740] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.915349 23776 consensus_queue.cc:260] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.920135 23774 tablet_bootstrap.cc:654] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.923866 23776 ts_tablet_manager.cc:1434] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.004s
I20260709 12:16:23.925724 23776 tablet_bootstrap.cc:492] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:23.934232 23778 raft_consensus.cc:493] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.934947 23778 raft_consensus.cc:515] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:23.937604 23776 tablet_bootstrap.cc:654] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.939368 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:23.940261 23733 raft_consensus.cc:2468] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 0.
I20260709 12:16:23.942191 23622 leader_election.cc:304] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:23.944643 23778 leader_election.cc:290] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333), 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347)
I20260709 12:16:23.945420 23778 raft_consensus.cc:2804] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:23.945895 23778 raft_consensus.cc:493] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:23.946381 23778 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.955935 23773 tablet_bootstrap.cc:492] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:23.956590 23773 ts_tablet_manager.cc:1403] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.036s
I20260709 12:16:23.960183 23773 raft_consensus.cc:359] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.960980 23773 raft_consensus.cc:385] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.961297 23773 raft_consensus.cc:740] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:23.962211 23773 consensus_queue.cc:260] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.963999 23807 raft_consensus.cc:493] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:23.964679 23773 ts_tablet_manager.cc:1434] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:23.964849 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:23.967154 23773 tablet_bootstrap.cc:492] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
I20260709 12:16:23.966465 23807 raft_consensus.cc:515] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
W20260709 12:16:23.967730 23622 leader_election.cc:343] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.965904 23774 tablet_bootstrap.cc:492] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:23.971156 23774 ts_tablet_manager.cc:1403] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.077s	user 0.023s	sys 0.000s
I20260709 12:16:23.973631 23776 tablet_bootstrap.cc:492] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:23.974201 23776 ts_tablet_manager.cc:1403] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.015s
I20260709 12:16:23.975136 23773 tablet_bootstrap.cc:654] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.977550 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:23.978782 23807 leader_election.cc:290] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:23.975328 23774 raft_consensus.cc:359] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.979789 23774 raft_consensus.cc:385] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:23.980016 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:23.969300 23778 raft_consensus.cc:515] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
W20260709 12:16:23.981626 23622 leader_election.cc:343] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.980307 23774 raft_consensus.cc:740] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
W20260709 12:16:23.982383 23622 leader_election.cc:343] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:23.982842 23622 leader_election.cc:304] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 91b57400a7c74294b1b92de306b07de4; no voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451
I20260709 12:16:23.983526 23778 leader_election.cc:290] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Requested vote from peers 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333), 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347)
I20260709 12:16:23.983170 23774 consensus_queue.cc:260] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.984102 23778 raft_consensus.cc:2749] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:23.984913 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:23.985513 23733 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:23.986068 23774 ts_tablet_manager.cc:1434] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:16:23.987157 23774 tablet_bootstrap.cc:492] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:23.993233 23733 raft_consensus.cc:2468] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 1.
I20260709 12:16:23.994642 23622 leader_election.cc:304] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:23.995133 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:23.995560 23807 raft_consensus.cc:2804] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:23.996071 23807 raft_consensus.cc:697] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Becoming Leader. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:23.996583 23774 tablet_bootstrap.cc:654] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:23.996695 23773 tablet_bootstrap.cc:492] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:23.997203 23773 ts_tablet_manager.cc:1403] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.001s
I20260709 12:16:23.996980 23807 consensus_queue.cc:237] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:23.998932 23776 raft_consensus.cc:359] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:23.999725 23776 raft_consensus.cc:385] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.000041 23776 raft_consensus.cc:740] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
W20260709 12:16:24.000743 23622 leader_election.cc:343] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.000952 23776 consensus_queue.cc:260] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.002758 23773 raft_consensus.cc:359] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.003670 23776 ts_tablet_manager.cc:1434] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:16:24.003746 23773 raft_consensus.cc:385] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.004292 23773 raft_consensus.cc:740] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.004894 23776 tablet_bootstrap.cc:492] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:24.005468 23773 consensus_queue.cc:260] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.008821 23773 ts_tablet_manager.cc:1434] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:16:24.011693 23783 raft_consensus.cc:493] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.012331 23783 raft_consensus.cc:515] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.016228 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:24.016990 23584 raft_consensus.cc:2468] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 0.
I20260709 12:16:24.017709 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
I20260709 12:16:24.018548 23659 raft_consensus.cc:2468] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 0.
I20260709 12:16:24.019867 23696 leader_election.cc:304] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451; no voters: 
I20260709 12:16:24.021023 23781 raft_consensus.cc:2804] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.021476 23781 raft_consensus.cc:493] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.021872 23781 raft_consensus.cc:3060] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.022505 23773 tablet_bootstrap.cc:492] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
I20260709 12:16:24.027294 23783 leader_election.cc:290] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:24.031937 23776 tablet_bootstrap.cc:654] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.032352 23781 raft_consensus.cc:515] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.035878 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:24.036492 23584 raft_consensus.cc:3060] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.037468 23773 tablet_bootstrap.cc:654] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.038028 23482 catalog_manager.cc:5697] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91b57400a7c74294b1b92de306b07de4 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "91b57400a7c74294b1b92de306b07de4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.044344 23781 leader_election.cc:290] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:24.047048 23774 tablet_bootstrap.cc:492] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:24.047204 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:24.047652 23774 ts_tablet_manager.cc:1403] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.001s
I20260709 12:16:24.047835 23659 raft_consensus.cc:3060] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.048236 23776 tablet_bootstrap.cc:492] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:24.048749 23776 ts_tablet_manager.cc:1403] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.006s
I20260709 12:16:24.051005 23774 raft_consensus.cc:359] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.051894 23776 raft_consensus.cc:359] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.052223 23774 raft_consensus.cc:385] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.052596 23776 raft_consensus.cc:385] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.052618 23774 raft_consensus.cc:740] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.052978 23776 raft_consensus.cc:740] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.053761 23776 consensus_queue.cc:260] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.053586 23774 consensus_queue.cc:260] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.056810 23584 raft_consensus.cc:2468] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 1.
I20260709 12:16:24.057509 23773 tablet_bootstrap.cc:492] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:24.058061 23773 ts_tablet_manager.cc:1403] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.036s	user 0.011s	sys 0.000s
I20260709 12:16:24.058180 23696 leader_election.cc:304] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451; no voters: 
I20260709 12:16:24.059119 23781 raft_consensus.cc:2804] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.059639 23781 raft_consensus.cc:697] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Becoming Leader. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:24.060861 23659 raft_consensus.cc:2468] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 1.
I20260709 12:16:24.060516 23781 consensus_queue.cc:237] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.061405 23773 raft_consensus.cc:359] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.062188 23773 raft_consensus.cc:385] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.062408 23783 raft_consensus.cc:493] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.062481 23773 raft_consensus.cc:740] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.063068 23783 raft_consensus.cc:515] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.063568 23773 consensus_queue.cc:260] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.064409 23776 ts_tablet_manager.cc:1434] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:16:24.065780 23776 tablet_bootstrap.cc:492] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:24.067721 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
I20260709 12:16:24.068499 23658 raft_consensus.cc:2468] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 0.
I20260709 12:16:24.071190 23697 leader_election.cc:304] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.073148 23783 leader_election.cc:290] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:24.075467 23776 tablet_bootstrap.cc:654] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.076563 23774 ts_tablet_manager.cc:1434] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:16:24.076469 23783 raft_consensus.cc:2804] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.077313 23783 raft_consensus.cc:493] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.077688 23783 raft_consensus.cc:3060] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.080044 23774 tablet_bootstrap.cc:492] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:24.082536 23782 raft_consensus.cc:493] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.083063 23782 raft_consensus.cc:515] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.085428 23782 leader_election.cc:290] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.087800 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:24.088610 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
W20260709 12:16:24.089181 23696 leader_election.cc:343] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.089279 23733 raft_consensus.cc:2468] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 0.
I20260709 12:16:24.090598 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
I20260709 12:16:24.091271 23658 raft_consensus.cc:2468] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 0.
I20260709 12:16:24.092492 23548 leader_election.cc:304] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.094549 23782 raft_consensus.cc:2804] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.095010 23782 raft_consensus.cc:493] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.095371 23782 raft_consensus.cc:3060] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.104188 23782 raft_consensus.cc:515] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.107261 23783 raft_consensus.cc:515] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.107666 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:24.108246 23658 raft_consensus.cc:3060] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.110466 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
W20260709 12:16:24.112005 23696 leader_election.cc:343] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.116259 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:24.116968 23659 raft_consensus.cc:3060] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.122259 23783 leader_election.cc:290] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:24.126011 23774 tablet_bootstrap.cc:654] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.133111 23480 catalog_manager.cc:5697] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195). New cstate: current_term: 1 leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.137048 23659 raft_consensus.cc:2468] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 1.
I20260709 12:16:24.137346 23658 raft_consensus.cc:2468] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 1.
I20260709 12:16:24.138621 23697 leader_election.cc:304] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:24.138765 23548 leader_election.cc:304] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.140079 23781 raft_consensus.cc:2804] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.140478 23782 leader_election.cc:290] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.140578 23781 raft_consensus.cc:697] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Becoming Leader. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:24.141253 23785 raft_consensus.cc:2804] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.141767 23785 raft_consensus.cc:697] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:24.141605 23781 consensus_queue.cc:237] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.142527 23773 ts_tablet_manager.cc:1434] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.084s	user 0.038s	sys 0.041s
I20260709 12:16:24.142627 23785 consensus_queue.cc:237] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.143675 23773 tablet_bootstrap.cc:492] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
I20260709 12:16:24.146047 23807 raft_consensus.cc:493] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.146548 23807 raft_consensus.cc:515] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.149080 23807 leader_election.cc:290] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.151592 23776 tablet_bootstrap.cc:492] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:24.151641 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:24.152453 23776 ts_tablet_manager.cc:1403] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.087s	user 0.027s	sys 0.035s
I20260709 12:16:24.152580 23733 raft_consensus.cc:3060] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.155215 23773 tablet_bootstrap.cc:654] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.155982 23776 raft_consensus.cc:359] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:24.156364 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:24.156909 23776 raft_consensus.cc:385] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.157400 23776 raft_consensus.cc:740] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.158527 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:24.158280 23776 consensus_queue.cc:260] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:24.159193 23584 raft_consensus.cc:2468] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 0.
W20260709 12:16:24.160014 23622 leader_election.cc:343] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.160970 23622 leader_election.cc:304] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 79ecaafdb5ee4c3095ccf052f2079451
I20260709 12:16:24.162513 23807 raft_consensus.cc:2804] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.163010 23807 raft_consensus.cc:493] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.163462 23807 raft_consensus.cc:3060] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.168799 23776 ts_tablet_manager.cc:1434] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 12:16:24.169991 23776 tablet_bootstrap.cc:492] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:24.170624 23773 tablet_bootstrap.cc:492] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:24.172851 23773 ts_tablet_manager.cc:1403] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.029s	user 0.005s	sys 0.009s
I20260709 12:16:24.176287 23773 raft_consensus.cc:359] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.177048 23773 raft_consensus.cc:385] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.177338 23773 raft_consensus.cc:740] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.177976 23776 tablet_bootstrap.cc:654] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.183719 23773 consensus_queue.cc:260] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.185393 23733 raft_consensus.cc:2468] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 1.
I20260709 12:16:24.190979 23773 ts_tablet_manager.cc:1434] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:16:24.199622 23778 raft_consensus.cc:493] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.205878 23778 raft_consensus.cc:515] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.206704 23773 tablet_bootstrap.cc:492] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
I20260709 12:16:24.208937 23778 leader_election.cc:290] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.211163 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:24.211521 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:24.211912 23584 raft_consensus.cc:2468] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 0.
I20260709 12:16:24.212121 23732 raft_consensus.cc:2468] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 0.
I20260709 12:16:24.198041 23480 catalog_manager.cc:5697] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 0 to 1, leader changed from <none> to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.213425 23622 leader_election.cc:304] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.214891 23778 raft_consensus.cc:2804] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.215276 23778 raft_consensus.cc:493] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.215624 23778 raft_consensus.cc:3060] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.218111 23773 tablet_bootstrap.cc:654] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.201030 23782 raft_consensus.cc:493] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.221372 23782 raft_consensus.cc:515] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:24.221776 23807 raft_consensus.cc:515] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.224115 23807 leader_election.cc:290] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.224915 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:24.225560 23584 raft_consensus.cc:3060] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.236070 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:24.236647 23584 raft_consensus.cc:2468] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 1.
W20260709 12:16:24.237928 23622 leader_election.cc:343] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.239318 23622 leader_election.cc:304] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 79ecaafdb5ee4c3095ccf052f2079451
I20260709 12:16:24.238668 23480 catalog_manager.cc:5697] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195). New cstate: current_term: 1 leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.240406 23774 tablet_bootstrap.cc:492] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:24.240783 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
I20260709 12:16:24.241080 23774 ts_tablet_manager.cc:1403] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.161s	user 0.031s	sys 0.019s
I20260709 12:16:24.243083 23782 leader_election.cc:290] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:24.243932 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:24.244902 23733 raft_consensus.cc:2393] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 330862e4eccf4112ba00dd6519a1c431 in current term 1: Already voted for candidate 91b57400a7c74294b1b92de306b07de4 in this term.
I20260709 12:16:24.245493 23774 raft_consensus.cc:359] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.246137 23547 leader_election.cc:304] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431; no voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4
I20260709 12:16:24.246448 23774 raft_consensus.cc:385] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.246847 23774 raft_consensus.cc:740] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.247435 23782 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.242668 23778 raft_consensus.cc:515] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.247998 23774 consensus_queue.cc:260] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.250727 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:24.251189 23807 raft_consensus.cc:2804] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.251402 23584 raft_consensus.cc:3060] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.254415 23774 ts_tablet_manager.cc:1434] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.013s	user 0.014s	sys 0.000s
I20260709 12:16:24.254158 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:24.254781 23778 leader_election.cc:290] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.255600 23733 raft_consensus.cc:3060] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.256839 23776 tablet_bootstrap.cc:492] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:24.257357 23776 ts_tablet_manager.cc:1403] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.088s	user 0.034s	sys 0.029s
I20260709 12:16:24.259091 23774 tablet_bootstrap.cc:492] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:24.260005 23776 raft_consensus.cc:359] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.260736 23776 raft_consensus.cc:385] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.261029 23776 raft_consensus.cc:740] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.263579 23776 consensus_queue.cc:260] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.266520 23776 ts_tablet_manager.cc:1434] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:16:24.267791 23776 tablet_bootstrap.cc:492] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:24.270865 23733 raft_consensus.cc:2468] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 1.
I20260709 12:16:24.272544 23622 leader_election.cc:304] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.273855 23778 raft_consensus.cc:2804] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.275087 23774 tablet_bootstrap.cc:654] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.274238 23807 raft_consensus.cc:697] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Becoming Leader. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:24.275206 23778 raft_consensus.cc:697] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Becoming Leader. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:24.276417 23807 consensus_queue.cc:237] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.277122 23584 raft_consensus.cc:2468] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 1.
I20260709 12:16:24.277236 23778 consensus_queue.cc:237] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.285007 23782 raft_consensus.cc:2749] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.295259 23776 tablet_bootstrap.cc:654] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.309386 23773 tablet_bootstrap.cc:492] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:24.309973 23773 ts_tablet_manager.cc:1403] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.104s	user 0.020s	sys 0.013s
I20260709 12:16:24.310534 23774 tablet_bootstrap.cc:492] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:24.311187 23774 ts_tablet_manager.cc:1403] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.003s
I20260709 12:16:24.311581 23481 catalog_manager.cc:5697] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91b57400a7c74294b1b92de306b07de4 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "91b57400a7c74294b1b92de306b07de4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.312583 23776 tablet_bootstrap.cc:492] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:24.313189 23776 ts_tablet_manager.cc:1403] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.012s
I20260709 12:16:24.313171 23773 raft_consensus.cc:359] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.314039 23773 raft_consensus.cc:385] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.314340 23773 raft_consensus.cc:740] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.313594 23481 catalog_manager.cc:5697] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91b57400a7c74294b1b92de306b07de4 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "91b57400a7c74294b1b92de306b07de4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.314173 23774 raft_consensus.cc:359] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.314919 23774 raft_consensus.cc:385] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.315225 23774 raft_consensus.cc:740] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.315410 23773 consensus_queue.cc:260] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.315914 23774 consensus_queue.cc:260] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.316759 23776 raft_consensus.cc:359] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.317427 23776 raft_consensus.cc:385] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.317840 23776 raft_consensus.cc:740] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.318202 23774 ts_tablet_manager.cc:1434] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:24.318447 23773 ts_tablet_manager.cc:1434] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:16:24.319209 23774 tablet_bootstrap.cc:492] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4: Bootstrap starting.
I20260709 12:16:24.318837 23776 consensus_queue.cc:260] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.319622 23773 tablet_bootstrap.cc:492] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
I20260709 12:16:24.323457 23782 raft_consensus.cc:493] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.323976 23782 raft_consensus.cc:515] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.326318 23774 tablet_bootstrap.cc:654] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.327584 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:24.328593 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
I20260709 12:16:24.329411 23658 raft_consensus.cc:2393] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 330862e4eccf4112ba00dd6519a1c431 in current term 1: Already voted for candidate 79ecaafdb5ee4c3095ccf052f2079451 in this term.
I20260709 12:16:24.326346 23773 tablet_bootstrap.cc:654] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.327234 23782 leader_election.cc:290] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.330719 23548 leader_election.cc:304] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431; no voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4
I20260709 12:16:24.331725 23776 ts_tablet_manager.cc:1434] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:24.331966 23782 raft_consensus.cc:3060] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.332803 23776 tablet_bootstrap.cc:492] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431: Bootstrap starting.
I20260709 12:16:24.339705 23776 tablet_bootstrap.cc:654] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.339918 23782 raft_consensus.cc:2749] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.342039 23773 tablet_bootstrap.cc:492] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:24.342547 23773 ts_tablet_manager.cc:1403] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.023s	user 0.003s	sys 0.013s
I20260709 12:16:24.346908 23773 raft_consensus.cc:359] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.347754 23773 raft_consensus.cc:385] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.348050 23773 raft_consensus.cc:740] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.348749 23773 consensus_queue.cc:260] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.351346 23773 ts_tablet_manager.cc:1434] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:16:24.352300 23773 tablet_bootstrap.cc:492] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451: Bootstrap starting.
I20260709 12:16:24.359999 23781 raft_consensus.cc:493] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.360569 23781 raft_consensus.cc:515] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.362828 23781 leader_election.cc:290] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:24.363106 23773 tablet_bootstrap.cc:654] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:24.363771 23774 tablet_bootstrap.cc:492] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4: No bootstrap required, opened a new log
I20260709 12:16:24.364367 23774 ts_tablet_manager.cc:1403] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4: Time spent bootstrapping tablet: real 0.045s	user 0.014s	sys 0.008s
I20260709 12:16:24.366678 23776 tablet_bootstrap.cc:492] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431: No bootstrap required, opened a new log
I20260709 12:16:24.366349 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:24.366335 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
W20260709 12:16:24.367980 23696 leader_election.cc:343] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:24.369095 23697 leader_election.cc:343] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:24.369545 23697 leader_election.cc:304] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451; no voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4
I20260709 12:16:24.370467 23781 raft_consensus.cc:2749] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.370903 23776 ts_tablet_manager.cc:1403] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.003s
I20260709 12:16:24.371306 23773 tablet_bootstrap.cc:492] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451: No bootstrap required, opened a new log
I20260709 12:16:24.371752 23773 ts_tablet_manager.cc:1403] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.001s
I20260709 12:16:24.371728 23778 raft_consensus.cc:493] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.369581 23774 raft_consensus.cc:359] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.372408 23778 raft_consensus.cc:515] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.372898 23774 raft_consensus.cc:385] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.373200 23774 raft_consensus.cc:740] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.374184 23773 raft_consensus.cc:359] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.374682 23778 leader_election.cc:290] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.374904 23773 raft_consensus.cc:385] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.376515 23773 raft_consensus.cc:740] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.376268 23774 consensus_queue.cc:260] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.377147 23773 consensus_queue.cc:260] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.378443 23774 ts_tablet_manager.cc:1434] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:16:24.375454 23776 raft_consensus.cc:359] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.375833 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:24.375864 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:24.379256 23773 ts_tablet_manager.cc:1434] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:24.379537 23776 raft_consensus.cc:385] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:24.379442 23733 raft_consensus.cc:2468] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 0.
I20260709 12:16:24.379881 23776 raft_consensus.cc:740] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Initialized, Role: FOLLOWER
I20260709 12:16:24.379446 23584 raft_consensus.cc:2468] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 0.
I20260709 12:16:24.380592 23776 consensus_queue.cc:260] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.380923 23782 raft_consensus.cc:493] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.381574 23622 leader_election.cc:304] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.381500 23782 raft_consensus.cc:515] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.382792 23776 ts_tablet_manager.cc:1434] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.000s
I20260709 12:16:24.383433 23778 raft_consensus.cc:2804] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.383775 23782 leader_election.cc:290] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.385097 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540b0b5949df44c3b69ddd1ee4e9244c" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
I20260709 12:16:24.385720 23658 raft_consensus.cc:2468] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 0.
I20260709 12:16:24.383790 23778 raft_consensus.cc:493] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.386642 23548 leader_election.cc:304] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.386976 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540b0b5949df44c3b69ddd1ee4e9244c" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:24.387679 23785 raft_consensus.cc:2804] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.388062 23785 raft_consensus.cc:493] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.388428 23785 raft_consensus.cc:3060] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.387236 23778 raft_consensus.cc:3060] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.387691 23733 raft_consensus.cc:2468] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 0.
I20260709 12:16:24.396468 23785 raft_consensus.cc:515] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.399573 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540b0b5949df44c3b69ddd1ee4e9244c" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:24.400214 23658 raft_consensus.cc:3060] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.400314 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540b0b5949df44c3b69ddd1ee4e9244c" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:24.401113 23733 raft_consensus.cc:3060] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.407630 23785 leader_election.cc:290] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.407959 23584 raft_consensus.cc:3060] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.407809 23778 raft_consensus.cc:515] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.409252 23658 raft_consensus.cc:2468] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 1.
I20260709 12:16:24.410966 23548 leader_election.cc:304] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.411343 23733 raft_consensus.cc:2468] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 1.
I20260709 12:16:24.411682 23583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:24.412556 23583 raft_consensus.cc:3060] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.412721 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:24.413403 23732 raft_consensus.cc:3060] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.411988 23785 raft_consensus.cc:2804] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.416174 23785 raft_consensus.cc:697] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:24.419937 23781 consensus_queue.cc:1048] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.421106 23732 raft_consensus.cc:2468] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 1.
I20260709 12:16:24.421919 23778 leader_election.cc:290] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.422677 23622 leader_election.cc:304] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.417141 23785 consensus_queue.cc:237] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.423571 23778 raft_consensus.cc:2804] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.426877 23781 consensus_queue.cc:1048] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.430928 23583 raft_consensus.cc:2468] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 1.
I20260709 12:16:24.425864 23778 raft_consensus.cc:697] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Becoming Leader. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:24.444657 23782 raft_consensus.cc:493] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.445398 23782 raft_consensus.cc:515] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.436939 23778 consensus_queue.cc:237] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.449218 23733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451" is_pre_election: true
I20260709 12:16:24.449949 23733 raft_consensus.cc:2468] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 0.
I20260709 12:16:24.450073 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
I20260709 12:16:24.450688 23658 raft_consensus.cc:2468] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 0.
I20260709 12:16:24.447889 23782 leader_election.cc:290] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.451472 23547 leader_election.cc:304] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451; no voters: 
I20260709 12:16:24.453270 23807 consensus_queue.cc:1048] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.455174 23782 raft_consensus.cc:2804] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:24.455724 23782 raft_consensus.cc:493] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:24.456080 23782 raft_consensus.cc:3060] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.471104 23782 raft_consensus.cc:515] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.470589 23482 catalog_manager.cc:5697] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91b57400a7c74294b1b92de306b07de4 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "91b57400a7c74294b1b92de306b07de4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.471549 23807 consensus_queue.cc:1048] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.474118 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:24.474748 23658 raft_consensus.cc:3060] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.486291 23658 raft_consensus.cc:2468] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 1.
I20260709 12:16:24.487799 23548 leader_election.cc:304] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.488874 23820 raft_consensus.cc:2804] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:24.491894 23820 raft_consensus.cc:697] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:24.492844 23820 consensus_queue.cc:237] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.498224 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:24.498910 23732 raft_consensus.cc:3060] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.508067 23732 raft_consensus.cc:2468] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 1.
I20260709 12:16:24.509511 23782 leader_election.cc:290] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 1 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.523343 23480 catalog_manager.cc:5697] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 0 to 1, leader changed from <none> to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.537463 23480 catalog_manager.cc:5697] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 0 to 1, leader changed from <none> to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:24.549808 23781 consensus_queue.cc:1048] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.555297 23781 consensus_queue.cc:1048] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.562089 23781 consensus_queue.cc:1048] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.571839 23783 consensus_queue.cc:1048] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.593334 23781 raft_consensus.cc:493] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:24.593983 23781 raft_consensus.cc:515] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.596426 23781 leader_election.cc:290] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:24.597267 23583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "330862e4eccf4112ba00dd6519a1c431" is_pre_election: true
I20260709 12:16:24.597769 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91b57400a7c74294b1b92de306b07de4" is_pre_election: true
I20260709 12:16:24.598295 23583 raft_consensus.cc:2393] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79ecaafdb5ee4c3095ccf052f2079451 in current term 1: Already voted for candidate 91b57400a7c74294b1b92de306b07de4 in this term.
I20260709 12:16:24.599601 23696 leader_election.cc:304] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451; no voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4
I20260709 12:16:24.600263 23781 raft_consensus.cc:3060] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:24.606261 23781 raft_consensus.cc:2749] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:24.608510 23785 consensus_queue.cc:1048] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.620121 23782 consensus_queue.cc:1048] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.727622 23778 consensus_queue.cc:1048] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.740640 23823 consensus_queue.cc:1048] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.787834 23823 consensus_queue.cc:1048] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.800771 23659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebe53913015b4828b154e59e4a971617"
dest_uuid: "91b57400a7c74294b1b92de306b07de4"
mode: GRACEFUL
new_leader_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:52682
I20260709 12:16:24.801635 23659 raft_consensus.cc:606] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Received request to transfer leadership to TS 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:24.804255 23823 consensus_queue.cc:1048] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.826192 23732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
mode: GRACEFUL
new_leader_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:55446
I20260709 12:16:24.826956 23732 raft_consensus.cc:606] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Received request to transfer leadership to TS 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:24.833287 23732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
mode: GRACEFUL
new_leader_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:55446
I20260709 12:16:24.833880 23732 raft_consensus.cc:606] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Received request to transfer leadership to TS 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:24.839576 23659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943"
dest_uuid: "91b57400a7c74294b1b92de306b07de4"
mode: GRACEFUL
new_leader_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:52682
I20260709 12:16:24.840176 23659 raft_consensus.cc:606] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Received request to transfer leadership to TS 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:24.853868 23732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
mode: GRACEFUL
new_leader_uuid: "91b57400a7c74294b1b92de306b07de4"
 from {username='slave'} at 127.0.0.1:55446
I20260709 12:16:24.854511 23732 raft_consensus.cc:606] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Received request to transfer leadership to TS 91b57400a7c74294b1b92de306b07de4
I20260709 12:16:24.875432 23583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "540b0b5949df44c3b69ddd1ee4e9244c"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
mode: GRACEFUL
new_leader_uuid: "91b57400a7c74294b1b92de306b07de4"
 from {username='slave'} at 127.0.0.1:43132
I20260709 12:16:24.876104 23583 raft_consensus.cc:606] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Received request to transfer leadership to TS 91b57400a7c74294b1b92de306b07de4
I20260709 12:16:24.882567 23583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
mode: GRACEFUL
new_leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:43132
I20260709 12:16:24.883405 23583 raft_consensus.cc:606] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Received request to transfer leadership to TS 79ecaafdb5ee4c3095ccf052f2079451
I20260709 12:16:24.885706 23782 consensus_queue.cc:1048] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.899340 23843 consensus_queue.cc:1048] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.911746 23843 raft_consensus.cc:993] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431: : Instructing follower 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:24.912297 23843 raft_consensus.cc:1081] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Signalling peer 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:24.913990 23843 consensus_queue.cc:1048] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:24.914448 23732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:55440
I20260709 12:16:24.915282 23732 raft_consensus.cc:493] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:24.916857 23732 raft_consensus.cc:3060] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.923616 23732 raft_consensus.cc:515] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.926959 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:24.926597 23583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "253d1f9706824309b87c80d03a20abb5" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:24.927752 23659 raft_consensus.cc:3060] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.932379 23782 consensus_queue.cc:1048] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:24.927810 23583 raft_consensus.cc:3055] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:24.933580 23583 raft_consensus.cc:740] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:24.934499 23583 consensus_queue.cc:260] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.935791 23583 raft_consensus.cc:3060] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.939498 23732 leader_election.cc:290] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 2 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:24.942777 23659 raft_consensus.cc:2468] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 2.
I20260709 12:16:24.944618 23697 leader_election.cc:304] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.945652 23781 raft_consensus.cc:2804] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:24.946192 23781 raft_consensus.cc:697] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 LEADER]: Becoming Leader. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:24.946651 23583 raft_consensus.cc:2468] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 2.
I20260709 12:16:24.947211 23781 consensus_queue.cc:237] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.952046 23843 raft_consensus.cc:993] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431: : Instructing follower 91b57400a7c74294b1b92de306b07de4 to start an election
I20260709 12:16:24.952589 23782 raft_consensus.cc:1081] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Signalling peer 91b57400a7c74294b1b92de306b07de4 to start an election
I20260709 12:16:24.954249 23658 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "540b0b5949df44c3b69ddd1ee4e9244c"
dest_uuid: "91b57400a7c74294b1b92de306b07de4"
 from {username='slave'} at 127.0.0.1:52676
I20260709 12:16:24.954836 23658 raft_consensus.cc:493] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:24.955363 23658 raft_consensus.cc:3060] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.957180 23482 catalog_manager.cc:5697] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 reported cstate change: term changed from 1 to 2, leader changed from 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193) to 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195). New cstate: current_term: 2 leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:24.961491 23658 raft_consensus.cc:515] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.963780 23658 leader_election.cc:290] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 2 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:24.964763 23583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540b0b5949df44c3b69ddd1ee4e9244c" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:24.965059 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "540b0b5949df44c3b69ddd1ee4e9244c" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:24.965437 23583 raft_consensus.cc:3055] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:24.965723 23732 raft_consensus.cc:3060] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.965744 23583 raft_consensus.cc:740] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:24.966811 23583 consensus_queue.cc:260] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.968622 23583 raft_consensus.cc:3060] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:24.973030 23732 raft_consensus.cc:2468] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 2.
I20260709 12:16:24.974109 23583 raft_consensus.cc:2468] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 2.
I20260709 12:16:24.974463 23622 leader_election.cc:304] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:24.975415 23823 raft_consensus.cc:2804] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:24.975859 23823 raft_consensus.cc:697] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 2 LEADER]: Becoming Leader. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:24.976720 23823 consensus_queue.cc:237] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:24.983451 23482 catalog_manager.cc:5697] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 reported cstate change: term changed from 1 to 2, leader changed from 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193) to 91b57400a7c74294b1b92de306b07de4 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "91b57400a7c74294b1b92de306b07de4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.006465 23783 raft_consensus.cc:993] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451: : Instructing follower 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:25.007225 23781 raft_consensus.cc:1081] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Signalling peer 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:25.009212 23584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:43114
I20260709 12:16:25.009917 23584 raft_consensus.cc:493] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.011446 23584 raft_consensus.cc:3060] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.011194 23807 consensus_queue.cc:1048] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.014881 23807 raft_consensus.cc:993] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4: : Instructing follower 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:25.015378 23807 raft_consensus.cc:1081] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Signalling peer 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:25.019641 23583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebe53913015b4828b154e59e4a971617"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:43128
I20260709 12:16:25.020344 23583 raft_consensus.cc:493] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.020306 23584 raft_consensus.cc:515] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.021015 23583 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.025581 23823 consensus_queue.cc:1048] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:25.028957 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:25.029816 23658 raft_consensus.cc:3060] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.030445 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:25.031209 23732 raft_consensus.cc:3055] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.031697 23732 raft_consensus.cc:740] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:25.030571 23583 raft_consensus.cc:515] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:25.032793 23732 consensus_queue.cc:260] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.034101 23732 raft_consensus.cc:3060] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.035238 23583 leader_election.cc:290] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Requested vote from peers 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:25.035902 23731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:25.036623 23731 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.029223 23584 leader_election.cc:290] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:25.043088 23658 raft_consensus.cc:2468] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:25.045665 23548 leader_election.cc:304] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:25.046767 23782 raft_consensus.cc:2804] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.047327 23782 raft_consensus.cc:697] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:25.048123 23782 consensus_queue.cc:237] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.050091 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:25.050786 23658 raft_consensus.cc:3055] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.051218 23658 raft_consensus.cc:740] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:25.052505 23658 consensus_queue.cc:260] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:25.055457 23658 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.057830 23781 raft_consensus.cc:993] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451: : Instructing follower 91b57400a7c74294b1b92de306b07de4 to start an election
I20260709 12:16:25.058360 23781 raft_consensus.cc:1081] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Signalling peer 91b57400a7c74294b1b92de306b07de4 to start an election
I20260709 12:16:25.056145 23731 raft_consensus.cc:2468] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:25.060719 23659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf"
dest_uuid: "91b57400a7c74294b1b92de306b07de4"
 from {username='slave'} at 127.0.0.1:52672
I20260709 12:16:25.061372 23659 raft_consensus.cc:493] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.061787 23659 raft_consensus.cc:3060] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.062453 23732 raft_consensus.cc:2468] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:25.063683 23547 leader_election.cc:304] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451; no voters: 
I20260709 12:16:25.065131 23658 raft_consensus.cc:2468] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:25.065280 23782 raft_consensus.cc:2804] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.067224 23782 raft_consensus.cc:697] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:25.068249 23782 consensus_queue.cc:237] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:25.069465 23481 catalog_manager.cc:5697] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 1 to 2, leader changed from 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195) to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.070729 23659 raft_consensus.cc:515] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.073321 23659 leader_election.cc:290] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 2 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:25.074210 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:25.074592 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:25.074903 23584 raft_consensus.cc:3060] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.075271 23732 raft_consensus.cc:3055] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.075623 23732 raft_consensus.cc:740] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:25.076572 23732 consensus_queue.cc:260] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.078015 23732 raft_consensus.cc:3060] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.083841 23584 raft_consensus.cc:2468] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 2.
I20260709 12:16:25.085503 23622 leader_election.cc:304] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:25.086480 23823 raft_consensus.cc:2804] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.086766 23732 raft_consensus.cc:2468] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 2.
I20260709 12:16:25.087203 23823 raft_consensus.cc:697] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 2 LEADER]: Becoming Leader. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:25.086680 23481 catalog_manager.cc:5697] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 1 to 2, leader changed from 91b57400a7c74294b1b92de306b07de4 (127.22.93.194) to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.088261 23823 consensus_queue.cc:237] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.095908 23482 catalog_manager.cc:5697] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 reported cstate change: term changed from 1 to 2, leader changed from 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195) to 91b57400a7c74294b1b92de306b07de4 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "91b57400a7c74294b1b92de306b07de4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.182753 23813 raft_consensus.cc:993] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451: : Instructing follower 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:25.183362 23781 raft_consensus.cc:1081] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Signalling peer 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:25.185089 23584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:43114
I20260709 12:16:25.185699 23584 raft_consensus.cc:493] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.186115 23584 raft_consensus.cc:3060] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.193099 23584 raft_consensus.cc:515] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.195255 23584 leader_election.cc:290] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:25.196051 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:25.196506 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be694eb33fb04855b2299a61ed9d6689" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:25.196815 23659 raft_consensus.cc:3060] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.197199 23732 raft_consensus.cc:3055] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.197587 23732 raft_consensus.cc:740] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:25.198495 23732 consensus_queue.cc:260] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.199920 23732 raft_consensus.cc:3060] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.205585 23659 raft_consensus.cc:2468] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:25.207154 23548 leader_election.cc:304] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:25.208029 23782 raft_consensus.cc:2804] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.207937 23732 raft_consensus.cc:2468] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:25.208654 23782 raft_consensus.cc:697] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:25.209671 23782 consensus_queue.cc:237] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.218737 23481 catalog_manager.cc:5697] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 1 to 2, leader changed from 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195) to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.245657 23807 raft_consensus.cc:993] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4: : Instructing follower 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:25.246212 23807 raft_consensus.cc:1081] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Signalling peer 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:25.247987 23583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:43128
I20260709 12:16:25.248590 23583 raft_consensus.cc:493] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:25.248952 23583 raft_consensus.cc:3060] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.255205 23583 raft_consensus.cc:515] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.257128 23583 leader_election.cc:290] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:25.258260 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:25.258365 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:25.258903 23659 raft_consensus.cc:3055] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:25.258932 23732 raft_consensus.cc:3060] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.259311 23659 raft_consensus.cc:740] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:25.260161 23659 consensus_queue.cc:260] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.261322 23659 raft_consensus.cc:3060] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:25.266050 23732 raft_consensus.cc:2468] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:25.266678 23659 raft_consensus.cc:2468] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:25.267282 23547 leader_election.cc:304] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451; no voters: 
I20260709 12:16:25.268185 23782 raft_consensus.cc:2804] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:25.268677 23782 raft_consensus.cc:697] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:25.269389 23782 consensus_queue.cc:237] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:25.276333 23481 catalog_manager.cc:5697] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 1 to 2, leader changed from 91b57400a7c74294b1b92de306b07de4 (127.22.93.194) to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:25.331748 23583 raft_consensus.cc:1275] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.333237 23781 consensus_queue.cc:1048] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.342111 23659 raft_consensus.cc:1275] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.344452 23783 consensus_queue.cc:1048] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.369243 23732 raft_consensus.cc:1275] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Refusing update from remote peer 91b57400a7c74294b1b92de306b07de4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.370767 23823 consensus_queue.cc:1048] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:25.372140 23583 raft_consensus.cc:1275] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Refusing update from remote peer 91b57400a7c74294b1b92de306b07de4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.373628 23823 consensus_queue.cc:1048] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.588810 23659 raft_consensus.cc:1275] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.590679 23782 consensus_queue.cc:1048] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.602464 23732 raft_consensus.cc:1275] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.603952 23843 consensus_queue.cc:1048] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.611159 23659 raft_consensus.cc:1275] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.612699 23843 consensus_queue.cc:1048] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.624620 23732 raft_consensus.cc:1275] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.626398 23843 consensus_queue.cc:1048] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.665350 23583 raft_consensus.cc:1275] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Refusing update from remote peer 91b57400a7c74294b1b92de306b07de4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.666697 23823 consensus_queue.cc:1048] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.676568 23732 raft_consensus.cc:1275] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Refusing update from remote peer 91b57400a7c74294b1b92de306b07de4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.678437 23778 consensus_queue.cc:1048] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.717010 23659 raft_consensus.cc:1275] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.718521 23843 consensus_queue.cc:1048] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.727069 23732 raft_consensus.cc:1275] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.728670 23820 consensus_queue.cc:1048] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.775664 23732 raft_consensus.cc:1275] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.777017 23820 consensus_queue.cc:1048] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:25.786321 23659 raft_consensus.cc:1275] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:25.788146 23866 consensus_queue.cc:1048] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:27.918241 22903 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:16:27.919072 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:27.936846 23583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
mode: GRACEFUL
new_leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:43142
I20260709 12:16:27.937469 23583 raft_consensus.cc:606] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Received request to transfer leadership to TS 79ecaafdb5ee4c3095ccf052f2079451
I20260709 12:16:27.940061 23583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebe53913015b4828b154e59e4a971617"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
mode: GRACEFUL
new_leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:43142
I20260709 12:16:27.940585 23583 raft_consensus.cc:606] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Received request to transfer leadership to TS 79ecaafdb5ee4c3095ccf052f2079451
I20260709 12:16:27.941635 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:16:27.942140 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:27.985597 23820 raft_consensus.cc:993] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431: : Instructing follower 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:27.986120 23875 raft_consensus.cc:1081] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Signalling peer 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:27.987680 23732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebe53913015b4828b154e59e4a971617"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:55440
I20260709 12:16:27.988209 23732 raft_consensus.cc:493] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:27.988523 23732 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:27.993533 23732 raft_consensus.cc:515] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:27.995183 23732 leader_election.cc:290] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 3 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:27.996265 23583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:27.996332 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:27.996986 23583 raft_consensus.cc:3055] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:27.997004 23658 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:27.997363 23583 raft_consensus.cc:740] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:27.998189 23583 consensus_queue.cc:260] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:27.999279 23583 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:28.003209 23658 raft_consensus.cc:2468] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 3.
I20260709 12:16:28.004557 23697 leader_election.cc:304] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:28.005095 23583 raft_consensus.cc:2468] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 3.
I20260709 12:16:28.005590 23874 raft_consensus.cc:2804] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:28.006927 23874 raft_consensus.cc:697] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 LEADER]: Becoming Leader. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:28.007772 23874 consensus_queue.cc:237] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:28.018232 23480 catalog_manager.cc:5697] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 reported cstate change: term changed from 2 to 3, leader changed from 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193) to 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195). New cstate: current_term: 3 leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:28.135924 23820 raft_consensus.cc:993] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431: : Instructing follower 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:28.136448 23875 raft_consensus.cc:1081] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Signalling peer 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:28.137984 23732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:55440
I20260709 12:16:28.138458 23732 raft_consensus.cc:493] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:28.138718 23732 raft_consensus.cc:3060] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:28.143549 23732 raft_consensus.cc:515] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:28.145203 23732 leader_election.cc:290] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 2 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:28.146263 23583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:28.146418 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:28.146881 23583 raft_consensus.cc:3055] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:28.147044 23658 raft_consensus.cc:3060] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:28.147222 23583 raft_consensus.cc:740] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:28.148128 23583 consensus_queue.cc:260] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:28.149142 23583 raft_consensus.cc:3060] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:28.152944 23658 raft_consensus.cc:2468] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 2.
I20260709 12:16:28.154503 23697 leader_election.cc:304] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:28.155210 23583 raft_consensus.cc:2468] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 2.
I20260709 12:16:28.155571 23874 raft_consensus.cc:2804] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:28.156140 23874 raft_consensus.cc:697] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 LEADER]: Becoming Leader. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:28.157037 23874 consensus_queue.cc:237] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:28.164374 23480 catalog_manager.cc:5697] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 reported cstate change: term changed from 1 to 2, leader changed from 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193) to 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195). New cstate: current_term: 2 leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:28.411409 23658 raft_consensus.cc:1275] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:28.413029 23874 consensus_queue.cc:1048] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:28.424836 23583 raft_consensus.cc:1275] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:28.426573 23874 consensus_queue.cc:1048] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:28.601207 23658 raft_consensus.cc:1275] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:28.602677 23878 consensus_queue.cc:1048] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:28.612520 23583 raft_consensus.cc:1275] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:28.613989 23887 consensus_queue.cc:1048] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:28.943301 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:28.949349 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:28.949944 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:29.951452 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:29.957857 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:29.958351 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:30.959589 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:30.965428 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:30.965860 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:31.966818 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:31.972975 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:31.973392 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:33.170076 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:33.180620 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:33.181262 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:34.182484 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:34.188514 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:34.189059 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:34.194597 23605 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1b00 after lost signal to thread 22906
W20260709 12:16:34.195674 23605 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5b40 after lost signal to thread 23516
W20260709 12:16:34.196812 23605 debug-util.cc:398] Leaking SignalData structure 0x7b0800134ee0 after lost signal to thread 23608
W20260709 12:16:34.197922 23605 debug-util.cc:398] Leaking SignalData structure 0x7b0800134560 after lost signal to thread 23683
W20260709 12:16:34.198781 23605 debug-util.cc:398] Leaking SignalData structure 0x7b08001e0f40 after lost signal to thread 23757
I20260709 12:16:35.219467 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:35.225665 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:35.226166 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:36.001411 23513 debug-util.cc:398] Leaking SignalData structure 0x7b08000541e0 after lost signal to thread 22906
W20260709 12:16:36.002449 23513 debug-util.cc:398] Leaking SignalData structure 0x7b08000548c0 after lost signal to thread 23516
W20260709 12:16:36.003626 23513 debug-util.cc:398] Leaking SignalData structure 0x7b0800116c00 after lost signal to thread 23608
W20260709 12:16:36.004580 23513 debug-util.cc:398] Leaking SignalData structure 0x7b08001a9440 after lost signal to thread 23683
W20260709 12:16:36.005503 23513 debug-util.cc:398] Leaking SignalData structure 0x7b08000b4740 after lost signal to thread 23757
I20260709 12:16:36.227547 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:36.237619 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:36.238381 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:37.239784 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:37.249333 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:37.250058 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:38.293699 22903 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:16:38.300567 23732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ebe53913015b4828b154e59e4a971617"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
mode: GRACEFUL
new_leader_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:55446
I20260709 12:16:38.301707 23732 raft_consensus.cc:606] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 LEADER]: Received request to transfer leadership to TS 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:38.319521 23732 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
mode: GRACEFUL
new_leader_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:55446
I20260709 12:16:38.320284 23732 raft_consensus.cc:606] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 LEADER]: Received request to transfer leadership to TS 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:38.326761 23658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3"
dest_uuid: "91b57400a7c74294b1b92de306b07de4"
mode: GRACEFUL
new_leader_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:52682
I20260709 12:16:38.327416 23658 raft_consensus.cc:606] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Received request to transfer leadership to TS 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:38.331430 23887 raft_consensus.cc:993] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451: : Instructing follower 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.332055 23911 raft_consensus.cc:1081] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 LEADER]: Signalling peer 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.334270 23584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:43114
I20260709 12:16:38.334303 23658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf"
dest_uuid: "91b57400a7c74294b1b92de306b07de4"
mode: GRACEFUL
new_leader_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:52682
I20260709 12:16:38.334919 23584 raft_consensus.cc:493] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.335023 23658 raft_consensus.cc:606] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 2 LEADER]: Received request to transfer leadership to TS 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:38.335551 23584 raft_consensus.cc:3060] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.342236 23658 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98"
dest_uuid: "91b57400a7c74294b1b92de306b07de4"
mode: GRACEFUL
new_leader_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:52682
I20260709 12:16:38.343010 23658 raft_consensus.cc:606] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Received request to transfer leadership to TS 330862e4eccf4112ba00dd6519a1c431
I20260709 12:16:38.344820 23584 raft_consensus.cc:515] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.348316 23584 leader_election.cc:290] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 3 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:38.348223 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:38.348613 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca15dc948854a41bb785b223ab17a90" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:38.349318 23732 raft_consensus.cc:3055] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:38.349670 23732 raft_consensus.cc:740] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:38.349181 23658 raft_consensus.cc:3060] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.350638 23732 consensus_queue.cc:260] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.352248 23732 raft_consensus.cc:3060] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.359450 23658 raft_consensus.cc:2468] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 3.
I20260709 12:16:38.361215 23548 leader_election.cc:304] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:38.361161 23732 raft_consensus.cc:2468] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 3.
I20260709 12:16:38.362545 23898 raft_consensus.cc:2804] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:38.363791 23898 raft_consensus.cc:697] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 3 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:38.365106 23898 consensus_queue.cc:237] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.380651 23480 catalog_manager.cc:5697] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 2 to 3, leader changed from 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195) to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.606959 23918 raft_consensus.cc:993] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4: : Instructing follower 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.607704 23910 raft_consensus.cc:1081] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 2 LEADER]: Signalling peer 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.609490 23584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:43128
I20260709 12:16:38.610185 23584 raft_consensus.cc:493] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.610634 23584 raft_consensus.cc:3060] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.620031 23584 raft_consensus.cc:515] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.623261 23584 leader_election.cc:290] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 3 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:38.624931 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:38.625129 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee2ab659c8ee44b1a9ff34956ddd9abf" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:38.625667 23658 raft_consensus.cc:3055] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:38.625778 23732 raft_consensus.cc:3060] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.626015 23658 raft_consensus.cc:740] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:38.626832 23658 consensus_queue.cc:260] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.628191 23658 raft_consensus.cc:3060] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:38.634065 23732 raft_consensus.cc:2468] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 3.
I20260709 12:16:38.635583 23658 raft_consensus.cc:2468] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 3.
I20260709 12:16:38.635557 23547 leader_election.cc:304] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451; no voters: 
I20260709 12:16:38.636641 23898 raft_consensus.cc:2804] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:38.637122 23898 raft_consensus.cc:697] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 3 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:38.638185 23898 consensus_queue.cc:237] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.647821 23480 catalog_manager.cc:5697] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 2 to 3, leader changed from 91b57400a7c74294b1b92de306b07de4 (127.22.93.194) to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.670810 23887 raft_consensus.cc:993] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451: : Instructing follower 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.671435 23911 raft_consensus.cc:1081] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 LEADER]: Signalling peer 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.673336 23584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ebe53913015b4828b154e59e4a971617"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:43114
I20260709 12:16:38.673918 23584 raft_consensus.cc:493] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.674270 23584 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:38.681469 23584 raft_consensus.cc:515] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:38.683621 23584 leader_election.cc:290] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 4 election: Requested vote from peers 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:38.684396 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:38.684831 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ebe53913015b4828b154e59e4a971617" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:38.685061 23732 raft_consensus.cc:3055] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:16:38.685444 23658 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:38.685413 23732 raft_consensus.cc:740] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:38.686477 23732 consensus_queue.cc:260] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:38.687896 23732 raft_consensus.cc:3060] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:16:38.693393 23658 raft_consensus.cc:2468] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 4.
I20260709 12:16:38.694818 23548 leader_election.cc:304] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:38.695158 23732 raft_consensus.cc:2468] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 4.
I20260709 12:16:38.695801 23898 raft_consensus.cc:2804] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:16:38.696352 23898 raft_consensus.cc:697] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 4 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:38.697209 23898 consensus_queue.cc:237] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } }
I20260709 12:16:38.707480 23480 catalog_manager.cc:5697] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 3 to 4, leader changed from 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195) to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 4 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.766486 23918 raft_consensus.cc:993] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4: : Instructing follower 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.767099 23910 raft_consensus.cc:1081] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Signalling peer 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.768715 23584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:43128
I20260709 12:16:38.769304 23584 raft_consensus.cc:493] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.769642 23584 raft_consensus.cc:3060] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.775513 23584 raft_consensus.cc:515] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.778302 23584 leader_election.cc:290] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:38.779292 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:38.779537 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:38.779862 23658 raft_consensus.cc:3055] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:38.780074 23732 raft_consensus.cc:3060] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.780203 23658 raft_consensus.cc:740] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:38.781065 23658 consensus_queue.cc:260] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.782038 23658 raft_consensus.cc:3060] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.785483 23732 raft_consensus.cc:2468] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:38.786803 23547 leader_election.cc:304] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451; no voters: 
I20260709 12:16:38.787707 23898 raft_consensus.cc:2804] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:38.787743 23658 raft_consensus.cc:2468] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:38.788267 23898 raft_consensus.cc:697] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:38.789181 23898 consensus_queue.cc:237] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.797466 23480 catalog_manager.cc:5697] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 1 to 2, leader changed from 91b57400a7c74294b1b92de306b07de4 (127.22.93.194) to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.830479 23918 raft_consensus.cc:993] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4: : Instructing follower 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.831133 23910 raft_consensus.cc:1081] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Signalling peer 330862e4eccf4112ba00dd6519a1c431 to start an election
I20260709 12:16:38.833245 23584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
 from {username='slave'} at 127.0.0.1:43128
I20260709 12:16:38.834059 23584 raft_consensus.cc:493] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:38.834569 23584 raft_consensus.cc:3060] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.843809 23584 raft_consensus.cc:515] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.847909 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:38.848475 23584 leader_election.cc:290] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Requested vote from peers 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:38.848505 23658 raft_consensus.cc:3055] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:38.849157 23658 raft_consensus.cc:740] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:38.850073 23658 consensus_queue.cc:260] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.851131 23658 raft_consensus.cc:3060] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.851457 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "330862e4eccf4112ba00dd6519a1c431" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:38.852025 23732 raft_consensus.cc:3060] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:38.858512 23658 raft_consensus.cc:2468] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:38.858880 23732 raft_consensus.cc:2468] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 330862e4eccf4112ba00dd6519a1c431 in term 2.
I20260709 12:16:38.860129 23548 leader_election.cc:304] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:38.861101 23898 raft_consensus.cc:2804] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:38.861806 23898 raft_consensus.cc:697] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Leader. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:38.862831 23898 consensus_queue.cc:237] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:38.872805 23480 catalog_manager.cc:5697] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 reported cstate change: term changed from 1 to 2, leader changed from 91b57400a7c74294b1b92de306b07de4 (127.22.93.194) to 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "330862e4eccf4112ba00dd6519a1c431" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:38.931304 23732 raft_consensus.cc:1275] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:38.932556 23898 consensus_queue.cc:1048] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:38.944485 23658 raft_consensus.cc:1275] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:38.946731 23912 consensus_queue.cc:1048] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:39.135855 23658 raft_consensus.cc:1275] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 4 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:39.137269 23912 consensus_queue.cc:1048] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.147368 23732 raft_consensus.cc:1275] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 4 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:16:39.149159 23912 consensus_queue.cc:1048] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:16:39.218294 23658 raft_consensus.cc:1275] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:39.220142 23930 consensus_queue.cc:1048] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:39.255685 23732 raft_consensus.cc:1275] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:39.259966 23930 consensus_queue.cc:1048] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:39.267967 23659 raft_consensus.cc:1275] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:39.270335 23930 consensus_queue.cc:1048] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:39.295574 23731 raft_consensus.cc:1275] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:39.297585 23936 consensus_queue.cc:1048] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:39.300007 23732 raft_consensus.cc:1275] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:39.303617 23936 consensus_queue.cc:1048] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:39.321955 23658 raft_consensus.cc:1275] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Refusing update from remote peer 330862e4eccf4112ba00dd6519a1c431: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:39.323778 23912 consensus_queue.cc:1048] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:41.400002 22903 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:16:41.400808 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:41.410033 23584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
mode: GRACEFUL
new_leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:43142
I20260709 12:16:41.410828 23584 raft_consensus.cc:606] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Received request to transfer leadership to TS 79ecaafdb5ee4c3095ccf052f2079451
I20260709 12:16:41.413818 23584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
mode: GRACEFUL
new_leader_uuid: "91b57400a7c74294b1b92de306b07de4"
 from {username='slave'} at 127.0.0.1:43142
I20260709 12:16:41.414300 23584 raft_consensus.cc:606] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Received request to transfer leadership to TS 91b57400a7c74294b1b92de306b07de4
I20260709 12:16:41.416620 23584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
mode: GRACEFUL
new_leader_uuid: "91b57400a7c74294b1b92de306b07de4"
 from {username='slave'} at 127.0.0.1:43142
I20260709 12:16:41.417102 23584 raft_consensus.cc:606] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Received request to transfer leadership to TS 91b57400a7c74294b1b92de306b07de4
I20260709 12:16:41.419634 23584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3"
dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
mode: GRACEFUL
new_leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:43142
I20260709 12:16:41.420109 23584 raft_consensus.cc:606] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Received request to transfer leadership to TS 79ecaafdb5ee4c3095ccf052f2079451
I20260709 12:16:41.421126 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:16:41.421689 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:41.533627 23940 raft_consensus.cc:993] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431: : Instructing follower 91b57400a7c74294b1b92de306b07de4 to start an election
I20260709 12:16:41.534205 23940 raft_consensus.cc:1081] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Signalling peer 91b57400a7c74294b1b92de306b07de4 to start an election
I20260709 12:16:41.536062 23659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01"
dest_uuid: "91b57400a7c74294b1b92de306b07de4"
 from {username='slave'} at 127.0.0.1:52676
I20260709 12:16:41.536665 23659 raft_consensus.cc:493] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.536998 23659 raft_consensus.cc:3060] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.543529 23659 raft_consensus.cc:515] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.545909 23659 leader_election.cc:290] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 3 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:41.547257 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:41.547143 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8ca276fa91d404f8ad556bd666c0d01" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:41.548048 23732 raft_consensus.cc:3060] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.548138 23584 raft_consensus.cc:3055] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:41.548544 23584 raft_consensus.cc:740] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:41.549331 23584 consensus_queue.cc:260] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.550474 23584 raft_consensus.cc:3060] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.554085 23732 raft_consensus.cc:2468] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 3.
I20260709 12:16:41.555549 23622 leader_election.cc:304] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:41.556229 23584 raft_consensus.cc:2468] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 3.
I20260709 12:16:41.556504 23910 raft_consensus.cc:2804] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:41.557574 23910 raft_consensus.cc:697] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 3 LEADER]: Becoming Leader. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:41.558456 23910 consensus_queue.cc:237] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.566511 23479 catalog_manager.cc:5697] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 reported cstate change: term changed from 2 to 3, leader changed from 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193) to 91b57400a7c74294b1b92de306b07de4 (127.22.93.194). New cstate: current_term: 3 leader_uuid: "91b57400a7c74294b1b92de306b07de4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:41.647549 23941 raft_consensus.cc:993] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431: : Instructing follower 91b57400a7c74294b1b92de306b07de4 to start an election
I20260709 12:16:41.648146 23940 raft_consensus.cc:1081] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Signalling peer 91b57400a7c74294b1b92de306b07de4 to start an election
I20260709 12:16:41.649859 23659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943"
dest_uuid: "91b57400a7c74294b1b92de306b07de4"
 from {username='slave'} at 127.0.0.1:52676
I20260709 12:16:41.650380 23659 raft_consensus.cc:493] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.650705 23659 raft_consensus.cc:3060] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.656402 23659 raft_consensus.cc:515] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.657922 23659 leader_election.cc:290] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 3 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195:39333)
I20260709 12:16:41.658847 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:41.659155 23732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aad041ed5f474ef69666a9c72d93a943" candidate_uuid: "91b57400a7c74294b1b92de306b07de4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
I20260709 12:16:41.659492 23584 raft_consensus.cc:3055] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:41.659709 23732 raft_consensus.cc:3060] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.659816 23584 raft_consensus.cc:740] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:41.660723 23584 consensus_queue.cc:260] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.662016 23584 raft_consensus.cc:3060] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.667340 23732 raft_consensus.cc:2468] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 3.
I20260709 12:16:41.668640 23622 leader_election.cc:304] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79ecaafdb5ee4c3095ccf052f2079451, 91b57400a7c74294b1b92de306b07de4; no voters: 
I20260709 12:16:41.669149 23584 raft_consensus.cc:2468] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91b57400a7c74294b1b92de306b07de4 in term 3.
I20260709 12:16:41.669417 23910 raft_consensus.cc:2804] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:41.669939 23910 raft_consensus.cc:697] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 3 LEADER]: Becoming Leader. State: Replica: 91b57400a7c74294b1b92de306b07de4, State: Running, Role: LEADER
I20260709 12:16:41.670897 23910 consensus_queue.cc:237] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.679087 23479 catalog_manager.cc:5697] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 reported cstate change: term changed from 2 to 3, leader changed from 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193) to 91b57400a7c74294b1b92de306b07de4 (127.22.93.194). New cstate: current_term: 3 leader_uuid: "91b57400a7c74294b1b92de306b07de4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:41.724705 23940 raft_consensus.cc:993] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431: : Instructing follower 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:41.725384 23941 raft_consensus.cc:1081] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Signalling peer 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:41.727348 23732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:55440
I20260709 12:16:41.727926 23732 raft_consensus.cc:493] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.729298 23732 raft_consensus.cc:3060] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.730151 23941 raft_consensus.cc:993] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431: : Instructing follower 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:41.730702 23940 raft_consensus.cc:1081] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Signalling peer 79ecaafdb5ee4c3095ccf052f2079451 to start an election
I20260709 12:16:41.732270 23731 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98"
dest_uuid: "79ecaafdb5ee4c3095ccf052f2079451"
 from {username='slave'} at 127.0.0.1:55440
I20260709 12:16:41.732774 23731 raft_consensus.cc:493] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:16:41.733093 23731 raft_consensus.cc:3060] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.736809 23732 raft_consensus.cc:515] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.740129 23732 leader_election.cc:290] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 3 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:41.740576 23584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:41.740824 23659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2ecab16e3c24bca9c01429e360d6cf3" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:41.741277 23584 raft_consensus.cc:3055] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:41.741415 23659 raft_consensus.cc:3060] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.741607 23584 raft_consensus.cc:740] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:41.741662 23731 raft_consensus.cc:515] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.742580 23584 consensus_queue.cc:260] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.743942 23584 raft_consensus.cc:3060] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.744534 23731 leader_election.cc:290] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 3 election: Requested vote from peers 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347), 91b57400a7c74294b1b92de306b07de4 (127.22.93.194:34517)
I20260709 12:16:41.744938 23583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "330862e4eccf4112ba00dd6519a1c431"
I20260709 12:16:41.745139 23658 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fa2747d4c204a44b2fe8c3e36f72a98" candidate_uuid: "79ecaafdb5ee4c3095ccf052f2079451" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "91b57400a7c74294b1b92de306b07de4"
I20260709 12:16:41.745651 23583 raft_consensus.cc:3055] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:16:41.746094 23583 raft_consensus.cc:740] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 330862e4eccf4112ba00dd6519a1c431, State: Running, Role: LEADER
I20260709 12:16:41.746954 23583 consensus_queue.cc:260] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.748623 23583 raft_consensus.cc:3060] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.750614 23659 raft_consensus.cc:2468] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 3.
I20260709 12:16:41.745716 23658 raft_consensus.cc:3060] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:16:41.752103 23584 raft_consensus.cc:2468] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 3.
I20260709 12:16:41.753420 23696 leader_election.cc:304] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451; no voters: 
I20260709 12:16:41.755775 23911 raft_consensus.cc:2804] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:41.758279 23583 raft_consensus.cc:2468] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 3.
I20260709 12:16:41.758956 23911 raft_consensus.cc:697] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 LEADER]: Becoming Leader. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:41.759344 23696 leader_election.cc:304] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 330862e4eccf4112ba00dd6519a1c431, 79ecaafdb5ee4c3095ccf052f2079451; no voters: 
I20260709 12:16:41.760310 23949 raft_consensus.cc:2804] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:16:41.760205 23658 raft_consensus.cc:2468] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79ecaafdb5ee4c3095ccf052f2079451 in term 3.
I20260709 12:16:41.760181 23911 consensus_queue.cc:237] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.762015 23949 raft_consensus.cc:697] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 LEADER]: Becoming Leader. State: Replica: 79ecaafdb5ee4c3095ccf052f2079451, State: Running, Role: LEADER
I20260709 12:16:41.762923 23949 consensus_queue.cc:237] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } }
I20260709 12:16:41.769376 23479 catalog_manager.cc:5697] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 reported cstate change: term changed from 2 to 3, leader changed from 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193) to 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195). New cstate: current_term: 3 leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:41.782662 23479 catalog_manager.cc:5697] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 reported cstate change: term changed from 2 to 3, leader changed from 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193) to 79ecaafdb5ee4c3095ccf052f2079451 (127.22.93.195). New cstate: current_term: 3 leader_uuid: "79ecaafdb5ee4c3095ccf052f2079451" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:42.008379 23731 raft_consensus.cc:1275] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Refusing update from remote peer 91b57400a7c74294b1b92de306b07de4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.009716 23910 consensus_queue.cc:1048] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.021797 23583 raft_consensus.cc:1275] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Refusing update from remote peer 91b57400a7c74294b1b92de306b07de4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.023972 23942 consensus_queue.cc:1048] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:42.156884 23731 raft_consensus.cc:1275] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Refusing update from remote peer 91b57400a7c74294b1b92de306b07de4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.158677 23942 consensus_queue.cc:1048] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79ecaafdb5ee4c3095ccf052f2079451" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:42.171967 23583 raft_consensus.cc:1275] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Refusing update from remote peer 91b57400a7c74294b1b92de306b07de4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.174741 23942 consensus_queue.cc:1048] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.175081 23583 raft_consensus.cc:1275] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.177793 23911 consensus_queue.cc:1048] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.180910 23658 raft_consensus.cc:1275] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.182768 23911 consensus_queue.cc:1048] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.191877 23659 raft_consensus.cc:1275] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.203112 23950 consensus_queue.cc:1048] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91b57400a7c74294b1b92de306b07de4" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:16:42.209653 23584 raft_consensus.cc:1275] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Refusing update from remote peer 79ecaafdb5ee4c3095ccf052f2079451: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:16:42.211938 23911 consensus_queue.cc:1048] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [LEADER]: Connected to new peer: Peer: permanent_uuid: "330862e4eccf4112ba00dd6519a1c431" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 41347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:16:42.423018 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:42.430043 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:42.430752 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:43.701820 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:43.708048 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:43.708551 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:16:44.384275 23680 debug-util.cc:398] Leaking SignalData structure 0x7b08000fe3e0 after lost signal to thread 22906
W20260709 12:16:44.385612 23680 debug-util.cc:398] Leaking SignalData structure 0x7b08000feac0 after lost signal to thread 23516
W20260709 12:16:44.386731 23680 debug-util.cc:398] Leaking SignalData structure 0x7b0800198240 after lost signal to thread 23608
W20260709 12:16:44.387768 23680 debug-util.cc:398] Leaking SignalData structure 0x7b0800199e40 after lost signal to thread 23683
W20260709 12:16:44.388664 23680 debug-util.cc:398] Leaking SignalData structure 0x7b0800041e20 after lost signal to thread 23757
I20260709 12:16:44.709695 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:44.715931 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:44.716506 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:45.717648 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:45.725468 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:45.726080 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:46.727370 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:46.734754 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:46.735451 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:47.736781 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:47.743978 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:47.744556 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:48.745620 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:48.751618 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:48.752090 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:49.753885 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:49.761854 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:49.762447 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:50.763784 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:16:50.770339 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:16:50.770961 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:16:51.804726 22903 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:16:51.805351 22903 tablet_server.cc:179] TabletServer@127.22.93.193:0 shutting down...
I20260709 12:16:51.844902 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:51.845772 22903 tablet_replica.cc:333] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.846553 22903 raft_consensus.cc:2243] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.848063 22903 raft_consensus.cc:2272] T ee2ab659c8ee44b1a9ff34956ddd9abf P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.850589 22903 tablet_replica.cc:333] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.851334 22903 raft_consensus.cc:2243] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.851981 22903 raft_consensus.cc:2272] T b8ca276fa91d404f8ad556bd666c0d01 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.855033 22903 tablet_replica.cc:333] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.855827 22903 raft_consensus.cc:2243] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.856824 22903 raft_consensus.cc:2272] T ebe53913015b4828b154e59e4a971617 P 330862e4eccf4112ba00dd6519a1c431 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.858950 22903 tablet_replica.cc:333] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.859619 22903 raft_consensus.cc:2243] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.860117 22903 raft_consensus.cc:2272] T 253d1f9706824309b87c80d03a20abb5 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.862088 22903 tablet_replica.cc:333] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.862643 22903 raft_consensus.cc:2243] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.863225 22903 raft_consensus.cc:2272] T 540b0b5949df44c3b69ddd1ee4e9244c P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.865269 22903 tablet_replica.cc:333] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.865821 22903 raft_consensus.cc:2243] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.866338 22903 raft_consensus.cc:2272] T aad041ed5f474ef69666a9c72d93a943 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.868498 22903 tablet_replica.cc:333] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.869251 22903 raft_consensus.cc:2243] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.870601 22903 raft_consensus.cc:2272] T be694eb33fb04855b2299a61ed9d6689 P 330862e4eccf4112ba00dd6519a1c431 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.873067 22903 tablet_replica.cc:333] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.873610 22903 raft_consensus.cc:2243] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:51.874503 22903 raft_consensus.cc:2272] T 2ca15dc948854a41bb785b223ab17a90 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.876490 22903 tablet_replica.cc:333] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.877004 22903 raft_consensus.cc:2243] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.877501 22903 raft_consensus.cc:2272] T f2ecab16e3c24bca9c01429e360d6cf3 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:51.879669 22903 tablet_replica.cc:333] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431: stopping tablet replica
I20260709 12:16:51.880347 22903 raft_consensus.cc:2243] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:51.880988 22903 raft_consensus.cc:2272] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 330862e4eccf4112ba00dd6519a1c431 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:16:51.894193 23696 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:16:51.898138 23696 consensus_peers.cc:597] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 -> Peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Couldn't send request to peer 330862e4eccf4112ba00dd6519a1c431. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:51.940403 22903 tablet_server.cc:196] TabletServer@127.22.93.193:0 shutdown complete.
I20260709 12:16:51.967135 22903 tablet_server.cc:179] TabletServer@127.22.93.194:0 shutting down...
I20260709 12:16:52.005098 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:52.006152 22903 tablet_replica.cc:333] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.007184 22903 raft_consensus.cc:2243] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.007889 22903 raft_consensus.cc:2272] T 253d1f9706824309b87c80d03a20abb5 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.010269 22903 tablet_replica.cc:333] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.010914 22903 raft_consensus.cc:2243] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.012017 22903 raft_consensus.cc:2272] T 540b0b5949df44c3b69ddd1ee4e9244c P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.014593 22903 tablet_replica.cc:333] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.015295 22903 raft_consensus.cc:2243] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.015836 22903 raft_consensus.cc:2272] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.018018 22903 tablet_replica.cc:333] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.018734 22903 raft_consensus.cc:2243] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.019294 22903 raft_consensus.cc:2272] T ee2ab659c8ee44b1a9ff34956ddd9abf P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.021373 22903 tablet_replica.cc:333] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.021950 22903 raft_consensus.cc:2243] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.023047 22903 raft_consensus.cc:2272] T b8ca276fa91d404f8ad556bd666c0d01 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.025193 22903 tablet_replica.cc:333] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.025785 22903 raft_consensus.cc:2243] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.026342 22903 raft_consensus.cc:2272] T ebe53913015b4828b154e59e4a971617 P 91b57400a7c74294b1b92de306b07de4 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.028489 22903 tablet_replica.cc:333] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.029050 22903 raft_consensus.cc:2243] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.029538 22903 raft_consensus.cc:2272] T 2ca15dc948854a41bb785b223ab17a90 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.031581 22903 tablet_replica.cc:333] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.032121 22903 raft_consensus.cc:2243] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.032658 22903 raft_consensus.cc:2272] T f2ecab16e3c24bca9c01429e360d6cf3 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.034653 22903 tablet_replica.cc:333] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.035280 22903 raft_consensus.cc:2243] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.036285 22903 raft_consensus.cc:2272] T aad041ed5f474ef69666a9c72d93a943 P 91b57400a7c74294b1b92de306b07de4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.038187 22903 tablet_replica.cc:333] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4: stopping tablet replica
I20260709 12:16:52.038712 22903 raft_consensus.cc:2243] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.039264 22903 raft_consensus.cc:2272] T be694eb33fb04855b2299a61ed9d6689 P 91b57400a7c74294b1b92de306b07de4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.091500 22903 tablet_server.cc:196] TabletServer@127.22.93.194:0 shutdown complete.
I20260709 12:16:52.115844 22903 tablet_server.cc:179] TabletServer@127.22.93.195:0 shutting down...
W20260709 12:16:52.148499 23696 consensus_peers.cc:597] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 -> Peer 330862e4eccf4112ba00dd6519a1c431 (127.22.93.193:41347): Couldn't send request to peer 330862e4eccf4112ba00dd6519a1c431. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:41347: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:52.152484 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:16:52.153280 22903 tablet_replica.cc:333] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.154151 22903 raft_consensus.cc:2243] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.155205 22903 raft_consensus.cc:2272] T 0fa2747d4c204a44b2fe8c3e36f72a98 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.157434 22903 tablet_replica.cc:333] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.158082 22903 raft_consensus.cc:2243] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.158582 22903 raft_consensus.cc:2272] T 540b0b5949df44c3b69ddd1ee4e9244c P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.160743 22903 tablet_replica.cc:333] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.161303 22903 raft_consensus.cc:2243] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.162207 22903 raft_consensus.cc:2272] T 253d1f9706824309b87c80d03a20abb5 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.164494 22903 tablet_replica.cc:333] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.165091 22903 raft_consensus.cc:2243] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.165606 22903 raft_consensus.cc:2272] T ee2ab659c8ee44b1a9ff34956ddd9abf P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.167572 22903 tablet_replica.cc:333] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.168138 22903 raft_consensus.cc:2243] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.169049 22903 raft_consensus.cc:2272] T f2ecab16e3c24bca9c01429e360d6cf3 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.171159 22903 tablet_replica.cc:333] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.171723 22903 raft_consensus.cc:2243] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.172178 22903 raft_consensus.cc:2272] T 2ca15dc948854a41bb785b223ab17a90 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.174055 22903 tablet_replica.cc:333] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.174592 22903 raft_consensus.cc:2243] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.175127 22903 raft_consensus.cc:2272] T aad041ed5f474ef69666a9c72d93a943 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.176918 22903 tablet_replica.cc:333] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.177436 22903 raft_consensus.cc:2243] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.177855 22903 raft_consensus.cc:2272] T be694eb33fb04855b2299a61ed9d6689 P 79ecaafdb5ee4c3095ccf052f2079451 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.179736 22903 tablet_replica.cc:333] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.180234 22903 raft_consensus.cc:2243] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.180684 22903 raft_consensus.cc:2272] T ebe53913015b4828b154e59e4a971617 P 79ecaafdb5ee4c3095ccf052f2079451 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.182593 22903 tablet_replica.cc:333] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451: stopping tablet replica
I20260709 12:16:52.183127 22903 raft_consensus.cc:2243] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:16:52.183574 22903 raft_consensus.cc:2272] T b8ca276fa91d404f8ad556bd666c0d01 P 79ecaafdb5ee4c3095ccf052f2079451 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.215621 22903 tablet_server.cc:196] TabletServer@127.22.93.195:0 shutdown complete.
I20260709 12:16:52.240648 22903 master.cc:562] Master@127.22.93.254:35107 shutting down...
I20260709 12:16:52.269284 22903 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:16:52.270069 22903 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:16:52.270450 22903 tablet_replica.cc:333] T 00000000000000000000000000000000 P 200fb92e72654cbbb4012971a09d4586: stopping tablet replica
I20260709 12:16:52.314772 22903 master.cc:584] Master@127.22.93.254:35107 shutdown complete.
330862e4eccf4112ba00dd6519a1c431  5
79ecaafdb5ee4c3095ccf052f2079451  1
91b57400a7c74294b1b92de306b07de4  4
330862e4eccf4112ba00dd6519a1c431  3
79ecaafdb5ee4c3095ccf052f2079451  3
91b57400a7c74294b1b92de306b07de4  4
330862e4eccf4112ba00dd6519a1c431  8
79ecaafdb5ee4c3095ccf052f2079451  1
91b57400a7c74294b1b92de306b07de4  1
330862e4eccf4112ba00dd6519a1c431  4
79ecaafdb5ee4c3095ccf052f2079451  3
91b57400a7c74294b1b92de306b07de4  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (29753 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:16:52.366123 22903 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.93.254:36285
I20260709 12:16:52.367555 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.373682 23975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.373695 23974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.376477 23977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.376513 22903 server_base.cc:1061] running on GCE node
I20260709 12:16:52.378043 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.378271 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.378443 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599412378405 us; error 0 us; skew 500 ppm
I20260709 12:16:52.379493 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.382143 22903 webserver.cc:533] Webserver started at http://127.22.93.254:36377/ using document root <none> and password file <none>
I20260709 12:16:52.382702 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.382929 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.383350 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.384706 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/master-0-root/instance:
uuid: "aa1cad1355eb4ec68d9dd23f0c34795d"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-k289"
I20260709 12:16:52.389638 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:16:52.393321 23982 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.394057 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:16:52.394353 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/master-0-root
uuid: "aa1cad1355eb4ec68d9dd23f0c34795d"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-k289"
I20260709 12:16:52.394637 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.437292 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.438876 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.483193 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.254:36285
I20260709 12:16:52.483273 24033 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.254:36285 every 8 connection(s)
I20260709 12:16:52.487913 24034 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:52.499089 24034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Bootstrap starting.
I20260709 12:16:52.504876 24034 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:52.509814 24034 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: No bootstrap required, opened a new log
I20260709 12:16:52.512354 24034 raft_consensus.cc:359] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa1cad1355eb4ec68d9dd23f0c34795d" member_type: VOTER }
I20260709 12:16:52.512866 24034 raft_consensus.cc:385] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:52.513163 24034 raft_consensus.cc:740] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa1cad1355eb4ec68d9dd23f0c34795d, State: Initialized, Role: FOLLOWER
I20260709 12:16:52.513863 24034 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa1cad1355eb4ec68d9dd23f0c34795d" member_type: VOTER }
I20260709 12:16:52.514400 24034 raft_consensus.cc:399] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:16:52.514635 24034 raft_consensus.cc:493] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:16:52.514963 24034 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:52.519706 24034 raft_consensus.cc:515] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa1cad1355eb4ec68d9dd23f0c34795d" member_type: VOTER }
I20260709 12:16:52.520264 24034 leader_election.cc:304] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aa1cad1355eb4ec68d9dd23f0c34795d; no voters: 
I20260709 12:16:52.521570 24034 leader_election.cc:290] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:16:52.522053 24037 raft_consensus.cc:2804] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:52.523857 24037 raft_consensus.cc:697] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 1 LEADER]: Becoming Leader. State: Replica: aa1cad1355eb4ec68d9dd23f0c34795d, State: Running, Role: LEADER
I20260709 12:16:52.524636 24037 consensus_queue.cc:237] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa1cad1355eb4ec68d9dd23f0c34795d" member_type: VOTER }
I20260709 12:16:52.525015 24034 sys_catalog.cc:565] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:16:52.530597 24039 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [sys.catalog]: SysCatalogTable state changed. Reason: New leader aa1cad1355eb4ec68d9dd23f0c34795d. Latest consensus state: current_term: 1 leader_uuid: "aa1cad1355eb4ec68d9dd23f0c34795d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa1cad1355eb4ec68d9dd23f0c34795d" member_type: VOTER } }
I20260709 12:16:52.530548 24038 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aa1cad1355eb4ec68d9dd23f0c34795d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aa1cad1355eb4ec68d9dd23f0c34795d" member_type: VOTER } }
I20260709 12:16:52.531629 24039 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:52.531807 24038 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [sys.catalog]: This master's current role is: LEADER
I20260709 12:16:52.540763 24044 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:16:52.549358 24044 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:16:52.550450 22903 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:16:52.559932 24044 catalog_manager.cc:1383] Generated new cluster ID: a29f54a902e44a6c8e0a87efcb3fc94f
I20260709 12:16:52.560238 24044 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:16:52.576238 24044 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:16:52.577710 24044 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:16:52.589732 24044 catalog_manager.cc:6070] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Generated new TSK 0
I20260709 12:16:52.590437 24044 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:16:52.617417 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.624589 24055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.625598 24056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.627341 24058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.628232 22903 server_base.cc:1061] running on GCE node
I20260709 12:16:52.629387 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.629607 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.629776 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599412629759 us; error 0 us; skew 500 ppm
I20260709 12:16:52.630401 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.633234 22903 webserver.cc:533] Webserver started at http://127.22.93.193:35671/ using document root <none> and password file <none>
I20260709 12:16:52.633828 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.634043 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.634356 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.636129 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/instance:
uuid: "729aa4b1ccec48b588c14e67652c61e1"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-k289"
I20260709 12:16:52.641091 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 12:16:52.644841 24063 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.645640 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:16:52.646001 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "729aa4b1ccec48b588c14e67652c61e1"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-k289"
I20260709 12:16:52.646332 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.661631 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.663267 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.665048 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:52.667793 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:52.668049 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.668313 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:52.668510 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.716231 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:44043
I20260709 12:16:52.716357 24125 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:44043 every 8 connection(s)
I20260709 12:16:52.722000 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.730255 24130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.731297 24131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.734575 24133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.735024 22903 server_base.cc:1061] running on GCE node
I20260709 12:16:52.737609 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.737941 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.737931 24126 heartbeater.cc:344] Connected to a master server at 127.22.93.254:36285
I20260709 12:16:52.738340 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599412738320 us; error 0 us; skew 500 ppm
I20260709 12:16:52.738798 24126 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:52.739394 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.739912 24126 heartbeater.cc:507] Master 127.22.93.254:36285 requested a full tablet report, sending...
I20260709 12:16:52.742588 22903 webserver.cc:533] Webserver started at http://127.22.93.194:43925/ using document root <none> and password file <none>
I20260709 12:16:52.742720 23999 ts_manager.cc:194] Registered new tserver with Master: 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:16:52.743425 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.743722 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.744083 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.745551 23999 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47144
I20260709 12:16:52.745908 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/instance:
uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-k289"
I20260709 12:16:52.751348 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:16:52.754815 24138 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.755615 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:16:52.755919 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root
uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-k289"
I20260709 12:16:52.756210 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.775795 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.777330 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.779117 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:52.781605 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:52.781841 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.782117 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:52.782299 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.831065 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.194:36209
I20260709 12:16:52.831135 24200 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.194:36209 every 8 connection(s)
I20260709 12:16:52.836536 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:16:52.845026 24204 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:16:52.845913 24205 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.850800 24201 heartbeater.cc:344] Connected to a master server at 127.22.93.254:36285
I20260709 12:16:52.851271 24201 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:52.851346 22903 server_base.cc:1061] running on GCE node
W20260709 12:16:52.852038 24207 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:16:52.852175 24201 heartbeater.cc:507] Master 127.22.93.254:36285 requested a full tablet report, sending...
I20260709 12:16:52.853052 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:16:52.853348 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:16:52.853585 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599412853560 us; error 0 us; skew 500 ppm
I20260709 12:16:52.854238 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:16:52.854717 23999 ts_manager.cc:194] Registered new tserver with Master: 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:52.856396 23999 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47160
I20260709 12:16:52.857448 22903 webserver.cc:533] Webserver started at http://127.22.93.195:45619/ using document root <none> and password file <none>
I20260709 12:16:52.858099 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:16:52.858335 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:16:52.858637 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:16:52.860004 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/instance:
uuid: "fa8cfbff90bf4881a56772b05008aadb"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-k289"
I20260709 12:16:52.864864 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 12:16:52.868533 24212 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.869380 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:16:52.869803 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root
uuid: "fa8cfbff90bf4881a56772b05008aadb"
format_stamp: "Formatted at 2026-07-09 12:16:52 on dist-test-slave-k289"
I20260709 12:16:52.870128 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:16:52.888386 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:16:52.889825 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:16:52.891510 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:16:52.893807 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:16:52.894047 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.894296 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:16:52.894488 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:16:52.939942 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.195:37157
I20260709 12:16:52.940073 24274 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.195:37157 every 8 connection(s)
I20260709 12:16:52.955441 24275 heartbeater.cc:344] Connected to a master server at 127.22.93.254:36285
I20260709 12:16:52.955905 24275 heartbeater.cc:461] Registering TS with master...
I20260709 12:16:52.956768 24275 heartbeater.cc:507] Master 127.22.93.254:36285 requested a full tablet report, sending...
I20260709 12:16:52.958936 23999 ts_manager.cc:194] Registered new tserver with Master: fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:52.959436 22903 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015847677s
I20260709 12:16:52.960486 23999 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47164
I20260709 12:16:52.987478 23999 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47178:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:16:52.994304 23999 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:16:53.220429 24090 tablet_service.cc:1511] Processing CreateTablet for tablet 2152258f0d654836a042cc0cf00d66a3 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:53.221124 24088 tablet_service.cc:1511] Processing CreateTablet for tablet e37f672475a541c4b15e807dbe8bcd7d (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:53.222494 24090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2152258f0d654836a042cc0cf00d66a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.223928 24087 tablet_service.cc:1511] Processing CreateTablet for tablet 272fa86b9b194257adecb1c4f372fde9 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:53.224445 24089 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5cb153ce4e4ac387672e2345a08fa5 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:53.226282 24091 tablet_service.cc:1511] Processing CreateTablet for tablet 44755249cf394d0aa1ea6b45f82eb521 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:53.227452 24087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272fa86b9b194257adecb1c4f372fde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.227067 24086 tablet_service.cc:1511] Processing CreateTablet for tablet 290d272848834ed2813ddb5e16609dba (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:53.228132 24089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5cb153ce4e4ac387672e2345a08fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.228948 24088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f672475a541c4b15e807dbe8bcd7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.229625 24091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44755249cf394d0aa1ea6b45f82eb521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.233340 24086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290d272848834ed2813ddb5e16609dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.235954 24166 tablet_service.cc:1511] Processing CreateTablet for tablet 44755249cf394d0aa1ea6b45f82eb521 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:53.237600 24166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44755249cf394d0aa1ea6b45f82eb521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.237879 24164 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5cb153ce4e4ac387672e2345a08fa5 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:53.239365 24164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5cb153ce4e4ac387672e2345a08fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.240447 24165 tablet_service.cc:1511] Processing CreateTablet for tablet 2152258f0d654836a042cc0cf00d66a3 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:53.242051 24165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2152258f0d654836a042cc0cf00d66a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.244403 24162 tablet_service.cc:1511] Processing CreateTablet for tablet 272fa86b9b194257adecb1c4f372fde9 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:53.244800 24163 tablet_service.cc:1511] Processing CreateTablet for tablet e37f672475a541c4b15e807dbe8bcd7d (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:53.246605 24162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272fa86b9b194257adecb1c4f372fde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.248863 24161 tablet_service.cc:1511] Processing CreateTablet for tablet 290d272848834ed2813ddb5e16609dba (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:53.252750 24085 tablet_service.cc:1511] Processing CreateTablet for tablet 8bcb2b2e4d1146f7a8201d801a112ca0 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:53.255476 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bcb2b2e4d1146f7a8201d801a112ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.263423 24163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f672475a541c4b15e807dbe8bcd7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.265928 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290d272848834ed2813ddb5e16609dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.276594 24160 tablet_service.cc:1511] Processing CreateTablet for tablet 8bcb2b2e4d1146f7a8201d801a112ca0 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:53.278373 24160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bcb2b2e4d1146f7a8201d801a112ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.282004 24240 tablet_service.cc:1511] Processing CreateTablet for tablet 44755249cf394d0aa1ea6b45f82eb521 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:16:53.284157 24239 tablet_service.cc:1511] Processing CreateTablet for tablet 2152258f0d654836a042cc0cf00d66a3 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:16:53.286207 24238 tablet_service.cc:1511] Processing CreateTablet for tablet 6f5cb153ce4e4ac387672e2345a08fa5 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:16:53.287119 24084 tablet_service.cc:1511] Processing CreateTablet for tablet b55ff2c6fc804b36ae275790f8dfe310 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:53.288636 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55ff2c6fc804b36ae275790f8dfe310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.288424 24237 tablet_service.cc:1511] Processing CreateTablet for tablet e37f672475a541c4b15e807dbe8bcd7d (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:16:53.290547 24236 tablet_service.cc:1511] Processing CreateTablet for tablet 272fa86b9b194257adecb1c4f372fde9 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:16:53.292661 24235 tablet_service.cc:1511] Processing CreateTablet for tablet 290d272848834ed2813ddb5e16609dba (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:16:53.295188 24234 tablet_service.cc:1511] Processing CreateTablet for tablet 8bcb2b2e4d1146f7a8201d801a112ca0 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:16:53.296905 24240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44755249cf394d0aa1ea6b45f82eb521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.300405 24239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2152258f0d654836a042cc0cf00d66a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.303136 24233 tablet_service.cc:1511] Processing CreateTablet for tablet b55ff2c6fc804b36ae275790f8dfe310 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:53.303789 24235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290d272848834ed2813ddb5e16609dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.304692 24233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55ff2c6fc804b36ae275790f8dfe310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.305684 24237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f672475a541c4b15e807dbe8bcd7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.310063 24238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5cb153ce4e4ac387672e2345a08fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.311271 24083 tablet_service.cc:1511] Processing CreateTablet for tablet 45016a37c2d9462798b1991f8cb78e65 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:53.312883 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45016a37c2d9462798b1991f8cb78e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.315826 24236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 272fa86b9b194257adecb1c4f372fde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.319818 24234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bcb2b2e4d1146f7a8201d801a112ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.319312 24232 tablet_service.cc:1511] Processing CreateTablet for tablet 45016a37c2d9462798b1991f8cb78e65 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:53.322947 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45016a37c2d9462798b1991f8cb78e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.329696 24082 tablet_service.cc:1511] Processing CreateTablet for tablet e33dc2dd26074c7d8437ce5a91c0f8bf (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:53.331480 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33dc2dd26074c7d8437ce5a91c0f8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.333214 24291 tablet_bootstrap.cc:492] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:53.345237 24159 tablet_service.cc:1511] Processing CreateTablet for tablet b55ff2c6fc804b36ae275790f8dfe310 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:16:53.347185 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b55ff2c6fc804b36ae275790f8dfe310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.350111 24291 tablet_bootstrap.cc:654] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.355338 24231 tablet_service.cc:1511] Processing CreateTablet for tablet e33dc2dd26074c7d8437ce5a91c0f8bf (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:53.356998 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33dc2dd26074c7d8437ce5a91c0f8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.357277 24158 tablet_service.cc:1511] Processing CreateTablet for tablet e33dc2dd26074c7d8437ce5a91c0f8bf (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:16:53.358794 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33dc2dd26074c7d8437ce5a91c0f8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.376382 24291 tablet_bootstrap.cc:492] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:53.377274 24291 ts_tablet_manager.cc:1403] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.002s
I20260709 12:16:53.381757 24291 raft_consensus.cc:359] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.382916 24291 raft_consensus.cc:385] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.391580 24291 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.394198 24291 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.394826 24084 tablet_service.cc:1511] Processing CreateTablet for tablet ba2b8234ad7d402bb1de3ebc3a408c0f (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:53.397357 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2b8234ad7d402bb1de3ebc3a408c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.404323 24163 tablet_service.cc:1511] Processing CreateTablet for tablet 45016a37c2d9462798b1991f8cb78e65 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:16:53.434340 24083 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc81ca349024898b0af873713a28fcb (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:53.434888 24165 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc81ca349024898b0af873713a28fcb (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:53.436487 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc81ca349024898b0af873713a28fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.436792 24161 tablet_service.cc:1511] Processing CreateTablet for tablet ba2b8234ad7d402bb1de3ebc3a408c0f (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:53.439570 24163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45016a37c2d9462798b1991f8cb78e65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.443737 24165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc81ca349024898b0af873713a28fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.451682 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2b8234ad7d402bb1de3ebc3a408c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.462303 24290 tablet_bootstrap.cc:492] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:53.469604 24290 tablet_bootstrap.cc:654] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.487439 24293 tablet_bootstrap.cc:492] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:53.517544 24164 tablet_service.cc:1511] Processing CreateTablet for tablet 25a02c46886249619a17c69df6ded3b4 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:53.532375 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 1388d59244114d37a482e6205f04c237 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:53.532815 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 25a02c46886249619a17c69df6ded3b4 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:53.533972 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1388d59244114d37a482e6205f04c237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.534096 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a02c46886249619a17c69df6ded3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.535426 24164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a02c46886249619a17c69df6ded3b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:53.541157 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:53.541965 24126 heartbeater.cc:499] Master 127.22.93.254:36285 was elected leader, sending a full tablet report...
I20260709 12:16:53.502900 24239 tablet_service.cc:1511] Processing CreateTablet for tablet 3fc81ca349024898b0af873713a28fcb (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:16:53.552701 24291 ts_tablet_manager.cc:1434] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.175s	user 0.030s	sys 0.028s
I20260709 12:16:53.554004 24291 tablet_bootstrap.cc:492] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:53.556589 24159 tablet_service.cc:1511] Processing CreateTablet for tablet 1388d59244114d37a482e6205f04c237 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:53.558023 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1388d59244114d37a482e6205f04c237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.563651 24239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fc81ca349024898b0af873713a28fcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.560073 24238 tablet_service.cc:1511] Processing CreateTablet for tablet 1388d59244114d37a482e6205f04c237 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:16:53.566649 24238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1388d59244114d37a482e6205f04c237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.567023 24086 tablet_service.cc:1511] Processing CreateTablet for tablet 25a02c46886249619a17c69df6ded3b4 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:16:53.570132 24291 tablet_bootstrap.cc:654] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.516516 24233 tablet_service.cc:1511] Processing CreateTablet for tablet ba2b8234ad7d402bb1de3ebc3a408c0f (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:16:53.576188 24233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2b8234ad7d402bb1de3ebc3a408c0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.581970 24085 tablet_service.cc:1511] Processing CreateTablet for tablet a6831162b73f4c16a41519abb392404b (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:53.583135 24293 tablet_bootstrap.cc:654] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.586768 24086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25a02c46886249619a17c69df6ded3b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.587491 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6831162b73f4c16a41519abb392404b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.599629 24291 tablet_bootstrap.cc:492] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:53.600203 24291 ts_tablet_manager.cc:1403] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.004s
I20260709 12:16:53.603658 24291 raft_consensus.cc:359] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.604453 24291 raft_consensus.cc:385] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.604795 24291 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.605921 24291 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.617004 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 637c5886d38642daacb9b3dac3e4e9d2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:53.618511 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637c5886d38642daacb9b3dac3e4e9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.618335 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 637c5886d38642daacb9b3dac3e4e9d2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:53.619757 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637c5886d38642daacb9b3dac3e4e9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.620055 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 637c5886d38642daacb9b3dac3e4e9d2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:16:53.621413 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 637c5886d38642daacb9b3dac3e4e9d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.621127 24089 tablet_service.cc:1511] Processing CreateTablet for tablet 7c552e5996384fef9c032a7fda531298 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:53.622571 24089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c552e5996384fef9c032a7fda531298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.623487 24236 tablet_service.cc:1511] Processing CreateTablet for tablet 7c552e5996384fef9c032a7fda531298 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:53.622570 24291 ts_tablet_manager.cc:1434] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.003s
I20260709 12:16:53.624861 24236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c552e5996384fef9c032a7fda531298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.625542 24159 tablet_service.cc:1511] Processing CreateTablet for tablet 7c552e5996384fef9c032a7fda531298 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:16:53.626945 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c552e5996384fef9c032a7fda531298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.631327 24235 tablet_service.cc:1511] Processing CreateTablet for tablet a6831162b73f4c16a41519abb392404b (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:53.632426 24291 tablet_bootstrap.cc:492] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:53.595575 24162 tablet_service.cc:1511] Processing CreateTablet for tablet a6831162b73f4c16a41519abb392404b (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:16:53.632782 24235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6831162b73f4c16a41519abb392404b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.635501 24290 tablet_bootstrap.cc:492] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:53.638921 24290 ts_tablet_manager.cc:1403] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.177s	user 0.045s	sys 0.026s
I20260709 12:16:53.639166 24162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6831162b73f4c16a41519abb392404b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.642428 24290 raft_consensus.cc:359] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.643301 24290 raft_consensus.cc:385] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.643682 24290 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.644758 24290 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.653620 24201 heartbeater.cc:499] Master 127.22.93.254:36285 was elected leader, sending a full tablet report...
I20260709 12:16:53.665050 24290 ts_tablet_manager.cc:1434] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:16:53.666531 24290 tablet_bootstrap.cc:492] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:53.679761 24085 tablet_service.cc:1511] Processing CreateTablet for tablet 2391737d1a8643bd885a4db57ceba96c (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:53.681281 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2391737d1a8643bd885a4db57ceba96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.685555 24159 tablet_service.cc:1511] Processing CreateTablet for tablet 2391737d1a8643bd885a4db57ceba96c (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:53.686965 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2391737d1a8643bd885a4db57ceba96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.689245 24291 tablet_bootstrap.cc:654] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.693447 24293 tablet_bootstrap.cc:492] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:53.694058 24293 ts_tablet_manager.cc:1403] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.207s	user 0.009s	sys 0.015s
I20260709 12:16:53.697597 24293 raft_consensus.cc:359] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.698421 24293 raft_consensus.cc:385] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.698750 24293 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.704856 24293 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.713050 24239 tablet_service.cc:1511] Processing CreateTablet for tablet 2391737d1a8643bd885a4db57ceba96c (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:16:53.714548 24239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2391737d1a8643bd885a4db57ceba96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.724691 24290 tablet_bootstrap.cc:654] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:53.726285 24127 tablet.cc:2406] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:16:53.726241 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 4e320f288fdb4be0ada8bfff79b41a9a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:53.727794 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e320f288fdb4be0ada8bfff79b41a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.726051 24084 tablet_service.cc:1511] Processing CreateTablet for tablet 4e320f288fdb4be0ada8bfff79b41a9a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:53.728765 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e320f288fdb4be0ada8bfff79b41a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.733573 24291 tablet_bootstrap.cc:492] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:53.734151 24291 ts_tablet_manager.cc:1403] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.102s	user 0.016s	sys 0.003s
I20260709 12:16:53.733428 24236 tablet_service.cc:1511] Processing CreateTablet for tablet 4e320f288fdb4be0ada8bfff79b41a9a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:16:53.740556 24236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e320f288fdb4be0ada8bfff79b41a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.747871 24291 raft_consensus.cc:359] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.748756 24291 raft_consensus.cc:385] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.749118 24291 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:53.750164 24291 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.752640 24291 ts_tablet_manager.cc:1434] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:16:53.760601 24291 tablet_bootstrap.cc:492] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:53.770800 24084 tablet_service.cc:1511] Processing CreateTablet for tablet 984475bb8f024d469921acdc98196b93 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:53.771819 24275 heartbeater.cc:499] Master 127.22.93.254:36285 was elected leader, sending a full tablet report...
I20260709 12:16:53.775857 24291 tablet_bootstrap.cc:654] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.777418 24162 tablet_service.cc:1511] Processing CreateTablet for tablet 984475bb8f024d469921acdc98196b93 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:53.778939 24162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984475bb8f024d469921acdc98196b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.778549 24236 tablet_service.cc:1511] Processing CreateTablet for tablet 984475bb8f024d469921acdc98196b93 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:16:53.779948 24236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984475bb8f024d469921acdc98196b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.781800 24159 tablet_service.cc:1511] Processing CreateTablet for tablet 7bea694ade5d4f1daf189ff65fa4a13f (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:53.783129 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bea694ade5d4f1daf189ff65fa4a13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.784294 24089 tablet_service.cc:1511] Processing CreateTablet for tablet 7bea694ade5d4f1daf189ff65fa4a13f (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:53.786015 24085 tablet_service.cc:1511] Processing CreateTablet for tablet f9a75b1a807b49b791d2de5abd8f8ca1 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:53.784782 24298 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.787470 24298 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.788314 24161 tablet_service.cc:1511] Processing CreateTablet for tablet f9a75b1a807b49b791d2de5abd8f8ca1 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:53.788312 24238 tablet_service.cc:1511] Processing CreateTablet for tablet 7bea694ade5d4f1daf189ff65fa4a13f (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:16:53.789775 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a75b1a807b49b791d2de5abd8f8ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.790344 24298 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:53.791038 24089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bea694ade5d4f1daf189ff65fa4a13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.795075 24238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bea694ade5d4f1daf189ff65fa4a13f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.795531 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a75b1a807b49b791d2de5abd8f8ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.807323 24299 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.807894 24299 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.810767 24299 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:53.811189 24293 ts_tablet_manager.cc:1434] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.115s	user 0.028s	sys 0.024s
I20260709 12:16:53.812407 24293 tablet_bootstrap.cc:492] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:53.837980 24294 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.838647 24294 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.850489 24086 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5c00e5364f4911a535f428ee9a0f9c (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:53.845974 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984475bb8f024d469921acdc98196b93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.861975 24290 tablet_bootstrap.cc:492] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:53.862614 24290 ts_tablet_manager.cc:1403] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.196s	user 0.013s	sys 0.016s
I20260709 12:16:53.867297 24294 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:53.880779 24162 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5c00e5364f4911a535f428ee9a0f9c (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:53.881546 24238 tablet_service.cc:1511] Processing CreateTablet for tablet f9a75b1a807b49b791d2de5abd8f8ca1 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:16:53.882267 24162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5c00e5364f4911a535f428ee9a0f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.882836 24238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a75b1a807b49b791d2de5abd8f8ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.888535 24239 tablet_service.cc:1511] Processing CreateTablet for tablet 4b5c00e5364f4911a535f428ee9a0f9c (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:16:53.890031 24239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5c00e5364f4911a535f428ee9a0f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.891258 24086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5c00e5364f4911a535f428ee9a0f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.896092 24233 tablet_service.cc:1511] Processing CreateTablet for tablet 93e303f1b8c84a32a8a6522ee6c6fb27 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:53.897466 24233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e303f1b8c84a32a8a6522ee6c6fb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.899251 24161 tablet_service.cc:1511] Processing CreateTablet for tablet 93e303f1b8c84a32a8a6522ee6c6fb27 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:53.900550 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e303f1b8c84a32a8a6522ee6c6fb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.901795 24293 tablet_bootstrap.cc:654] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.913220 24294 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:53.913911 24294 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.890622 24290 raft_consensus.cc:359] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.917169 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 93e303f1b8c84a32a8a6522ee6c6fb27 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:16:53.918596 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e303f1b8c84a32a8a6522ee6c6fb27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.923842 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:53.927333 24290 raft_consensus.cc:385] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:53.927759 24290 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
W20260709 12:16:53.929649 24141 leader_election.cc:343] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:53.929459 24290 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:53.940394 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc5bc9605e64854a78054b02b3da6dd (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:53.941205 24290 ts_tablet_manager.cc:1434] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.000s
I20260709 12:16:53.941996 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc5bc9605e64854a78054b02b3da6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.942380 24290 tablet_bootstrap.cc:492] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:53.952366 24290 tablet_bootstrap.cc:654] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:53.961871 24294 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:53.965960 24238 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc5bc9605e64854a78054b02b3da6dd (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:53.967563 24238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc5bc9605e64854a78054b02b3da6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.988143 24085 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc5bc9605e64854a78054b02b3da6dd (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:16:53.989722 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc5bc9605e64854a78054b02b3da6dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:53.989354 24235 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab5a3f1f43046a9860089fc73f7efff (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:53.991149 24291 tablet_bootstrap.cc:492] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:53.991696 24291 ts_tablet_manager.cc:1403] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.231s	user 0.012s	sys 0.013s
I20260709 12:16:53.993247 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:16:53.995429 24214 leader_election.cc:343] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.003180 24291 raft_consensus.cc:359] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.004382 24291 raft_consensus.cc:385] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.004813 24291 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.005632 24084 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab5a3f1f43046a9860089fc73f7efff (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:54.005970 24291 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.008203 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab5a3f1f43046a9860089fc73f7efff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.009959 24083 tablet_service.cc:1511] Processing CreateTablet for tablet 683c964dc5814af698a7b4af6649e9ed (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:54.029697 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 683c964dc5814af698a7b4af6649e9ed (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:54.032843 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:54.033578 24235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab5a3f1f43046a9860089fc73f7efff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.037333 24161 tablet_service.cc:1511] Processing CreateTablet for tablet 683c964dc5814af698a7b4af6649e9ed (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:16:54.038242 24162 tablet_service.cc:1511] Processing CreateTablet for tablet 010e8fce74be491b8432c9ea63b75515 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:54.038728 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683c964dc5814af698a7b4af6649e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:54.039930 24066 leader_election.cc:343] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.040553 24159 tablet_service.cc:1511] Processing CreateTablet for tablet 0ab5a3f1f43046a9860089fc73f7efff (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:16:54.041108 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683c964dc5814af698a7b4af6649e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.041683 24162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010e8fce74be491b8432c9ea63b75515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.043900 24089 tablet_service.cc:1511] Processing CreateTablet for tablet 010e8fce74be491b8432c9ea63b75515 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:54.044502 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:54.031569 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:16:54.048974 24140 leader_election.cc:343] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.049182 24239 tablet_service.cc:1511] Processing CreateTablet for tablet 010e8fce74be491b8432c9ea63b75515 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:16:54.049499 24140 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:16:54.049765 24066 leader_election.cc:343] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.050560 24239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010e8fce74be491b8432c9ea63b75515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.050755 24298 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.051208 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683c964dc5814af698a7b4af6649e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.054133 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ab5a3f1f43046a9860089fc73f7efff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.054271 24089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010e8fce74be491b8432c9ea63b75515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.060290 24293 tablet_bootstrap.cc:492] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:54.060956 24293 ts_tablet_manager.cc:1403] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.249s	user 0.021s	sys 0.016s
I20260709 12:16:54.070658 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:16:54.072917 24216 leader_election.cc:343] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.073499 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:54.074910 24299 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.080744 24293 raft_consensus.cc:359] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.081650 24293 raft_consensus.cc:385] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.081971 24293 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.082918 24293 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.090333 24091 tablet_service.cc:1511] Processing CreateTablet for tablet 4f40c9d3e625486382331d48f50901e2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:54.090819 24294 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.091395 24291 ts_tablet_manager.cc:1434] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.099s	user 0.010s	sys 0.001s
I20260709 12:16:54.091886 24091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f40c9d3e625486382331d48f50901e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.091521 24294 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.096568 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:54.099242 24066 leader_election.cc:343] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.100808 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 4f40c9d3e625486382331d48f50901e2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:54.100878 24163 tablet_service.cc:1511] Processing CreateTablet for tablet 4f40c9d3e625486382331d48f50901e2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:16:54.103701 24294 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:54.109952 24163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f40c9d3e625486382331d48f50901e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.110843 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 0a36a91a0b5548f28dd004a49f5cac15 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:54.110848 24164 tablet_service.cc:1511] Processing CreateTablet for tablet 0a36a91a0b5548f28dd004a49f5cac15 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:16:54.112533 24164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a36a91a0b5548f28dd004a49f5cac15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.116180 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a36a91a0b5548f28dd004a49f5cac15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.117285 24290 tablet_bootstrap.cc:492] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:54.117849 24290 ts_tablet_manager.cc:1403] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.176s	user 0.022s	sys 0.012s
I20260709 12:16:54.121244 24290 raft_consensus.cc:359] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.122004 24290 raft_consensus.cc:385] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.122311 24290 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.121708 24291 tablet_bootstrap.cc:492] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:54.127166 24290 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.130955 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:54.131593 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:54.132304 24175 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:54.132517 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:54.134094 24174 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:54.141624 24233 tablet_service.cc:1511] Processing CreateTablet for tablet 0a36a91a0b5548f28dd004a49f5cac15 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
W20260709 12:16:54.142429 24067 leader_election.cc:343] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.142973 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:54.143452 24158 tablet_service.cc:1511] Processing CreateTablet for tablet e1bb72a9478347d3a00d4ee984094ca3 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:54.143888 24294 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.144377 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:54.144977 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1bb72a9478347d3a00d4ee984094ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.145248 24294 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.145664 24294 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.145692 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:54.146108 24294 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.148454 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f40c9d3e625486382331d48f50901e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.155573 24233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a36a91a0b5548f28dd004a49f5cac15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.150664 24293 ts_tablet_manager.cc:1434] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.089s	user 0.011s	sys 0.000s
I20260709 12:16:54.160768 24291 tablet_bootstrap.cc:654] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.163538 24294 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.166494 24293 tablet_bootstrap.cc:492] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:54.167085 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:16:54.168689 24066 leader_election.cc:343] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.171646 24238 tablet_service.cc:1511] Processing CreateTablet for tablet e1bb72a9478347d3a00d4ee984094ca3 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:54.173112 24238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1bb72a9478347d3a00d4ee984094ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.174571 24293 tablet_bootstrap.cc:654] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.179821 24158 tablet_service.cc:1511] Processing CreateTablet for tablet f4b7521a95604ae58fb9e26c98b5e4a6 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:54.181541 24294 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:54.182542 24294 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.182927 24294 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.183295 24294 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.185544 24290 ts_tablet_manager.cc:1434] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.067s	user 0.008s	sys 0.000s
I20260709 12:16:54.186741 24290 tablet_bootstrap.cc:492] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:54.190516 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:54.191167 24175 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.193414 24089 tablet_service.cc:1511] Processing CreateTablet for tablet f4b7521a95604ae58fb9e26c98b5e4a6 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:54.196226 24164 tablet_service.cc:1511] Processing CreateTablet for tablet 51d85bfbe5fb4a4ba1caf713a20ce874 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:54.197019 24235 tablet_service.cc:1511] Processing CreateTablet for tablet f4b7521a95604ae58fb9e26c98b5e4a6 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:16:54.197206 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 51d85bfbe5fb4a4ba1caf713a20ce874 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:54.198318 24235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b7521a95604ae58fb9e26c98b5e4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.202024 24084 tablet_service.cc:1511] Processing CreateTablet for tablet e1bb72a9478347d3a00d4ee984094ca3 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:16:54.194726 24089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b7521a95604ae58fb9e26c98b5e4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.217568 24083 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5b70d71470484d8fc5f942623adb98 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:54.217859 24161 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5b70d71470484d8fc5f942623adb98 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:54.212287 24290 tablet_bootstrap.cc:654] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.217994 24239 tablet_service.cc:1511] Processing CreateTablet for tablet 7b5b70d71470484d8fc5f942623adb98 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:16:54.222347 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b7521a95604ae58fb9e26c98b5e4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.222440 24239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5b70d71470484d8fc5f942623adb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.223238 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5b70d71470484d8fc5f942623adb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.225847 24164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d85bfbe5fb4a4ba1caf713a20ce874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.230852 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d85bfbe5fb4a4ba1caf713a20ce874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.231621 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5b70d71470484d8fc5f942623adb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.232293 24086 tablet_service.cc:1511] Processing CreateTablet for tablet f1c672629a7b441f9e55890cd643e03a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:54.233636 24086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c672629a7b441f9e55890cd643e03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.238425 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1bb72a9478347d3a00d4ee984094ca3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.239787 24175 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:54.215174 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 51d85bfbe5fb4a4ba1caf713a20ce874 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:16:54.241320 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:54.241814 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d85bfbe5fb4a4ba1caf713a20ce874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.242846 24317 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.251896 24236 tablet_service.cc:1511] Processing CreateTablet for tablet f1c672629a7b441f9e55890cd643e03a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:54.252751 24159 tablet_service.cc:1511] Processing CreateTablet for tablet f1c672629a7b441f9e55890cd643e03a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:16:54.253408 24236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c672629a7b441f9e55890cd643e03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.254163 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c672629a7b441f9e55890cd643e03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.264887 24087 tablet_service.cc:1511] Processing CreateTablet for tablet 988ca15bb1fd49b7822eef733e4a24a3 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:54.266505 24087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988ca15bb1fd49b7822eef733e4a24a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.267880 24290 tablet_bootstrap.cc:492] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:54.268483 24290 ts_tablet_manager.cc:1403] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.082s	user 0.012s	sys 0.001s
I20260709 12:16:54.266482 24163 tablet_service.cc:1511] Processing CreateTablet for tablet 988ca15bb1fd49b7822eef733e4a24a3 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:54.280921 24163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988ca15bb1fd49b7822eef733e4a24a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.283145 24290 raft_consensus.cc:359] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.283982 24290 raft_consensus.cc:385] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.284263 24290 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.290648 24237 tablet_service.cc:1511] Processing CreateTablet for tablet 988ca15bb1fd49b7822eef733e4a24a3 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:16:54.291770 24083 tablet_service.cc:1511] Processing CreateTablet for tablet 8665b055009a4659b6d86621874dddbd (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:54.292212 24237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 988ca15bb1fd49b7822eef733e4a24a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.293622 24290 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.300421 24294 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.293144 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8665b055009a4659b6d86621874dddbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.306555 24290 ts_tablet_manager.cc:1434] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.002s
I20260709 12:16:54.349123 24290 tablet_bootstrap.cc:492] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:54.317705 24293 tablet_bootstrap.cc:492] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:54.318044 24291 tablet_bootstrap.cc:492] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:54.355414 24293 ts_tablet_manager.cc:1403] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.189s	user 0.013s	sys 0.002s
I20260709 12:16:54.355643 24291 ts_tablet_manager.cc:1403] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.234s	user 0.013s	sys 0.004s
I20260709 12:16:54.324518 24317 raft_consensus.cc:697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:54.357971 24317 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.325747 24162 tablet_service.cc:1511] Processing CreateTablet for tablet 66b5cb14ed8f4b58a27e168bcac560d2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:54.329779 24235 tablet_service.cc:1511] Processing CreateTablet for tablet 66b5cb14ed8f4b58a27e168bcac560d2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:54.334896 24086 tablet_service.cc:1511] Processing CreateTablet for tablet 39ed3ba506b24217972fa63093a56c52 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:54.336115 24087 tablet_service.cc:1511] Processing CreateTablet for tablet 66b5cb14ed8f4b58a27e168bcac560d2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:16:54.340015 24237 tablet_service.cc:1511] Processing CreateTablet for tablet 39ed3ba506b24217972fa63093a56c52 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:54.361553 24086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ed3ba506b24217972fa63093a56c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.362586 24087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b5cb14ed8f4b58a27e168bcac560d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.361553 24235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b5cb14ed8f4b58a27e168bcac560d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.364804 24237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ed3ba506b24217972fa63093a56c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.340016 24163 tablet_service.cc:1511] Processing CreateTablet for tablet 8665b055009a4659b6d86621874dddbd (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:54.368094 24321 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.368906 24290 tablet_bootstrap.cc:654] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.341616 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 39ed3ba506b24217972fa63093a56c52 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:16:54.343248 24082 tablet_service.cc:1511] Processing CreateTablet for tablet d4ba8a9e171042a4a56a0f731bf431cc (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:54.368687 24321 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.370333 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ba8a9e171042a4a56a0f731bf431cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.375412 24321 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:54.376091 24162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b5cb14ed8f4b58a27e168bcac560d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.376704 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ed3ba506b24217972fa63093a56c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.376866 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:54.377604 24163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8665b055009a4659b6d86621874dddbd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:54.379482 24067 leader_election.cc:343] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.382015 24293 raft_consensus.cc:359] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.382578 24291 raft_consensus.cc:359] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.378523 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:54.390882 24066 leader_election.cc:343] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.391423 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:54.391965 24294 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:54.392558 24294 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.394457 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:54.394676 24238 tablet_service.cc:1511] Processing CreateTablet for tablet d4ba8a9e171042a4a56a0f731bf431cc (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:16:54.395838 24066 leader_election.cc:343] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.396296 24238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ba8a9e171042a4a56a0f731bf431cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.399195 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:54.339717 24239 tablet_service.cc:1511] Processing CreateTablet for tablet 8665b055009a4659b6d86621874dddbd (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:16:54.399837 24175 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.400825 24239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8665b055009a4659b6d86621874dddbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.382826 24293 raft_consensus.cc:385] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.403833 24293 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.404733 24293 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.409498 24091 tablet_service.cc:1511] Processing CreateTablet for tablet b29f161fe0e24b51ad5c1903bdc5112c (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:54.393273 24159 tablet_service.cc:1511] Processing CreateTablet for tablet d4ba8a9e171042a4a56a0f731bf431cc (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:16:54.410962 24091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29f161fe0e24b51ad5c1903bdc5112c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.387374 24291 raft_consensus.cc:385] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.426321 24085 tablet_service.cc:1511] Processing CreateTablet for tablet 882bb02a9e9e423bbbc4df3dd0c55540 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:54.429927 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882bb02a9e9e423bbbc4df3dd0c55540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.419104 24293 ts_tablet_manager.cc:1434] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.008s
I20260709 12:16:54.418632 24299 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.432953 24299 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.434470 24293 tablet_bootstrap.cc:492] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:54.435621 24161 tablet_service.cc:1511] Processing CreateTablet for tablet 882bb02a9e9e423bbbc4df3dd0c55540 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:16:54.436127 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:54.438374 24233 tablet_service.cc:1511] Processing CreateTablet for tablet 882bb02a9e9e423bbbc4df3dd0c55540 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
W20260709 12:16:54.438956 24214 leader_election.cc:343] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.440106 24299 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:54.441282 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:16:54.443115 24216 leader_election.cc:343] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.443572 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:54.412093 24165 tablet_service.cc:1511] Processing CreateTablet for tablet b29f161fe0e24b51ad5c1903bdc5112c (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:54.446105 24299 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.413380 24236 tablet_service.cc:1511] Processing CreateTablet for tablet b29f161fe0e24b51ad5c1903bdc5112c (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:16:54.428045 24291 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.451062 23999 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:54.412093 24159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ba8a9e171042a4a56a0f731bf431cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.458096 24088 tablet_service.cc:1511] Processing CreateTablet for tablet c07ef51fde0145f3ab7d32fa63626a55 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:54.452692 24291 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.463202 24236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29f161fe0e24b51ad5c1903bdc5112c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.463201 24088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c07ef51fde0145f3ab7d32fa63626a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.464973 24317 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.465504 24317 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.466167 24291 ts_tablet_manager.cc:1434] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.110s	user 0.010s	sys 0.003s
I20260709 12:16:54.469868 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882bb02a9e9e423bbbc4df3dd0c55540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.474845 24175 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:54.477489 24233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882bb02a9e9e423bbbc4df3dd0c55540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.481314 24164 tablet_service.cc:1511] Processing CreateTablet for tablet c07ef51fde0145f3ab7d32fa63626a55 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:54.482815 24164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c07ef51fde0145f3ab7d32fa63626a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.494179 24231 tablet_service.cc:1511] Processing CreateTablet for tablet c07ef51fde0145f3ab7d32fa63626a55 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:16:54.495688 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c07ef51fde0145f3ab7d32fa63626a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.489246 24291 tablet_bootstrap.cc:492] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:54.507210 24293 tablet_bootstrap.cc:654] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.507483 24163 tablet_service.cc:1511] Processing CreateTablet for tablet c617be9ee61e4bb583e2fecf7f8cd9b2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:54.507563 24234 tablet_service.cc:1511] Processing CreateTablet for tablet c617be9ee61e4bb583e2fecf7f8cd9b2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:54.507441 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 9e016416bdc742068f5568ff2bebabd1 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:54.509102 24234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c617be9ee61e4bb583e2fecf7f8cd9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.511718 24298 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.512255 24298 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.500265 24165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29f161fe0e24b51ad5c1903bdc5112c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.514810 24317 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:54.516433 24290 tablet_bootstrap.cc:492] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:54.516816 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:54.517037 24290 ts_tablet_manager.cc:1403] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.170s	user 0.020s	sys 0.004s
W20260709 12:16:54.518492 24140 leader_election.cc:343] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.518608 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:54.516466 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:54.516942 24298 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:54.519721 24250 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:54.521771 24299 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.522274 24299 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.523404 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:54.523654 24290 raft_consensus.cc:359] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.524463 24290 raft_consensus.cc:385] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:54.524528 24141 leader_election.cc:343] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.524895 24290 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.525094 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:54.525725 24290 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.528559 24298 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.533224 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:54.535632 24299 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:54.536569 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:54.539057 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e016416bdc742068f5568ff2bebabd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.542564 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:16:54.544148 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:16:54.544551 24214 leader_election.cc:343] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:54.545919 24216 leader_election.cc:343] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.546382 24216 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:54.554922 24163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c617be9ee61e4bb583e2fecf7f8cd9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.550028 24299 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:54.549983 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:16:54.558218 24067 leader_election.cc:343] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.560362 24321 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.560887 24321 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:54.561808 24321 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.564227 24086 tablet_service.cc:1511] Processing CreateTablet for tablet 9e016416bdc742068f5568ff2bebabd1 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:54.565112 24166 tablet_service.cc:1511] Processing CreateTablet for tablet 07fcc70b8c0d43ae8334ea802c9a9924 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:54.565691 24086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e016416bdc742068f5568ff2bebabd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.566475 24166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fcc70b8c0d43ae8334ea802c9a9924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.568408 24084 tablet_service.cc:1511] Processing CreateTablet for tablet 07fcc70b8c0d43ae8334ea802c9a9924 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:54.569711 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fcc70b8c0d43ae8334ea802c9a9924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.549227 24317 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.582562 24317 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.583053 24317 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.574903 24089 tablet_service.cc:1511] Processing CreateTablet for tablet c617be9ee61e4bb583e2fecf7f8cd9b2 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:16:54.580739 24232 tablet_service.cc:1511] Processing CreateTablet for tablet 07fcc70b8c0d43ae8334ea802c9a9924 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:16:54.583549 24087 tablet_service.cc:1511] Processing CreateTablet for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:54.584213 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fcc70b8c0d43ae8334ea802c9a9924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.584213 24089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c617be9ee61e4bb583e2fecf7f8cd9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.588167 24162 tablet_service.cc:1511] Processing CreateTablet for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:54.589578 24162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29a1bdc82674a4ab1ad6c3b54c69e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.595412 24087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29a1bdc82674a4ab1ad6c3b54c69e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.624123 24090 tablet_service.cc:1511] Processing CreateTablet for tablet d84a44368371490a8287d9cb8d1620d0 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:54.625653 24090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84a44368371490a8287d9cb8d1620d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.628238 24293 tablet_bootstrap.cc:492] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:54.628862 24293 ts_tablet_manager.cc:1403] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.195s	user 0.024s	sys 0.013s
I20260709 12:16:54.643332 24158 tablet_service.cc:1511] Processing CreateTablet for tablet d84a44368371490a8287d9cb8d1620d0 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:54.644695 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84a44368371490a8287d9cb8d1620d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.647215 24235 tablet_service.cc:1511] Processing CreateTablet for tablet d84a44368371490a8287d9cb8d1620d0 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:16:54.648648 24235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84a44368371490a8287d9cb8d1620d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.655519 24238 tablet_service.cc:1511] Processing CreateTablet for tablet 9e016416bdc742068f5568ff2bebabd1 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:16:54.657065 24238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e016416bdc742068f5568ff2bebabd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.664757 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 73fc2a59a00e4ea6a3b63c28c6f58512 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:54.666214 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fc2a59a00e4ea6a3b63c28c6f58512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.667959 24236 tablet_service.cc:1511] Processing CreateTablet for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:16:54.669437 24236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29a1bdc82674a4ab1ad6c3b54c69e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.673197 24293 raft_consensus.cc:359] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.674091 24293 raft_consensus.cc:385] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.674453 24293 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.664580 24317 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.682004 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:16:54.683646 24067 leader_election.cc:343] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.687930 24239 tablet_service.cc:1511] Processing CreateTablet for tablet 73fc2a59a00e4ea6a3b63c28c6f58512 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:54.689513 24239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fc2a59a00e4ea6a3b63c28c6f58512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.695788 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:54.696497 24250 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.699851 24290 ts_tablet_manager.cc:1434] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.182s	user 0.010s	sys 0.009s
I20260709 12:16:54.700245 24293 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.704118 24250 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:54.705348 24290 tablet_bootstrap.cc:492] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:54.705482 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:16:54.706514 24321 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.707043 24321 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:54.708170 24321 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.702910 24293 ts_tablet_manager.cc:1434] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.002s
I20260709 12:16:54.714260 24293 tablet_bootstrap.cc:492] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:54.716747 24317 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:54.721261 24084 tablet_service.cc:1511] Processing CreateTablet for tablet 73fc2a59a00e4ea6a3b63c28c6f58512 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:16:54.722785 24084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fc2a59a00e4ea6a3b63c28c6f58512. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.728803 24163 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd67e018d26493bae6d921a57dfc306 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:54.730203 24163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd67e018d26493bae6d921a57dfc306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.729982 24085 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd67e018d26493bae6d921a57dfc306 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:54.731715 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd67e018d26493bae6d921a57dfc306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.731453 24234 tablet_service.cc:1511] Processing CreateTablet for tablet 9dd67e018d26493bae6d921a57dfc306 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:16:54.733024 24234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd67e018d26493bae6d921a57dfc306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.739676 24291 tablet_bootstrap.cc:654] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.741286 24293 tablet_bootstrap.cc:654] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.745821 24088 tablet_service.cc:1511] Processing CreateTablet for tablet 07add62ce67548c3bdb714821b78d1d1 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:54.751776 24232 tablet_service.cc:1511] Processing CreateTablet for tablet 07add62ce67548c3bdb714821b78d1d1 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:54.753211 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07add62ce67548c3bdb714821b78d1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.755044 24164 tablet_service.cc:1511] Processing CreateTablet for tablet ee66a7413b024d4b8e542242a567c0cf (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:54.756366 24164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee66a7413b024d4b8e542242a567c0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.764189 24239 tablet_service.cc:1511] Processing CreateTablet for tablet 46a4dd5f831f4ddca30827249660c52a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:54.764672 24290 tablet_bootstrap.cc:654] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:54.765678 24239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a4dd5f831f4ddca30827249660c52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.773842 24091 tablet_service.cc:1511] Processing CreateTablet for tablet ee66a7413b024d4b8e542242a567c0cf (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:54.783128 24158 tablet_service.cc:1511] Processing CreateTablet for tablet ce278f8a39b344f9a0cd7dcd099a3b66 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:54.784485 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce278f8a39b344f9a0cd7dcd099a3b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.785877 24326 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:54.786384 24326 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.788053 24237 tablet_service.cc:1511] Processing CreateTablet for tablet ce278f8a39b344f9a0cd7dcd099a3b66 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:54.789414 24237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce278f8a39b344f9a0cd7dcd099a3b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.791436 24088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07add62ce67548c3bdb714821b78d1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.791507 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:54.792377 24250 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:54.797628 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:16:54.799922 24140 leader_election.cc:343] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.800340 24231 tablet_service.cc:1511] Processing CreateTablet for tablet ee66a7413b024d4b8e542242a567c0cf (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:16:54.801148 24141 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:54.802138 24298 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:54.802311 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee66a7413b024d4b8e542242a567c0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.802567 24298 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:54.802976 24298 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.807117 24326 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:54.811661 24298 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.830192 24165 tablet_service.cc:1511] Processing CreateTablet for tablet 07add62ce67548c3bdb714821b78d1d1 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:16:54.832122 24165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07add62ce67548c3bdb714821b78d1d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.860555 24158 tablet_service.cc:1511] Processing CreateTablet for tablet 0996a24d22664e97aa7ba765bb20ef47 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:54.862510 24158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0996a24d22664e97aa7ba765bb20ef47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.866310 24298 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:54.868417 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:54.868880 24082 tablet_service.cc:1511] Processing CreateTablet for tablet 46a4dd5f831f4ddca30827249660c52a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:54.872644 24083 tablet_service.cc:1511] Processing CreateTablet for tablet ce278f8a39b344f9a0cd7dcd099a3b66 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:16:54.876413 24161 tablet_service.cc:1511] Processing CreateTablet for tablet 46a4dd5f831f4ddca30827249660c52a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:16:54.877835 24087 tablet_service.cc:1511] Processing CreateTablet for tablet 0996a24d22664e97aa7ba765bb20ef47 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:54.878345 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a4dd5f831f4ddca30827249660c52a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:16:54.879855 24140 leader_election.cc:343] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:54.882827 24321 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:54.896176 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:54.897198 24250 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:54.886552 24082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46a4dd5f831f4ddca30827249660c52a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.950577 24290 tablet_bootstrap.cc:492] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:54.951212 24290 ts_tablet_manager.cc:1403] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.246s	user 0.094s	sys 0.096s
I20260709 12:16:54.952152 24237 tablet_service.cc:1511] Processing CreateTablet for tablet 0996a24d22664e97aa7ba765bb20ef47 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:16:54.953557 24237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0996a24d22664e97aa7ba765bb20ef47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.954378 24290 raft_consensus.cc:359] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.955173 24290 raft_consensus.cc:385] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.955490 24290 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.956575 24290 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.959089 24091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee66a7413b024d4b8e542242a567c0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.961925 24291 tablet_bootstrap.cc:492] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:54.962474 24291 ts_tablet_manager.cc:1403] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.495s	user 0.015s	sys 0.008s
I20260709 12:16:54.967813 24293 tablet_bootstrap.cc:492] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:54.968390 24293 ts_tablet_manager.cc:1403] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.254s	user 0.023s	sys 0.007s
I20260709 12:16:54.977577 24291 raft_consensus.cc:359] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:54.978474 24291 raft_consensus.cc:385] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:54.980227 24086 tablet_service.cc:1511] Processing CreateTablet for tablet 30d4ada45d4b4872986993abc4470158 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:54.981431 24162 tablet_service.cc:1511] Processing CreateTablet for tablet 30d4ada45d4b4872986993abc4470158 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:54.986466 24250 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:54.978767 24291 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:54.993947 24141 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:54.996006 24298 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:54.996556 24298 raft_consensus.cc:697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:54.997452 24298 consensus_queue.cc:237] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.000394 24162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d4ada45d4b4872986993abc4470158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.000329 24232 tablet_service.cc:1511] Processing CreateTablet for tablet b5f8a25e7c97459c955d7ca7accd826d (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:55.001844 24232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f8a25e7c97459c955d7ca7accd826d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.002213 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 67948aed495f4bd9b04d87c9adbfe164 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:55.003407 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67948aed495f4bd9b04d87c9adbfe164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.003276 24083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce278f8a39b344f9a0cd7dcd099a3b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.026607 24161 tablet_service.cc:1511] Processing CreateTablet for tablet 67948aed495f4bd9b04d87c9adbfe164 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:55.028075 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67948aed495f4bd9b04d87c9adbfe164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.032051 24166 tablet_service.cc:1511] Processing CreateTablet for tablet b5f8a25e7c97459c955d7ca7accd826d (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:55.033308 24166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f8a25e7c97459c955d7ca7accd826d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.036531 24090 tablet_service.cc:1511] Processing CreateTablet for tablet b5f8a25e7c97459c955d7ca7accd826d (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:16:55.036531 24293 raft_consensus.cc:359] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.038470 24293 raft_consensus.cc:385] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.038765 24293 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
W20260709 12:16:55.040563 24066 consensus_peers.cc:597] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:55.041486 24293 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.044680 24085 tablet_service.cc:1511] Processing CreateTablet for tablet 67948aed495f4bd9b04d87c9adbfe164 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:16:55.026263 24087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0996a24d22664e97aa7ba765bb20ef47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.048769 24293 ts_tablet_manager.cc:1434] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.080s	user 0.009s	sys 0.000s
I20260709 12:16:55.049896 24293 tablet_bootstrap.cc:492] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:55.051663 24236 tablet_service.cc:1511] Processing CreateTablet for tablet 30d4ada45d4b4872986993abc4470158 (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:16:55.053400 24236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d4ada45d4b4872986993abc4470158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:54.993845 24291 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.059751 24294 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.060241 24294 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.061501 24291 ts_tablet_manager.cc:1434] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.099s	user 0.005s	sys 0.004s
I20260709 12:16:55.062592 24291 tablet_bootstrap.cc:492] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:55.066099 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.066322 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:55.073652 24088 tablet_service.cc:1511] Processing CreateTablet for tablet 680463fca31f47d494316f240f1df66a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:55.076496 24250 raft_consensus.cc:2393] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:16:55.087769 24290 ts_tablet_manager.cc:1434] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.136s	user 0.003s	sys 0.005s
I20260709 12:16:55.088260 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:55.075441 24294 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.089885 24086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30d4ada45d4b4872986993abc4470158. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.102466 24161 tablet_service.cc:1511] Processing CreateTablet for tablet 680463fca31f47d494316f240f1df66a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:55.103678 24161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680463fca31f47d494316f240f1df66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.107366 24090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f8a25e7c97459c955d7ca7accd826d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.116053 24231 tablet_service.cc:1511] Processing CreateTablet for tablet 680463fca31f47d494316f240f1df66a (DEFAULT_TABLE table=test-workload [id=284b02a75f9442be882da483bd34afd6]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:16:55.117394 24231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680463fca31f47d494316f240f1df66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.096025 24299 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.118445 24299 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.120874 24299 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.121814 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.130398 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.131335 24174 raft_consensus.cc:2393] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:16:55.133628 24173 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.135589 24216 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.136914 24299 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.138290 24317 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.100222 24294 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.105217 24290 tablet_bootstrap.cc:492] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
W20260709 12:16:55.156570 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 68419.7us
I20260709 12:16:55.153373 24085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67948aed495f4bd9b04d87c9adbfe164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.162734 24291 tablet_bootstrap.cc:654] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.164368 24293 tablet_bootstrap.cc:654] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.180354 24299 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.171196 24290 tablet_bootstrap.cc:654] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.184831 24298 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.185571 24298 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.188365 24317 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.172247 24294 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.176496 24088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680463fca31f47d494316f240f1df66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:16:55.205729 24298 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.209406 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.210714 24339 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.220440 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:55.221278 24250 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:55.226739 24141 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.236258 24298 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:55.241739 24298 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:16:55.242326 24298 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.239603 23996 catalog_manager.cc:5697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.256765 24293 tablet_bootstrap.cc:492] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:55.257457 24293 ts_tablet_manager.cc:1403] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.208s	user 0.012s	sys 0.028s
I20260709 12:16:55.258152 24298 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.268258 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:55.269037 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:55.269672 24249 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.268136 24344 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.274717 24291 tablet_bootstrap.cc:492] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:55.271330 24293 raft_consensus.cc:359] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.275558 24293 raft_consensus.cc:385] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.275960 24293 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.276676 24290 tablet_bootstrap.cc:492] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:55.276942 24173 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:55.277240 24290 ts_tablet_manager.cc:1403] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.007s
I20260709 12:16:55.277141 24293 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.278885 24317 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.279783 24344 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:55.280125 24293 ts_tablet_manager.cc:1434] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.002s
I20260709 12:16:55.280293 24344 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:55.279762 23997 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.281471 24344 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.282052 24293 tablet_bootstrap.cc:492] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:55.282709 24344 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.282119 23997 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.290403 24293 tablet_bootstrap.cc:654] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.294896 24291 ts_tablet_manager.cc:1403] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.233s	user 0.020s	sys 0.013s
I20260709 12:16:55.298496 24290 raft_consensus.cc:359] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.298969 24298 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.299365 24290 raft_consensus.cc:385] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.299752 24290 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.301580 24291 raft_consensus.cc:359] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.302376 24291 raft_consensus.cc:385] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.302678 24291 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.303614 24293 tablet_bootstrap.cc:492] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:55.304122 24293 ts_tablet_manager.cc:1403] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.002s
I20260709 12:16:55.304450 24290 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.304147 24291 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.307382 24293 raft_consensus.cc:359] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.308122 24293 raft_consensus.cc:385] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.308432 24293 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.305644 24249 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:16:55.309273 24293 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.309894 24248 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:16:55.310079 24141 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.311766 24293 ts_tablet_manager.cc:1434] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:16:55.311743 24298 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:55.312716 24298 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:55.312978 24293 tablet_bootstrap.cc:492] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:55.313445 24291 ts_tablet_manager.cc:1434] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:16:55.313671 24298 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.314204 24290 ts_tablet_manager.cc:1434] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.001s
I20260709 12:16:55.315407 24290 tablet_bootstrap.cc:492] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:55.322099 24293 tablet_bootstrap.cc:654] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.323160 24299 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.323374 24291 tablet_bootstrap.cc:492] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:55.323705 24299 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.326279 24299 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.327211 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.327831 24101 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:55.329077 24214 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:55.330117 24299 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.330590 24299 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.330117 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.331133 24299 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.331429 24173 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:55.337317 24290 tablet_bootstrap.cc:654] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.346457 24293 tablet_bootstrap.cc:492] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:55.346221 24299 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.347182 24293 ts_tablet_manager.cc:1403] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.014s
I20260709 12:16:55.348269 24291 tablet_bootstrap.cc:654] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.347503 23999 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 2 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.349819 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:55.350410 24101 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.351061 24293 raft_consensus.cc:359] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.356208 24293 raft_consensus.cc:385] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.356573 24293 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.357704 24293 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.364439 24351 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.365203 24351 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.366112 24290 tablet_bootstrap.cc:492] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:55.366670 24290 ts_tablet_manager.cc:1403] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.052s	user 0.006s	sys 0.010s
I20260709 12:16:55.370144 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:16:55.372556 24214 leader_election.cc:343] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.375447 24290 raft_consensus.cc:359] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.376466 24290 raft_consensus.cc:385] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.376821 24290 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.377985 24290 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.381011 24290 ts_tablet_manager.cc:1434] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:16:55.382655 24290 tablet_bootstrap.cc:492] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:55.385363 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:55.386230 24173 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.389302 24293 ts_tablet_manager.cc:1434] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.042s	user 0.013s	sys 0.011s
I20260709 12:16:55.387843 24299 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.391530 24293 tablet_bootstrap.cc:492] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:55.390060 24101 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:55.393455 24214 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:55.397379 24290 tablet_bootstrap.cc:654] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.397563 24291 tablet_bootstrap.cc:492] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:55.398077 24291 ts_tablet_manager.cc:1403] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.027s
I20260709 12:16:55.398149 24293 tablet_bootstrap.cc:654] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.400204 24299 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.401199 24299 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:55.401141 24291 raft_consensus.cc:359] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.401983 24291 raft_consensus.cc:385] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.402276 24291 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.403005 24291 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.405206 24291 ts_tablet_manager.cc:1434] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:55.402554 24299 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.411314 24291 tablet_bootstrap.cc:492] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:55.417513 24173 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:55.419874 24351 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.422196 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.423236 24173 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:55.427052 24216 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.429035 24351 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.429543 24351 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.429960 24351 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.437112 24291 tablet_bootstrap.cc:654] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.443898 24290 tablet_bootstrap.cc:492] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:55.444527 24290 ts_tablet_manager.cc:1403] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.022s
I20260709 12:16:55.444929 23999 catalog_manager.cc:5697] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.447676 24290 raft_consensus.cc:359] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.448570 24290 raft_consensus.cc:385] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.448889 24290 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.450199 24293 tablet_bootstrap.cc:492] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:55.450166 24290 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.450805 24293 ts_tablet_manager.cc:1403] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.060s	user 0.010s	sys 0.017s
I20260709 12:16:55.451467 24351 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.452617 24290 ts_tablet_manager.cc:1434] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:55.453697 24290 tablet_bootstrap.cc:492] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:55.454121 24293 raft_consensus.cc:359] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.454778 24293 raft_consensus.cc:385] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.455096 24293 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.455471 24291 tablet_bootstrap.cc:492] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:55.455962 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:55.456666 24351 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.456311 24293 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.458411 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:55.458662 24293 ts_tablet_manager.cc:1434] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:16:55.459071 24173 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.460255 24293 tablet_bootstrap.cc:492] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:55.461092 24290 tablet_bootstrap.cc:654] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:55.464033 24214 leader_election.cc:343] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.467125 24293 tablet_bootstrap.cc:654] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.470772 24173 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:55.473097 24216 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.455962 24291 ts_tablet_manager.cc:1403] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.007s
I20260709 12:16:55.474079 24351 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.474651 24351 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:55.475647 24351 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.477212 24291 raft_consensus.cc:359] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.478032 24291 raft_consensus.cc:385] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.478353 24291 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.479043 24290 tablet_bootstrap.cc:492] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:55.479585 24290 ts_tablet_manager.cc:1403] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.004s
I20260709 12:16:55.479189 24291 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.481557 24291 ts_tablet_manager.cc:1434] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:55.482963 24291 tablet_bootstrap.cc:492] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:55.482704 24290 raft_consensus.cc:359] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.485162 24290 raft_consensus.cc:385] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.485467 24290 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.486258 24290 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.488651 24290 ts_tablet_manager.cc:1434] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:16:55.490087 24291 tablet_bootstrap.cc:654] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.493870 24290 tablet_bootstrap.cc:492] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:55.494313 24249 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.502436 24290 tablet_bootstrap.cc:654] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.506229 24293 tablet_bootstrap.cc:492] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:55.506968 24293 ts_tablet_manager.cc:1403] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.002s
I20260709 12:16:55.511412 24293 raft_consensus.cc:359] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.512470 24293 raft_consensus.cc:385] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.512831 24293 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.513743 24293 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.521519 24293 ts_tablet_manager.cc:1434] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:16:55.522855 24293 tablet_bootstrap.cc:492] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:55.531975 24293 tablet_bootstrap.cc:654] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.532532 24290 tablet_bootstrap.cc:492] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:55.533151 24290 ts_tablet_manager.cc:1403] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.001s
I20260709 12:16:55.538131 24290 raft_consensus.cc:359] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.538700 24290 raft_consensus.cc:385] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.538935 24290 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.539671 24290 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.541250 24290 ts_tablet_manager.cc:1434] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:55.542537 24290 tablet_bootstrap.cc:492] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:55.549679 24290 tablet_bootstrap.cc:654] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:55.551211 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:55.552969 24298 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.559736 24298 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.575717 23997 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.588532 24293 tablet_bootstrap.cc:492] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:55.589138 24293 ts_tablet_manager.cc:1403] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.019s
I20260709 12:16:55.607784 24293 raft_consensus.cc:359] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.608652 24293 raft_consensus.cc:385] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.608958 24293 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.609695 24293 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.610846 24344 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.611430 24344 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.612177 24293 ts_tablet_manager.cc:1434] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.001s
I20260709 12:16:55.612388 24290 tablet_bootstrap.cc:492] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:55.613058 24290 ts_tablet_manager.cc:1403] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.008s
I20260709 12:16:55.613325 24293 tablet_bootstrap.cc:492] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:55.616986 24344 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.617250 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.617939 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:55.617985 24173 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:55.618814 24248 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:55.619464 24351 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.620004 24351 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.620393 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:55.620787 24293 tablet_bootstrap.cc:654] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.621843 24344 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.622249 24344 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.622516 24351 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.622658 24344 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.628808 24291 tablet_bootstrap.cc:492] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:55.630089 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.631494 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.629418 24291 ts_tablet_manager.cc:1403] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.147s	user 0.042s	sys 0.034s
W20260709 12:16:55.633291 24216 leader_election.cc:343] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.636567 24291 raft_consensus.cc:359] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.637508 24291 raft_consensus.cc:385] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.630884 24101 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:55.637882 24370 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.638892 24214 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:16:55.638638 24370 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.640491 24299 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.640925 24299 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.641317 24299 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.643318 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.644980 24370 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.645406 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:55.647156 24141 leader_election.cc:343] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.649353 24293 tablet_bootstrap.cc:492] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:55.649935 24293 ts_tablet_manager.cc:1403] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.008s
I20260709 12:16:55.651525 24344 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.653537 24293 raft_consensus.cc:359] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.654415 24299 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.654754 24293 raft_consensus.cc:385] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.654742 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:55.655328 24293 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.655539 24173 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.656219 24293 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.657665 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:55.658274 24101 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.658845 24293 ts_tablet_manager.cc:1434] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.005s
I20260709 12:16:55.637897 24291 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.660240 24293 tablet_bootstrap.cc:492] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:55.660625 24291 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.661581 24100 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:55.665069 24140 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:55.666544 24370 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.666931 24370 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.667285 24370 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.668968 24101 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:55.669219 24351 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.670326 24214 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:55.669745 24351 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.671590 24293 tablet_bootstrap.cc:654] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.671500 24354 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.674279 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.674259 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:16:55.676020 24216 leader_election.cc:343] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:55.676831 24214 leader_election.cc:343] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.677331 24214 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.674360 24351 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.680706 24351 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.664379 24290 raft_consensus.cc:359] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.683331 24290 raft_consensus.cc:385] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.683665 24290 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.684526 24290 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.685083 24293 tablet_bootstrap.cc:492] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:55.685681 24293 ts_tablet_manager.cc:1403] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 12:16:55.686154 24173 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:55.687307 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:55.688086 24175 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.689762 24291 ts_tablet_manager.cc:1434] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:16:55.689692 24293 raft_consensus.cc:359] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.690548 24293 raft_consensus.cc:385] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.690879 24293 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.691695 24293 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.693229 24370 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.693976 24293 ts_tablet_manager.cc:1434] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:55.695071 24293 tablet_bootstrap.cc:492] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:55.696718 24175 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:55.697068 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:55.697783 24321 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.699631 24290 ts_tablet_manager.cc:1434] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.086s	user 0.007s	sys 0.001s
I20260709 12:16:55.700320 24291 tablet_bootstrap.cc:492] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:55.700415 24290 tablet_bootstrap.cc:492] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:55.698343 24321 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.698418 24299 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.699285 24248 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.704941 24321 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.710111 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:55.710492 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:55.711009 24101 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.711107 24067 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:16:55.712077 24249 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:55.713020 24321 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.713579 24321 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:55.714529 24321 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.717368 24066 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:55.718670 24294 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.719231 24294 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.719674 24294 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.721652 24374 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.701793 24344 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.722219 24374 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.727159 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:55.728513 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:16:55.728884 24141 leader_election.cc:343] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.729259 24100 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:55.730852 24101 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:55.732616 24140 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:55.733081 24294 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.725220 24354 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:55.734777 24369 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.735400 24369 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:55.735563 24354 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.736348 24369 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.739167 24214 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:55.740180 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:55.731586 24370 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.750200 24326 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.751612 24326 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.754509 24326 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.756417 24374 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.756670 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.738023 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.757380 24176 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:55.758387 24372 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.758913 24372 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.759052 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.760171 24372 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.760530 24101 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:55.763058 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:55.751642 24175 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.763720 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:16:55.782522 24293 tablet_bootstrap.cc:654] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.784256 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:55.784894 24250 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.776021 24294 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.789211 24248 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:55.791431 24326 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.791857 24326 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.792214 24326 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.793835 24290 tablet_bootstrap.cc:654] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.796082 24291 tablet_bootstrap.cc:654] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.807360 24326 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.814693 24250 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:55.818665 24066 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:55.819777 24294 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:55.820315 24294 raft_consensus.cc:697] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:55.821762 24294 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.826380 24248 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.829033 24298 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:55.834168 24374 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.834950 24291 tablet_bootstrap.cc:492] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:55.834714 24374 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.835547 24291 ts_tablet_manager.cc:1403] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.135s	user 0.022s	sys 0.019s
I20260709 12:16:55.836977 24374 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.837121 24175 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:55.837611 24370 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.838133 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.838133 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.841711 24176 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:55.838078 24370 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:55.842538 24214 leader_election.cc:343] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.845284 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.849915 24291 raft_consensus.cc:359] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.850636 24291 raft_consensus.cc:385] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.850966 24291 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.850687 23997 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.851614 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.845867 24370 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.848377 24374 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:55.853488 24374 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.853421 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:55.853946 24374 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.854133 24250 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:55.852645 24291 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.856638 24291 ts_tablet_manager.cc:1434] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.021s	user 0.002s	sys 0.005s
I20260709 12:16:55.857507 24291 tablet_bootstrap.cc:492] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:55.859380 24141 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.860875 24370 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:55.861359 24370 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:55.861763 24370 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.868136 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:55.870090 24101 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.870592 24326 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.875986 24100 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.877696 24290 tablet_bootstrap.cc:492] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:55.878228 24290 ts_tablet_manager.cc:1403] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.178s	user 0.022s	sys 0.020s
I20260709 12:16:55.886312 24291 tablet_bootstrap.cc:654] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:55.886287 24299 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:55.888882 24099 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:55.891041 24326 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:55.890898 23999 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:55.898304 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:55.902910 24370 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.903952 24374 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.907431 24290 raft_consensus.cc:359] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.908480 24290 raft_consensus.cc:385] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:55.908849 24290 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:55.910584 24374 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.913576 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:55.914247 24372 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:55.915967 24214 leader_election.cc:343] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.917793 24249 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:55.919257 24299 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.919932 24299 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.913272 24290 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.931509 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.936918 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:55.939879 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:55.942730 24175 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:55.946137 24298 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:16:55.947831 24216 leader_election.cc:343] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.946897 24298 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:55.948803 24214 leader_election.cc:343] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.949481 24214 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.950596 24354 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.952883 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:55.953293 24298 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.926072 24299 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:16:55.955390 24140 leader_election.cc:343] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.927747 23997 catalog_manager.cc:5697] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:55.957058 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:55.958244 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:55.962517 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:55.963428 24176 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:16:55.964313 24141 leader_election.cc:343] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:55.964753 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:55.964835 24141 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:55.960132 24290 ts_tablet_manager.cc:1434] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.082s	user 0.008s	sys 0.000s
I20260709 12:16:55.961184 24372 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:55.966884 24290 tablet_bootstrap.cc:492] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:55.968520 24298 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.932691 24101 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:55.983882 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:55.969322 24370 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:55.989616 24249 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:55.983906 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:55.992843 24372 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:16:55.995075 24291 tablet_bootstrap.cc:492] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:55.995606 24291 ts_tablet_manager.cc:1403] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.138s	user 0.030s	sys 0.018s
I20260709 12:16:55.989744 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:55.997184 24294 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:55.997691 24294 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.999154 24291 raft_consensus.cc:359] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:55.999897 24291 raft_consensus.cc:385] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.000162 24291 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.000954 24291 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.001623 24372 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.003193 24291 ts_tablet_manager.cc:1434] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:56.004199 24291 tablet_bootstrap.cc:492] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:55.991398 24175 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:56.006362 23997 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.009264 24370 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.024127 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:56.024655 24370 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:56.025092 24293 tablet_bootstrap.cc:492] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:56.025583 24293 ts_tablet_manager.cc:1403] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.331s	user 0.017s	sys 0.018s
I20260709 12:16:56.010008 24294 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.008239 24372 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.021181 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:56.023476 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:56.025674 24370 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.028458 24299 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.028983 24299 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:56.029888 24299 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.004097 24249 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:16:56.036705 24141 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:56.038434 24298 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.039129 24298 raft_consensus.cc:697] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:56.040333 24298 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.044992 24291 tablet_bootstrap.cc:654] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.048485 24293 raft_consensus.cc:359] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.049264 24293 raft_consensus.cc:385] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.049573 24293 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.050379 24293 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.052933 24293 ts_tablet_manager.cc:1434] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 12:16:56.053929 24293 tablet_bootstrap.cc:492] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:56.036235 24173 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:56.063591 24067 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:56.063791 24351 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.073429 24317 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:16:56.080938 24290 tablet_bootstrap.cc:654] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.082963 23999 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.094192 24317 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:16:56.094743 24317 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.097275 24293 tablet_bootstrap.cc:654] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.120962 24317 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.122331 24100 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:16:56.123404 24321 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.124251 24374 consensus_queue.cc:1059] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.125154 24374 raft_consensus.cc:3055] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:56.125494 24374 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:56.126257 24291 tablet_bootstrap.cc:492] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:56.126953 24374 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.127820 24290 tablet_bootstrap.cc:492] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:56.128501 24290 ts_tablet_manager.cc:1403] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.162s	user 0.010s	sys 0.011s
I20260709 12:16:56.128726 24374 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.131058 24291 ts_tablet_manager.cc:1403] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.123s	user 0.005s	sys 0.021s
I20260709 12:16:56.135308 24372 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.135144 24294 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.135916 24372 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.137454 24291 raft_consensus.cc:359] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.138273 24372 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:56.138437 24291 raft_consensus.cc:385] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.138845 24291 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.141767 24290 raft_consensus.cc:359] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.142745 24290 raft_consensus.cc:385] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.143242 24290 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.145367 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:56.145391 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:56.146680 24100 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:16:56.148582 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:56.148486 24291 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.149804 24372 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.142620 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:56.144264 24290 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.153224 24291 ts_tablet_manager.cc:1434] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.000s
I20260709 12:16:56.157377 24290 ts_tablet_manager.cc:1434] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.001s
I20260709 12:16:56.157971 24291 tablet_bootstrap.cc:492] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:56.158792 23996 catalog_manager.cc:5697] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.161631 24317 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.162349 24290 tablet_bootstrap.cc:492] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:56.162123 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:56.162768 23996 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 2 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.176021 24250 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:16:56.178727 24290 tablet_bootstrap.cc:654] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.178459 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:16:56.179817 24317 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:16:56.181105 24291 tablet_bootstrap.cc:654] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.183805 24317 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:56.192749 24317 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.204797 24372 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.207752 24293 tablet_bootstrap.cc:492] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:56.208213 24293 ts_tablet_manager.cc:1403] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.155s	user 0.024s	sys 0.055s
I20260709 12:16:56.209280 24291 tablet_bootstrap.cc:492] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:56.209784 24291 ts_tablet_manager.cc:1403] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.009s
I20260709 12:16:56.213562 24293 raft_consensus.cc:359] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.214370 24293 raft_consensus.cc:385] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.214677 24293 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.215442 24293 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.217643 24293 ts_tablet_manager.cc:1434] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:16:56.218645 24293 tablet_bootstrap.cc:492] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:56.221737 24290 tablet_bootstrap.cc:492] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:56.222123 24290 ts_tablet_manager.cc:1403] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.004s
I20260709 12:16:56.231690 24291 raft_consensus.cc:359] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.233769 24291 raft_consensus.cc:385] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.234020 24291 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.238786 24293 tablet_bootstrap.cc:654] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.240139 24290 raft_consensus.cc:359] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.240705 24290 raft_consensus.cc:385] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.240947 24290 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.242862 24291 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.244477 24290 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.246250 24290 ts_tablet_manager.cc:1434] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.001s
I20260709 12:16:56.247993 24290 tablet_bootstrap.cc:492] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:56.248679 24291 ts_tablet_manager.cc:1434] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260709 12:16:56.249706 24291 tablet_bootstrap.cc:492] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:56.250686 24372 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.251241 24372 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.251060 23999 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.253501 24372 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:56.254767 24290 tablet_bootstrap.cc:654] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.255296 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:56.256639 24291 tablet_bootstrap.cc:654] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.257979 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:56.258700 24176 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:56.260526 24248 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
W20260709 12:16:56.262068 24214 leader_election.cc:343] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.262952 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:56.262777 24321 consensus_queue.cc:1059] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.264487 24294 raft_consensus.cc:3055] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:16:56.264990 24294 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:56.266095 24294 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.267360 24294 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.269975 24372 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.270418 24372 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.270807 24372 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.282351 24374 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.286831 24298 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.287606 24298 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.289849 24372 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.292990 24298 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.293062 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:56.295149 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:56.298018 24214 leader_election.cc:343] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.299242 24290 tablet_bootstrap.cc:492] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
W20260709 12:16:56.299448 24141 leader_election.cc:343] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.299908 24290 ts_tablet_manager.cc:1403] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.012s
I20260709 12:16:56.300345 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:56.301218 24100 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:56.302826 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:56.303277 24291 tablet_bootstrap.cc:492] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:56.303900 24291 ts_tablet_manager.cc:1403] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.017s
I20260709 12:16:56.304317 24290 raft_consensus.cc:359] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.304648 24298 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.305054 24290 raft_consensus.cc:385] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.305121 24298 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.305415 24290 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.305596 24298 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.306216 24290 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.308388 24290 ts_tablet_manager.cc:1434] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:56.309358 24290 tablet_bootstrap.cc:492] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:56.314929 24374 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.315279 24293 tablet_bootstrap.cc:492] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:56.315958 24293 ts_tablet_manager.cc:1403] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.098s	user 0.019s	sys 0.004s
I20260709 12:16:56.315969 24298 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.317169 24372 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:56.318444 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:56.319108 24175 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.324079 24290 tablet_bootstrap.cc:654] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.325508 24298 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.327669 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:56.328588 24291 raft_consensus.cc:359] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.329265 24298 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.329638 24291 raft_consensus.cc:385] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.330060 24291 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
W20260709 12:16:56.331303 24141 leader_election.cc:343] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.331192 24298 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.331101 24291 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.334280 24291 ts_tablet_manager.cc:1434] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:16:56.330020 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:56.335139 24098 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.335438 24291 tablet_bootstrap.cc:492] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:56.346136 24291 tablet_bootstrap.cc:654] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.350188 24321 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.350924 24321 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.356586 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:56.357538 24248 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:56.359107 24291 tablet_bootstrap.cc:492] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:56.359596 24321 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.359638 24291 ts_tablet_manager.cc:1403] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.007s
I20260709 12:16:56.360520 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:56.362273 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:56.363217 24294 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.363566 24291 raft_consensus.cc:359] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.364364 24291 raft_consensus.cc:385] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.364631 24291 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.365489 24291 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.373350 24291 ts_tablet_manager.cc:1434] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:16:56.374694 24291 tablet_bootstrap.cc:492] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:56.381978 24291 tablet_bootstrap.cc:654] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.382920 24294 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.394773 24291 tablet_bootstrap.cc:492] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:56.395367 24291 ts_tablet_manager.cc:1403] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.006s
I20260709 12:16:56.396298 24293 raft_consensus.cc:359] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.397059 24293 raft_consensus.cc:385] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.397331 24293 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.398758 24291 raft_consensus.cc:359] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.399693 24291 raft_consensus.cc:385] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.400032 24291 raft_consensus.cc:740] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.400954 24291 consensus_queue.cc:260] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.401927 24098 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:56.403237 24291 ts_tablet_manager.cc:1434] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:56.403390 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:56.404230 24291 tablet_bootstrap.cc:492] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:56.404597 24370 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.405124 24370 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:56.405988 24370 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.413090 24291 tablet_bootstrap.cc:654] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.415939 24175 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:56.418243 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:56.420081 24299 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.420754 24299 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:56.421957 24299 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.426525 24291 tablet_bootstrap.cc:492] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:56.427302 24291 ts_tablet_manager.cc:1403] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.023s	user 0.021s	sys 0.000s
I20260709 12:16:56.430946 24291 raft_consensus.cc:359] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.431875 24291 raft_consensus.cc:385] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.432214 24291 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.435981 24101 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.445880 24299 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.448820 24291 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.451453 24291 ts_tablet_manager.cc:1434] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.003s
I20260709 12:16:56.452533 24291 tablet_bootstrap.cc:492] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:56.461126 24291 tablet_bootstrap.cc:654] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.463683 24298 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.464356 24298 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.466388 24298 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.467499 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:56.468189 24097 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:56.469424 24140 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:16:56.470854 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:56.476045 24248 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:56.474723 24326 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.478830 24326 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.479611 24326 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.479651 24293 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.480157 24326 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.482652 24293 ts_tablet_manager.cc:1434] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.166s	user 0.006s	sys 0.000s
I20260709 12:16:56.485507 24293 tablet_bootstrap.cc:492] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:56.505918 23996 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.522859 24294 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.524317 24294 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.528587 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:56.529179 24294 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.531836 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:56.534898 24066 leader_election.cc:343] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:56.536293 24067 leader_election.cc:343] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.536911 24067 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:56.541997 24321 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.547676 24291 tablet_bootstrap.cc:492] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:56.548799 24291 ts_tablet_manager.cc:1403] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.096s	user 0.009s	sys 0.007s
I20260709 12:16:56.547521 24354 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.581044 23999 catalog_manager.cc:5697] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.613952 24321 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.619372 24321 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.626345 24290 tablet_bootstrap.cc:492] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:56.627562 24290 ts_tablet_manager.cc:1403] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.318s	user 0.075s	sys 0.070s
I20260709 12:16:56.628024 24249 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.617048 24326 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.632089 24293 tablet_bootstrap.cc:654] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.637383 24294 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:16:56.641408 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:56.642154 24249 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:56.643977 24066 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:56.645651 24317 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.645735 24290 raft_consensus.cc:359] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.646282 24317 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.646700 24290 raft_consensus.cc:385] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.646903 24317 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.624770 24321 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.647416 24290 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.658313 24250 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:16:56.661734 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:56.662600 24247 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.676244 24414 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.679744 24291 raft_consensus.cc:359] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.680941 24291 raft_consensus.cc:385] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.681551 24291 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.682637 24291 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.683995 24317 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.685266 24291 ts_tablet_manager.cc:1434] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.000s
I20260709 12:16:56.686420 24291 tablet_bootstrap.cc:492] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:56.674117 24326 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.693339 24293 tablet_bootstrap.cc:492] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:56.693930 24293 ts_tablet_manager.cc:1403] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.209s	user 0.015s	sys 0.011s
I20260709 12:16:56.694341 24317 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.696300 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:56.697016 24250 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.701511 24247 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:56.705426 24293 raft_consensus.cc:359] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.706236 24293 raft_consensus.cc:385] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.706588 24293 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.707360 24293 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.709003 24290 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.711412 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:56.712270 24290 ts_tablet_manager.cc:1434] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.084s	user 0.005s	sys 0.006s
I20260709 12:16:56.712565 24100 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.713030 24250 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:56.713536 24290 tablet_bootstrap.cc:492] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:56.714443 24066 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:56.715495 24317 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.716372 24317 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:56.717303 24317 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.720559 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:56.722077 24291 tablet_bootstrap.cc:654] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.723536 24293 ts_tablet_manager.cc:1434] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.002s
W20260709 12:16:56.770010 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:56.795089 24293 tablet_bootstrap.cc:492] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:56.798323 24354 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.798943 24354 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.800895 24293 tablet_bootstrap.cc:654] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.724690 24413 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.802829 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:56.803105 24354 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:56.803632 24096 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:56.726325 24099 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:16:56.804596 24099 pending_rounds.cc:85] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 0
I20260709 12:16:56.805009 24099 pending_rounds.cc:107] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:16:56.805151 24214 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:56.817253 24354 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.766166 24414 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
I20260709 12:16:56.817652 24354 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.818135 24354 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.806502 24413 raft_consensus.cc:697] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:56.808264 24293 tablet_bootstrap.cc:492] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:56.820060 24293 ts_tablet_manager.cc:1403] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260709 12:16:56.822255 24351 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:56.823477 24293 raft_consensus.cc:359] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.824290 24293 raft_consensus.cc:385] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.824594 24293 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.825410 24293 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.731688 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:56.739833 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:56.827777 24413 consensus_queue.cc:237] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.814182 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:56.762061 24418 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.830442 24354 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.830703 24418 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.831553 24293 ts_tablet_manager.cc:1434] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260709 12:16:56.832732 24293 tablet_bootstrap.cc:492] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:56.833386 24418 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.834893 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:56.835108 24099 raft_consensus.cc:2889] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:16:56.835811 24248 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:16:56.836120 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:56.836416 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:56.837036 24101 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.840956 24291 tablet_bootstrap.cc:492] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:56.841454 24291 ts_tablet_manager.cc:1403] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.002s
I20260709 12:16:56.843324 24293 tablet_bootstrap.cc:654] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.843087 24140 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:56.844214 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:56.846345 24291 raft_consensus.cc:359] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.847115 24291 raft_consensus.cc:385] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.847388 24291 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.848398 24370 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.850001 24291 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.850365 24370 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.851079 24354 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:56.853703 24101 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:56.855265 24214 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:56.856573 24354 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:56.857173 24354 raft_consensus.cc:697] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:56.858148 24354 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.858837 24370 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.815169 24290 tablet_bootstrap.cc:654] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.726763 24298 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.816018 24176 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:16:56.863859 24298 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.866914 24298 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:56.778280 24100 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:56.869192 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:56.869407 24174 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:56.870087 24096 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:56.871170 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:56.863844 24175 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:56.873571 24291 ts_tablet_manager.cc:1434] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.008s
I20260709 12:16:56.874902 24291 tablet_bootstrap.cc:492] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:56.877507 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:56.883272 24418 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.862630 23995 catalog_manager.cc:5697] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.890297 23996 catalog_manager.cc:5697] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:56.900214 24291 tablet_bootstrap.cc:654] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:56.891690 24176 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:16:56.904263 24294 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:16:56.914009 24418 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:56.915431 24351 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:56.929581 24293 tablet_bootstrap.cc:492] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:56.930310 24293 ts_tablet_manager.cc:1403] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.098s	user 0.031s	sys 0.028s
I20260709 12:16:56.930902 24418 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:16:56.943753 24290 tablet_bootstrap.cc:492] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:56.944303 24290 ts_tablet_manager.cc:1403] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.231s	user 0.016s	sys 0.010s
I20260709 12:16:56.955984 24293 raft_consensus.cc:359] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.957046 24293 raft_consensus.cc:385] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.957413 24293 raft_consensus.cc:740] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.959390 24290 raft_consensus.cc:359] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.960290 24290 raft_consensus.cc:385] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:56.960681 24290 raft_consensus.cc:740] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:56.961675 24290 consensus_queue.cc:260] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.964145 24290 ts_tablet_manager.cc:1434] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:16:56.964393 24354 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.959321 23995 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:56.965323 24354 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.974495 24290 tablet_bootstrap.cc:492] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:56.975363 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:56.976127 24101 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:56.977612 24214 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:56.979009 24372 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:56.979487 24372 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:56.979887 24372 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.982563 24293 consensus_queue.cc:260] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.985109 24293 ts_tablet_manager.cc:1434] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.000s
I20260709 12:16:56.985989 24293 tablet_bootstrap.cc:492] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:56.987735 24354 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:56.987089 24372 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:56.989239 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:16:56.991004 24216 leader_election.cc:343] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.990823 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:56.991735 24101 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:56.993130 24372 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:56.994261 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:16:56.996800 24216 leader_election.cc:343] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:56.994246 24372 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:56.997516 24372 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.000622 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.001260 24098 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.002878 24214 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.003786 24354 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.004537 24354 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.004926 24354 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.005347 24291 tablet_bootstrap.cc:492] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.005869 24291 ts_tablet_manager.cc:1403] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.131s	user 0.022s	sys 0.026s
I20260709 12:16:57.008929 24291 raft_consensus.cc:359] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.017576 24291 raft_consensus.cc:385] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.017784 24291 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.018450 24291 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.019018 24248 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.020754 24291 ts_tablet_manager.cc:1434] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:16:57.012579 24354 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.019151 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.022240 24176 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.024097 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:57.024575 24291 tablet_bootstrap.cc:492] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.024761 24096 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.012598 24101 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:57.011051 24293 tablet_bootstrap.cc:654] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.013185 24372 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.028749 24214 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:16:57.029799 24372 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.030391 24372 raft_consensus.cc:697] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:57.031350 24354 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.031405 24372 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.034149 24418 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.036950 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:57.037201 24291 tablet_bootstrap.cc:654] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.037609 24176 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.007369 24290 tablet_bootstrap.cc:654] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.052155 24176 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:57.053519 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.059514 24354 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.061533 24354 raft_consensus.cc:697] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:57.062858 24354 consensus_queue.cc:237] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.072922 24317 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.077877 24317 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.081786 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.083213 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:57.083436 24067 leader_election.cc:343] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.084381 24317 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:16:57.084903 24066 leader_election.cc:343] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.085505 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:57.075989 24096 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:57.086711 24317 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.087896 24291 tablet_bootstrap.cc:492] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.088634 24291 ts_tablet_manager.cc:1403] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.064s	user 0.016s	sys 0.001s
I20260709 12:16:57.089200 23996 catalog_manager.cc:5697] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.094028 24293 tablet_bootstrap.cc:492] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:57.094506 24293 ts_tablet_manager.cc:1403] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.109s	user 0.011s	sys 0.005s
I20260709 12:16:57.095373 24294 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.095894 24294 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.098074 24294 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.098809 24291 raft_consensus.cc:359] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.099520 24291 raft_consensus.cc:385] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.099794 24291 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.100067 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:57.100502 24291 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.097774 24293 raft_consensus.cc:359] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.101642 24293 raft_consensus.cc:385] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.101914 24293 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.102584 24293 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.103803 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:16:57.104446 24066 leader_election.cc:343] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:57.105194 24067 leader_election.cc:343] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.105645 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:57.116279 24344 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.118391 24293 ts_tablet_manager.cc:1434] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.004s
I20260709 12:16:57.118948 24291 ts_tablet_manager.cc:1434] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:16:57.119720 24293 tablet_bootstrap.cc:492] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:57.119992 24291 tablet_bootstrap.cc:492] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.120362 23997 catalog_manager.cc:5697] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.129035 24291 tablet_bootstrap.cc:654] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.129035 24293 tablet_bootstrap.cc:654] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.139544 24354 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.140321 24354 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.141607 24294 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.142174 24294 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.142930 24354 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.144285 24291 tablet_bootstrap.cc:492] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.144248 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.144608 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.145090 24291 ts_tablet_manager.cc:1403] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.003s
I20260709 12:16:57.145304 24096 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.145977 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.146659 24214 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.147250 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:57.147637 24354 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:16:57.147292 24067 leader_election.cc:343] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.148042 24354 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:16:57.148217 24216 leader_election.cc:343] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.144328 24294 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.148435 24354 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.148444 24291 raft_consensus.cc:359] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.149299 24291 raft_consensus.cc:385] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.149597 24291 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.150310 24291 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.152575 24291 ts_tablet_manager.cc:1434] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:57.153578 24291 tablet_bootstrap.cc:492] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.153664 24290 tablet_bootstrap.cc:492] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:57.154330 24290 ts_tablet_manager.cc:1403] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.183s	user 0.047s	sys 0.013s
I20260709 12:16:57.157195 24290 raft_consensus.cc:359] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.158002 24290 raft_consensus.cc:385] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.158334 24290 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.159214 24290 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.158388 24354 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.161227 24248 raft_consensus.cc:2393] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:57.163134 24066 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:57.164499 24294 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.165372 24291 tablet_bootstrap.cc:654] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.167999 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:57.171371 24293 tablet_bootstrap.cc:492] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:57.172042 24293 ts_tablet_manager.cc:1403] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.005s
I20260709 12:16:57.174301 24294 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.176120 24293 raft_consensus.cc:359] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.177068 24293 raft_consensus.cc:385] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.182561 24293 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.181074 24290 ts_tablet_manager.cc:1434] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.026s	user 0.000s	sys 0.005s
I20260709 12:16:57.182019 24354 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.183199 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:57.183981 24290 tablet_bootstrap.cc:492] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
W20260709 12:16:57.184815 24216 leader_election.cc:343] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.189735 24293 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.196405 24418 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.195617 24317 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:16:57.206023 24418 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.209112 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.209942 24101 raft_consensus.cc:2393] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:57.194051 24290 tablet_bootstrap.cc:654] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.214426 24418 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.189972 24096 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:57.214586 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:57.216480 24214 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:16:57.216902 24141 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:57.218179 24418 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.218137 24354 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.219064 24354 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:57.219969 24354 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.221302 24291 tablet_bootstrap.cc:492] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.221774 24291 ts_tablet_manager.cc:1403] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.068s	user 0.026s	sys 0.022s
I20260709 12:16:57.224730 24291 raft_consensus.cc:359] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.225404 24291 raft_consensus.cc:385] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.225670 24291 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.226406 24291 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.247012 24413 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:57.250730 24372 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.253736 24293 ts_tablet_manager.cc:1434] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.081s	user 0.012s	sys 0.006s
I20260709 12:16:57.254928 24293 tablet_bootstrap.cc:492] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:57.244016 24418 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.258553 24317 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.277269 24290 tablet_bootstrap.cc:492] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:57.277030 24351 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.278044 24290 ts_tablet_manager.cc:1403] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.007s
I20260709 12:16:57.297833 24418 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.308272 24447 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.308879 24447 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.312445 24447 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.312645 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:57.312589 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:16:57.314468 24066 leader_election.cc:343] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:57.315126 24067 leader_election.cc:343] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.315599 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:57.330677 24290 raft_consensus.cc:359] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.332052 24290 raft_consensus.cc:385] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.331903 24447 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.333810 24290 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.335022 24290 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.347826 24293 tablet_bootstrap.cc:654] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.347396 23995 catalog_manager.cc:5697] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.348994 24291 ts_tablet_manager.cc:1434] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.127s	user 0.063s	sys 0.033s
I20260709 12:16:57.350068 24291 tablet_bootstrap.cc:492] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.353586 24290 ts_tablet_manager.cc:1434] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 12:16:57.355090 24290 tablet_bootstrap.cc:492] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:57.359576 24293 tablet_bootstrap.cc:492] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:57.360100 24293 ts_tablet_manager.cc:1403] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.006s
I20260709 12:16:57.362103 24290 tablet_bootstrap.cc:654] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.362116 24291 tablet_bootstrap.cc:654] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.363026 24293 raft_consensus.cc:359] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.363993 24293 raft_consensus.cc:385] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.364300 24293 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.365221 24293 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.368314 24293 ts_tablet_manager.cc:1434] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:16:57.369623 24293 tablet_bootstrap.cc:492] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:57.375890 24291 tablet_bootstrap.cc:492] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.376408 24291 ts_tablet_manager.cc:1403] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.027s	user 0.007s	sys 0.011s
I20260709 12:16:57.379117 24291 raft_consensus.cc:359] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.379804 24291 raft_consensus.cc:385] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.380061 24293 tablet_bootstrap.cc:654] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.380072 24291 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.381063 24291 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.382097 24290 tablet_bootstrap.cc:492] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:57.382617 24290 ts_tablet_manager.cc:1403] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.015s
I20260709 12:16:57.383912 24291 ts_tablet_manager.cc:1434] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:16:57.384917 24291 tablet_bootstrap.cc:492] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.392161 24291 tablet_bootstrap.cc:654] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.410703 24290 raft_consensus.cc:359] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.411836 24290 raft_consensus.cc:385] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.412209 24290 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.413196 24290 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.417750 24290 ts_tablet_manager.cc:1434] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.001s
I20260709 12:16:57.418068 24293 tablet_bootstrap.cc:492] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:57.418582 24293 ts_tablet_manager.cc:1403] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.049s	user 0.016s	sys 0.030s
I20260709 12:16:57.419060 24290 tablet_bootstrap.cc:492] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:57.419698 24354 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.420218 24354 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.422185 24293 raft_consensus.cc:359] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.422910 24293 raft_consensus.cc:385] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.423265 24293 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.424042 24293 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.424360 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.422451 24354 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.430603 24293 ts_tablet_manager.cc:1434] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.005s
I20260709 12:16:57.431111 24096 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.431890 24293 tablet_bootstrap.cc:492] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:57.434134 24291 tablet_bootstrap.cc:492] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.434733 24291 ts_tablet_manager.cc:1403] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.015s
I20260709 12:16:57.434154 24290 tablet_bootstrap.cc:654] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.438676 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.438876 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.439702 24175 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.440279 24354 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.440762 24354 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.441161 24354 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.451447 24354 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.454137 24354 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.454551 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:57.454774 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:57.455295 24096 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.455571 24176 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.458710 24293 tablet_bootstrap.cc:654] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.459323 24372 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.461740 24291 raft_consensus.cc:359] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.463940 24291 raft_consensus.cc:385] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.463975 24176 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:57.464439 24291 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.464473 24096 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:57.465354 24216 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.466645 24354 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.465515 24291 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.467240 24354 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:57.468220 24354 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.469228 24291 ts_tablet_manager.cc:1434] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.001s
I20260709 12:16:57.469028 24374 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.470312 24291 tablet_bootstrap.cc:492] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.479784 24290 tablet_bootstrap.cc:492] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:57.480540 24290 ts_tablet_manager.cc:1403] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.062s	user 0.009s	sys 0.003s
I20260709 12:16:57.483737 24291 tablet_bootstrap.cc:654] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.484174 24290 raft_consensus.cc:359] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.485208 24290 raft_consensus.cc:385] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.485576 24290 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.486567 24290 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.496662 24418 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.497345 24418 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.500464 24418 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.500977 24418 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.501523 24418 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.502625 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.503646 24096 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:57.504947 24418 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.505100 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:57.506042 24250 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:57.506851 24290 ts_tablet_manager.cc:1434] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:16:57.507933 24290 tablet_bootstrap.cc:492] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:57.508898 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:16:57.511870 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:57.515013 24418 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.514861 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.515457 24418 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.515838 24096 raft_consensus.cc:2393] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:57.515880 24418 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.517258 24140 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:57.518093 24413 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.523960 24418 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.527024 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:57.527614 24096 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.531701 24293 tablet_bootstrap.cc:492] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:57.532168 24293 ts_tablet_manager.cc:1403] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.101s	user 0.019s	sys 0.023s
I20260709 12:16:57.532733 24374 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.534010 24418 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.537894 24293 raft_consensus.cc:359] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.538614 24293 raft_consensus.cc:385] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.538887 24293 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.540344 24293 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.542518 24293 ts_tablet_manager.cc:1434] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:57.543556 24293 tablet_bootstrap.cc:492] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:57.537997 23996 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.543967 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:57.546378 24250 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.549536 24372 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.551522 24290 tablet_bootstrap.cc:654] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.554380 24448 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.554911 24448 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.559084 24448 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.558862 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:57.561285 24066 leader_election.cc:343] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.562402 24291 tablet_bootstrap.cc:492] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.562939 24291 ts_tablet_manager.cc:1403] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.093s	user 0.023s	sys 0.000s
I20260709 12:16:57.563264 24293 tablet_bootstrap.cc:654] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.566972 24291 raft_consensus.cc:359] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.569851 24291 raft_consensus.cc:385] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.570278 24291 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.571218 24291 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.573374 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.578823 24291 ts_tablet_manager.cc:1434] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:16:57.580247 24291 tablet_bootstrap.cc:492] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.525962 24413 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:57.588294 24067 leader_election.cc:343] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.588820 24067 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:57.589813 24250 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:57.591142 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.593009 24447 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.594058 24413 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.594854 24413 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:57.595697 24291 tablet_bootstrap.cc:654] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.595865 24413 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.597373 24448 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.602217 24096 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:57.597879 24448 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.608793 24291 tablet_bootstrap.cc:492] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.609539 24291 ts_tablet_manager.cc:1403] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.030s	user 0.020s	sys 0.002s
I20260709 12:16:57.613107 24291 raft_consensus.cc:359] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.614842 24291 raft_consensus.cc:385] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.615286 24291 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.615190 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:57.616595 24291 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:57.617110 24066 leader_election.cc:343] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.618152 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.620645 24290 tablet_bootstrap.cc:492] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:57.621119 24290 ts_tablet_manager.cc:1403] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.113s	user 0.014s	sys 0.023s
I20260709 12:16:57.623059 24448 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.624178 24290 raft_consensus.cc:359] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:57.624867 24067 leader_election.cc:343] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.625000 24290 raft_consensus.cc:385] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.625439 24290 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.625425 24067 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:57.626416 24290 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.626789 24448 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.629961 24291 ts_tablet_manager.cc:1434] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:16:57.631027 24291 tablet_bootstrap.cc:492] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.631122 24293 tablet_bootstrap.cc:492] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:57.631610 24293 ts_tablet_manager.cc:1403] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.025s
I20260709 12:16:57.635239 23995 catalog_manager.cc:5697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:57.636713 24290 ts_tablet_manager.cc:1434] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:16:57.637766 24290 tablet_bootstrap.cc:492] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:57.639575 24291 tablet_bootstrap.cc:654] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.635303 24293 raft_consensus.cc:359] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.645924 24293 raft_consensus.cc:385] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.652340 24293 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.653182 24293 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.655725 24293 ts_tablet_manager.cc:1434] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:16:57.651491 24291 tablet_bootstrap.cc:492] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.656497 24291 ts_tablet_manager.cc:1403] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.011s
I20260709 12:16:57.656772 24293 tablet_bootstrap.cc:492] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:57.659420 24291 raft_consensus.cc:359] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.660234 24291 raft_consensus.cc:385] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.660555 24291 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.661406 24291 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.663858 24291 ts_tablet_manager.cc:1434] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:57.664961 24290 tablet_bootstrap.cc:654] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.664958 24291 tablet_bootstrap.cc:492] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.671557 24293 tablet_bootstrap.cc:654] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.672299 24291 tablet_bootstrap.cc:654] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.682916 24290 tablet_bootstrap.cc:492] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:57.683552 24290 ts_tablet_manager.cc:1403] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.007s
I20260709 12:16:57.687579 24293 tablet_bootstrap.cc:492] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:57.688284 24293 ts_tablet_manager.cc:1403] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.001s
I20260709 12:16:57.692124 24293 raft_consensus.cc:359] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.692519 24290 raft_consensus.cc:359] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.693127 24293 raft_consensus.cc:385] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.693598 24293 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.693240 24290 raft_consensus.cc:385] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.694418 24293 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.694782 24290 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.695734 24290 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.696688 24291 tablet_bootstrap.cc:492] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.697361 24291 ts_tablet_manager.cc:1403] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.033s	user 0.017s	sys 0.013s
I20260709 12:16:57.703292 24293 ts_tablet_manager.cc:1434] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:16:57.704340 24293 tablet_bootstrap.cc:492] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:57.705343 24290 ts_tablet_manager.cc:1434] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:16:57.706348 24290 tablet_bootstrap.cc:492] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:57.707926 24372 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.708427 24372 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.701467 24291 raft_consensus.cc:359] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.711560 24291 raft_consensus.cc:385] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.711830 24291 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.713707 24290 tablet_bootstrap.cc:654] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.715850 24291 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.717540 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.718190 24096 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.718703 24291 ts_tablet_manager.cc:1434] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:16:57.720688 24291 tablet_bootstrap.cc:492] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.720995 24214 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.724308 24351 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.724675 24351 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.725088 24351 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.727522 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.710711 24372 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.728492 24175 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.728699 24354 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.729220 24354 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.732432 24354 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.728699 24291 tablet_bootstrap.cc:654] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.734452 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.734521 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.735291 24096 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.736542 24214 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.738375 24374 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.740290 24374 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.740758 24374 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.741128 24374 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:57.744341 24216 leader_election.cc:343] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.744484 24445 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.745173 24445 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.747469 24445 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.750062 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:57.751729 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:16:57.752245 24066 leader_election.cc:343] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:57.752923 24067 leader_election.cc:343] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.753422 24067 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:57.754498 24445 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:57.754596 24351 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.762053 24291 tablet_bootstrap.cc:492] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.762601 24291 ts_tablet_manager.cc:1403] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.043s	user 0.006s	sys 0.010s
I20260709 12:16:57.763686 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:57.764341 24101 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.765863 24291 raft_consensus.cc:359] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.766571 24291 raft_consensus.cc:385] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.766832 24291 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.767761 24291 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.770251 24291 ts_tablet_manager.cc:1434] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:57.771247 24291 tablet_bootstrap.cc:492] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.774847 24101 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:57.776285 24214 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.777180 24372 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.777638 24372 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:57.778172 24291 tablet_bootstrap.cc:654] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.778515 24372 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.805943 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:57.806731 24174 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.814951 24174 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:57.831995 24293 tablet_bootstrap.cc:654] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.841869 23996 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:57.843720 24290 tablet_bootstrap.cc:492] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:57.844302 24290 ts_tablet_manager.cc:1403] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.138s	user 0.057s	sys 0.059s
I20260709 12:16:57.847517 24290 raft_consensus.cc:359] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.848284 24290 raft_consensus.cc:385] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.848578 24290 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.849444 24290 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.851713 24290 ts_tablet_manager.cc:1434] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:16:57.851878 24291 tablet_bootstrap.cc:492] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.852397 24291 ts_tablet_manager.cc:1403] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.081s	user 0.026s	sys 0.025s
I20260709 12:16:57.855474 24291 raft_consensus.cc:359] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.856177 24291 raft_consensus.cc:385] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.856630 24291 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
W20260709 12:16:57.858397 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:57.859472 24291 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.862438 24291 ts_tablet_manager.cc:1434] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:16:57.845031 24351 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.866631 24290 tablet_bootstrap.cc:492] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:57.868393 24372 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.800457 24374 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.866869 24351 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:57.863631 24291 tablet_bootstrap.cc:492] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:57.889902 24291 tablet_bootstrap.cc:654] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.869362 24372 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.933238 24372 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.930245 24374 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.935266 24290 tablet_bootstrap.cc:654] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:57.938265 24293 tablet_bootstrap.cc:492] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:57.938899 24293 ts_tablet_manager.cc:1403] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.235s	user 0.032s	sys 0.010s
I20260709 12:16:57.940253 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:57.941004 24096 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.942579 24293 raft_consensus.cc:359] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.943392 24293 raft_consensus.cc:385] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.943910 24293 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.944962 24293 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.946671 24293 ts_tablet_manager.cc:1434] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:16:57.947688 24293 tablet_bootstrap.cc:492] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:57.956056 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.956789 24100 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.957191 24483 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.957809 24445 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:57.957917 24483 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.957234 24291 tablet_bootstrap.cc:492] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:57.959571 24291 ts_tablet_manager.cc:1403] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.009s
I20260709 12:16:57.958421 24445 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.965390 24483 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:57.966039 24445 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:57.967384 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:57.968086 24248 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:57.969610 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.969858 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:57.955425 24096 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:57.970458 24176 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:57.975770 24291 raft_consensus.cc:359] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.976327 24291 raft_consensus.cc:385] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:57.976572 24291 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:57.970970 24447 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.977543 24447 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.977896 24447 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.974718 24214 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.984118 24482 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:57.984498 24482 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:57.984911 24482 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.984356 24214 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:57.987941 24291 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.991371 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:57.992250 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:57.993227 24176 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:57.994860 24482 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:57.996867 24483 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:57.997458 24483 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:57.999231 24374 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:57.999121 24483 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.000056 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:58.000695 24101 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.004004 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.004106 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.005466 24291 ts_tablet_manager.cc:1434] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 12:16:58.006327 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:58.006543 24291 tablet_bootstrap.cc:492] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:58.006918 24173 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.006948 24374 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:58.015602 24216 leader_election.cc:343] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.010044 24482 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:58.022432 24445 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.023633 24445 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:58.025709 24067 leader_election.cc:343] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.027323 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:58.030088 24290 tablet_bootstrap.cc:492] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:58.030731 24290 ts_tablet_manager.cc:1403] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.164s	user 0.008s	sys 0.025s
I20260709 12:16:58.031208 24293 tablet_bootstrap.cc:654] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:58.032480 24066 leader_election.cc:343] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:57.998049 24447 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.027325 24445 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.042876 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.044945 24096 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:16:58.052227 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:58.052603 24445 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.053118 24482 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.053195 24445 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.058525 24445 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.058719 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:58.059679 24176 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:58.059770 24248 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:58.063060 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:58.064023 24445 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.059705 24173 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
W20260709 12:16:58.064908 24067 leader_election.cc:343] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.064810 24445 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.059767 24101 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:58.067373 24067 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:58.072767 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.073016 24448 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.070196 24445 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.075430 24214 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:58.078047 24293 tablet_bootstrap.cc:492] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:58.078543 24293 ts_tablet_manager.cc:1403] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.131s	user 0.014s	sys 0.001s
I20260709 12:16:58.079276 24291 tablet_bootstrap.cc:654] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.085829 24482 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.086229 24293 raft_consensus.cc:359] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.086925 24293 raft_consensus.cc:385] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.087218 24293 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.088025 24293 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.089758 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:58.090353 24293 ts_tablet_manager.cc:1434] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
W20260709 12:16:58.091078 24067 leader_election.cc:343] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.091501 24293 tablet_bootstrap.cc:492] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:58.079914 24483 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.092900 24447 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.093469 24447 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.094117 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:58.094931 24290 raft_consensus.cc:359] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.105029 24290 raft_consensus.cc:385] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.105342 24290 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.105921 24293 tablet_bootstrap.cc:654] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.106074 24290 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.107051 24173 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:58.098610 24445 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.099558 24483 raft_consensus.cc:697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:58.101881 24248 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:58.093924 24447 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.113675 24290 ts_tablet_manager.cc:1434] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.002s
I20260709 12:16:58.114642 24290 tablet_bootstrap.cc:492] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:58.116416 24447 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.116513 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:16:58.109401 24483 consensus_queue.cc:237] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.119508 24447 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.163182 24291 tablet_bootstrap.cc:492] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:58.163378 24445 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.163822 24291 ts_tablet_manager.cc:1403] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.158s	user 0.032s	sys 0.022s
I20260709 12:16:58.168139 24293 tablet_bootstrap.cc:492] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:58.168857 24293 ts_tablet_manager.cc:1403] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.078s	user 0.008s	sys 0.012s
I20260709 12:16:58.170629 24290 tablet_bootstrap.cc:654] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.180858 24448 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.181471 24448 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.184201 24448 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.187077 24293 raft_consensus.cc:359] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.188519 24293 raft_consensus.cc:385] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.188881 24293 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.189638 24293 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.190668 24448 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.194082 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:58.192807 24291 raft_consensus.cc:359] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.194722 24291 raft_consensus.cc:385] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.195148 24291 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.196488 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.195513 24448 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.195355 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:58.193265 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:58.196661 24291 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.200445 24249 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:58.201136 24066 leader_election.cc:343] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.206460 24293 ts_tablet_manager.cc:1434] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 12:16:58.207476 24293 tablet_bootstrap.cc:492] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:58.208395 24291 ts_tablet_manager.cc:1434] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.000s
I20260709 12:16:58.209105 24291 tablet_bootstrap.cc:492] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:58.202194 24447 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:58.218382 24418 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.219653 24249 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:58.210613 24447 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.221148 24448 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.244544 24374 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.245326 24374 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:58.237730 24066 leader_election.cc:343] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.230177 24372 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:16:58.231343 24413 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:16:58.264038 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:58.252092 24374 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:58.395637 24290 tablet_bootstrap.cc:492] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:58.273926 23995 catalog_manager.cc:5697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.397161 24290 ts_tablet_manager.cc:1403] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.283s	user 0.023s	sys 0.026s
I20260709 12:16:58.398254 23995 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.291785 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:58.409112 24172 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.292062 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.318589 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:58.267263 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:58.284649 24447 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:16:58.357909 24067 leader_election.cc:343] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.286510 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.414587 24290 raft_consensus.cc:359] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.417547 24290 raft_consensus.cc:385] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.417874 24290 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.418638 24290 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.419613 24374 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.420887 24290 ts_tablet_manager.cc:1434] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:16:58.419610 24067 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:58.420611 24374 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.422626 24290 tablet_bootstrap.cc:492] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:58.424646 24293 tablet_bootstrap.cc:654] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.426651 24493 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:58.426743 24066 leader_election.cc:343] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.427731 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 71116.7us
I20260709 12:16:58.425702 24447 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:58.419327 24101 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:58.438328 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.440796 24290 tablet_bootstrap.cc:654] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.442073 24291 tablet_bootstrap.cc:654] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.444335 24374 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:16:58.444279 24216 leader_election.cc:343] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.445211 24067 leader_election.cc:343] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.445693 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:58.449048 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:58.453310 24172 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:58.454293 24496 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.437407 24447 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.460081 24096 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
W20260709 12:16:58.472229 24067 leader_election.cc:343] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.474112 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:58.476223 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.476876 24290 tablet_bootstrap.cc:492] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:58.477555 24290 ts_tablet_manager.cc:1403] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.055s	user 0.023s	sys 0.006s
I20260709 12:16:58.478434 24496 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.484345 24374 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.487507 24290 raft_consensus.cc:359] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.492417 24290 raft_consensus.cc:385] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.493899 24290 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.470252 24214 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:16:58.496987 24216 leader_election.cc:343] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.495886 24290 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.504189 24290 ts_tablet_manager.cc:1434] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.001s
I20260709 12:16:58.505884 24290 tablet_bootstrap.cc:492] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:58.510878 24374 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.511883 24374 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.512225 24374 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:58.518288 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 55554.8us
I20260709 12:16:58.524871 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:16:58.526697 24351 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.527161 24351 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.527498 24351 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.531908 24293 tablet_bootstrap.cc:492] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:58.532569 24293 ts_tablet_manager.cc:1403] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.325s	user 0.021s	sys 0.015s
I20260709 12:16:58.536217 24372 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.544087 24293 raft_consensus.cc:359] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.545177 24293 raft_consensus.cc:385] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.545799 24293 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.546651 24293 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.547292 24448 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.558195 24291 tablet_bootstrap.cc:492] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:58.558840 24291 ts_tablet_manager.cc:1403] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.350s	user 0.019s	sys 0.022s
I20260709 12:16:58.550763 24448 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.562357 24448 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.564065 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:58.566154 24293 ts_tablet_manager.cc:1434] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:16:58.565033 23997 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.567133 24293 tablet_bootstrap.cc:492] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:58.568166 23997 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:58.574120 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:16:58.577000 24066 leader_election.cc:343] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.579207 24067 leader_election.cc:343] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.580114 24351 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.588788 24351 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:58.591465 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:16:58.594259 24216 leader_election.cc:343] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.594406 24290 tablet_bootstrap.cc:654] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.594794 24067 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:58.596313 24447 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.600092 24498 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.600643 24498 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.601667 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:58.602296 24099 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.602331 24291 raft_consensus.cc:359] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.603193 24291 raft_consensus.cc:385] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.603902 24291 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.605412 24291 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.608157 24291 ts_tablet_manager.cc:1434] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:16:58.609208 24291 tablet_bootstrap.cc:492] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:58.581497 24374 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.602948 24498 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.624380 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:58.627676 24482 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.628584 24372 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.628391 24482 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.629779 24354 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.634800 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:58.635895 24095 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:58.644335 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:58.627103 24374 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:16:58.647294 24141 leader_election.cc:343] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.648088 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:58.650602 24483 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.655323 24483 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.655781 24483 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.656103 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:58.656843 24100 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.630944 24482 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:58.659901 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:58.661545 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.678501 24448 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:58.685004 24099 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:58.687207 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:16:58.688651 24482 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.696748 24482 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:58.698853 24482 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.703346 24100 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:58.707878 24214 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:16:58.720153 24216 leader_election.cc:343] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.735602 24140 leader_election.cc:343] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.736173 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:16:58.736639 24514 log.cc:927] Time spent T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.081s	user 0.005s	sys 0.000s
W20260709 12:16:58.737340 24216 leader_election.cc:343] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.738276 24374 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.739073 24374 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:58.740008 24374 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.745783 24290 tablet_bootstrap.cc:492] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:58.746366 24290 ts_tablet_manager.cc:1403] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.241s	user 0.025s	sys 0.016s
I20260709 12:16:58.749107 24291 tablet_bootstrap.cc:654] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.755518 24483 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.758374 24498 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.759939 24290 raft_consensus.cc:359] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.761011 24290 raft_consensus.cc:385] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.761313 24290 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.752996 24293 tablet_bootstrap.cc:654] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.762089 24290 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.761960 23996 catalog_manager.cc:5697] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.763975 24290 ts_tablet_manager.cc:1434] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 12:16:58.763489 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:58.765219 24290 tablet_bootstrap.cc:492] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:58.767573 24101 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.770306 24483 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:58.773241 24290 tablet_bootstrap.cc:654] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.778731 24293 tablet_bootstrap.cc:492] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:58.779510 24293 ts_tablet_manager.cc:1403] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.213s	user 0.014s	sys 0.004s
I20260709 12:16:58.785980 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:58.786425 24293 raft_consensus.cc:359] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.787452 24293 raft_consensus.cc:385] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.787787 24293 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.788724 24293 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.790477 24293 ts_tablet_manager.cc:1434] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:16:58.791558 24293 tablet_bootstrap.cc:492] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:58.796833 24291 tablet_bootstrap.cc:492] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:58.796720 24374 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:58.797557 24291 ts_tablet_manager.cc:1403] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.189s	user 0.010s	sys 0.011s
I20260709 12:16:58.801667 24101 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:58.801441 24291 raft_consensus.cc:359] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.802244 24291 raft_consensus.cc:385] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.802569 24291 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.803373 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:58.805055 24480 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:58.805642 24480 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:58.806668 24480 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:58.808707 24216 leader_election.cc:343] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:58.810421 24067 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:58.810169 24290 tablet_bootstrap.cc:492] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:58.811890 24290 ts_tablet_manager.cc:1403] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.047s	user 0.007s	sys 0.009s
I20260709 12:16:58.815487 24290 raft_consensus.cc:359] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.816248 24290 raft_consensus.cc:385] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.816543 24290 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.817389 24290 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.819463 24291 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.822033 24291 ts_tablet_manager.cc:1434] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:16:58.823118 24291 tablet_bootstrap.cc:492] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:58.824750 24293 tablet_bootstrap.cc:654] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.825557 24290 ts_tablet_manager.cc:1434] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:16:58.827351 24290 tablet_bootstrap.cc:492] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:58.834142 24291 tablet_bootstrap.cc:654] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.837512 24290 tablet_bootstrap.cc:654] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.839289 23996 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.844901 24293 tablet_bootstrap.cc:492] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:58.845451 24293 ts_tablet_manager.cc:1403] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.000s
I20260709 12:16:58.846956 24291 tablet_bootstrap.cc:492] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:58.847523 24291 ts_tablet_manager.cc:1403] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.000s
I20260709 12:16:58.848393 24293 raft_consensus.cc:359] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.849109 24293 raft_consensus.cc:385] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.849378 24293 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.850028 24293 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.851265 24291 raft_consensus.cc:359] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.852046 24291 raft_consensus.cc:385] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.852289 24293 ts_tablet_manager.cc:1434] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:16:58.852355 24291 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.853412 24293 tablet_bootstrap.cc:492] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:58.853168 24291 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.855515 24291 ts_tablet_manager.cc:1434] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:16:58.856472 24291 tablet_bootstrap.cc:492] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:58.857213 24290 tablet_bootstrap.cc:492] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:58.857762 24290 ts_tablet_manager.cc:1403] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.031s	user 0.005s	sys 0.008s
I20260709 12:16:58.861737 24290 raft_consensus.cc:359] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.862591 24290 raft_consensus.cc:385] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.862902 24290 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.865217 24291 tablet_bootstrap.cc:654] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.867617 24293 tablet_bootstrap.cc:654] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.863622 24290 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.871699 24501 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.872203 24501 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.873915 24290 ts_tablet_manager.cc:1434] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:16:58.874929 24290 tablet_bootstrap.cc:492] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:58.877202 24293 tablet_bootstrap.cc:492] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:58.877717 24293 ts_tablet_manager.cc:1403] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.002s
I20260709 12:16:58.879114 24291 tablet_bootstrap.cc:492] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:58.880214 24291 ts_tablet_manager.cc:1403] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.003s
I20260709 12:16:58.881532 24290 tablet_bootstrap.cc:654] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.883179 24291 raft_consensus.cc:359] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.883877 24291 raft_consensus.cc:385] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.884135 24291 raft_consensus.cc:740] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.884835 24291 consensus_queue.cc:260] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.887655 24291 ts_tablet_manager.cc:1434] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:16:58.888736 24291 tablet_bootstrap.cc:492] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:58.890652 24496 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.891374 24496 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.894630 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:58.896173 24291 tablet_bootstrap.cc:654] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.896512 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:58.897877 24101 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:58.898484 24496 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.899698 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:58.896992 24501 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:58.899822 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:58.902133 24066 leader_election.cc:343] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.902236 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:58.904063 24293 raft_consensus.cc:359] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.904814 24293 raft_consensus.cc:385] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:16:58.904399 24067 leader_election.cc:343] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.905107 24293 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.905268 24370 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.905364 24067 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:58.906510 24496 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.917315 24293 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.921100 23997 catalog_manager.cc:5697] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:58.922498 24501 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:58.923133 24293 ts_tablet_manager.cc:1434] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.000s
I20260709 12:16:58.930238 24291 tablet_bootstrap.cc:492] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:58.931041 24290 tablet_bootstrap.cc:492] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:58.935182 24291 ts_tablet_manager.cc:1403] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.004s
I20260709 12:16:58.935206 24293 tablet_bootstrap.cc:492] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:58.934435 24501 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.926574 24370 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:58.939977 24290 ts_tablet_manager.cc:1403] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.065s	user 0.043s	sys 0.010s
I20260709 12:16:58.939354 24291 raft_consensus.cc:359] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.940433 24291 raft_consensus.cc:385] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.940122 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:58.940857 24291 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.941118 24101 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:58.941645 24291 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.942754 24140 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:16:58.943979 24370 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:58.944402 24370 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:58.944603 24290 raft_consensus.cc:359] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.945798 24290 raft_consensus.cc:385] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:58.946354 24290 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:58.946764 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:58.947645 24290 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:58.950763 24290 ts_tablet_manager.cc:1434] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:16:58.951538 24370 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:58.952171 24290 tablet_bootstrap.cc:492] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:58.961113 24501 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:16:58.968350 24141 leader_election.cc:343] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:58.970468 24291 ts_tablet_manager.cc:1434] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.001s
I20260709 12:16:58.971719 24291 tablet_bootstrap.cc:492] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:58.978574 24290 tablet_bootstrap.cc:654] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.979740 24293 tablet_bootstrap.cc:654] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:58.999379 24291 tablet_bootstrap.cc:654] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.001683 24370 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.002698 24496 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.014163 24496 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.014753 24496 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.020452 24496 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.020884 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:59.020509 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.022603 24176 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:16:59.023597 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:59.023823 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:16:59.024290 24101 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.025400 24447 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:59.025805 24447 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.026170 24447 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.031329 24448 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:59.035941 24066 leader_election.cc:343] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:59.035980 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:16:59.042450 24447 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.047468 24370 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.047886 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:59.050856 24172 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.048748 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:16:59.049767 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:16:59.064462 24066 leader_election.cc:343] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:59.065943 24141 leader_election.cc:343] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.049926 24447 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.045188 24290 tablet_bootstrap.cc:492] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:59.068105 24290 ts_tablet_manager.cc:1403] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.008s
I20260709 12:16:59.071306 24290 raft_consensus.cc:359] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.072163 24290 raft_consensus.cc:385] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.072494 24290 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.072510 24172 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:16:59.073635 24447 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.073722 24290 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.074349 24447 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.075547 24480 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.076202 24290 ts_tablet_manager.cc:1434] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:16:59.076076 24480 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.077412 24290 tablet_bootstrap.cc:492] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:59.078688 24483 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.079211 24483 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.080440 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:59.081532 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.081701 24483 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:16:59.082062 24066 leader_election.cc:343] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.082230 24100 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:59.084831 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.084733 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.085840 24174 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:59.085922 24099 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:59.089161 24480 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:59.092372 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:59.093204 24374 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:59.093816 24374 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.094244 24374 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.093216 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.092778 24447 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.105708 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:16:59.107636 24067 leader_election.cc:343] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.108263 24067 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.111383 24101 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:59.108338 24498 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.109692 24496 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.112733 24374 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.113216 24498 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.115796 24374 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:59.116055 24501 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.116134 24498 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.116602 24501 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.109400 24447 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:59.117635 24447 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:16:59.119256 24290 tablet_bootstrap.cc:654] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.120385 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:59.127987 24291 tablet_bootstrap.cc:492] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:59.118619 24447 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.128584 24291 ts_tablet_manager.cc:1403] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.002s
I20260709 12:16:59.129823 24501 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.132495 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:59.129441 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.154485 24214 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:59.199357 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:59.200397 24094 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.206050 24140 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.214411 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:59.215181 24174 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.215535 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.216446 24101 raft_consensus.cc:2393] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:59.216190 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.220319 24498 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:59.222028 24498 raft_consensus.cc:697] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:59.224489 24291 raft_consensus.cc:359] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.225167 24174 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:59.220876 24480 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:16:59.239508 24216 leader_election.cc:343] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.225945 24374 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:59.226722 24291 raft_consensus.cc:385] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.227658 24140 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.230651 24293 tablet_bootstrap.cc:492] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:59.244387 24291 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.244894 24293 ts_tablet_manager.cc:1403] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.310s	user 0.029s	sys 0.016s
I20260709 12:16:59.226383 24498 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.245236 24291 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.243726 24374 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.251876 24374 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.254281 24483 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.248198 24354 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.255596 24354 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.257441 24291 ts_tablet_manager.cc:1434] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.128s	user 0.007s	sys 0.008s
I20260709 12:16:59.258752 24291 tablet_bootstrap.cc:492] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:59.259544 24354 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:59.243095 23999 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.255622 24293 raft_consensus.cc:359] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.265174 24293 raft_consensus.cc:385] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.265547 24293 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.266822 24290 tablet_bootstrap.cc:492] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:59.267391 24290 ts_tablet_manager.cc:1403] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.190s	user 0.012s	sys 0.007s
I20260709 12:16:59.268494 24291 tablet_bootstrap.cc:654] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.270517 24290 raft_consensus.cc:359] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.271654 24290 raft_consensus.cc:385] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.271991 24290 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.266338 24293 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.275750 24501 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.283089 24374 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.286350 24374 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:16:59.287401 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59821.4us
I20260709 12:16:59.288393 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:59.289299 24374 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:59.289790 24374 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:59.290726 24374 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.295068 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.295912 24097 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:16:59.297850 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:59.298197 24482 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.298534 24100 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.274330 24293 ts_tablet_manager.cc:1434] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:16:59.298794 24482 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.300524 24293 tablet_bootstrap.cc:492] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:59.301330 24482 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:59.290526 24290 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.306284 24482 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.307329 24100 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:59.311801 24370 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.312361 24370 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.313118 24176 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.314859 24370 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.316383 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:59.318619 24094 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:59.320894 24290 ts_tablet_manager.cc:1434] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:16:59.321882 24290 tablet_bootstrap.cc:492] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:59.328210 24501 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.337668 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.339735 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:59.343070 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.343155 24214 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:59.345013 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.345391 24351 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:59.345861 24351 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.346238 24351 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.353787 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.354053 24482 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.354754 24094 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:59.361553 24214 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:16:59.362625 24447 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.363620 24482 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:59.363268 24447 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.364687 24482 raft_consensus.cc:697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:59.365823 24482 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.366500 24370 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:59.367511 24216 leader_election.cc:343] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.368515 24293 tablet_bootstrap.cc:654] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:59.368749 24216 leader_election.cc:343] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.338213 23999 catalog_manager.cc:5697] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:16:59.372735 24447 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.373585 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.374303 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:59.358650 24351 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:59.376125 24066 leader_election.cc:343] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.378204 24174 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.386454 24094 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:16:59.389359 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.392084 24351 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:59.391916 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.398826 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:16:59.392794 24291 tablet_bootstrap.cc:492] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
W20260709 12:16:59.400071 24067 leader_election.cc:343] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.400092 24291 ts_tablet_manager.cc:1403] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.142s	user 0.030s	sys 0.023s
I20260709 12:16:59.400697 24067 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:16:59.405036 24216 leader_election.cc:343] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.405004 24447 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.412461 24290 tablet_bootstrap.cc:654] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.413594 24291 raft_consensus.cc:359] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.414537 24291 raft_consensus.cc:385] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.414893 24291 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.415737 24291 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.465657 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:59.468508 24096 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.480010 24291 ts_tablet_manager.cc:1434] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.079s	user 0.012s	sys 0.000s
I20260709 12:16:59.483214 24291 tablet_bootstrap.cc:492] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:59.485704 24214 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:59.501755 24447 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.502712 24447 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.513198 24447 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.516254 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:59.518627 24066 leader_election.cc:343] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.521369 24293 tablet_bootstrap.cc:492] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:59.525933 24354 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.522691 24293 ts_tablet_manager.cc:1403] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.222s	user 0.016s	sys 0.009s
I20260709 12:16:59.543706 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.553434 23995 catalog_manager.cc:5697] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.555115 24291 tablet_bootstrap.cc:654] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:59.558521 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 73254.8us
I20260709 12:16:59.566623 24290 tablet_bootstrap.cc:492] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:59.566767 24498 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.567468 24290 ts_tablet_manager.cc:1403] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.246s	user 0.016s	sys 0.011s
I20260709 12:16:59.575736 24447 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.576555 24447 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.579944 24447 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.581547 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:59.583405 24354 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:16:59.584295 24066 leader_election.cc:343] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:16:59.584517 24067 leader_election.cc:343] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.585033 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.588105 24351 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.589227 24496 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.591144 24096 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:16:59.592139 24293 raft_consensus.cc:359] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.592978 24293 raft_consensus.cc:385] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.593330 24293 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.594172 24293 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.605875 24550 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.614249 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.617311 24290 raft_consensus.cc:359] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.618216 24290 raft_consensus.cc:385] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.618589 24290 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.619109 24214 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:16:59.620363 24482 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:59.620882 24482 raft_consensus.cc:697] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:16:59.622064 24482 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.625365 24293 ts_tablet_manager.cc:1434] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.087s	user 0.004s	sys 0.003s
I20260709 12:16:59.629678 24291 tablet_bootstrap.cc:492] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:59.630227 24291 ts_tablet_manager.cc:1403] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.148s	user 0.013s	sys 0.003s
I20260709 12:16:59.626904 24293 tablet_bootstrap.cc:492] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:59.644264 24290 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.647603 24291 raft_consensus.cc:359] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.648609 24291 raft_consensus.cc:385] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.648943 24291 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.649819 24291 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.655522 24291 ts_tablet_manager.cc:1434] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.004s
I20260709 12:16:59.659464 24554 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.653828 24290 ts_tablet_manager.cc:1434] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.086s	user 0.009s	sys 0.000s
I20260709 12:16:59.660046 24554 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.661101 24291 tablet_bootstrap.cc:492] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:16:59.662581 24290 tablet_bootstrap.cc:492] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:16:59.663079 24554 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.663915 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:16:59.665432 24066 leader_election.cc:343] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.666672 24293 tablet_bootstrap.cc:654] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:59.669844 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 83077.7us
I20260709 12:16:59.684244 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.686445 24496 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.687160 24370 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.687691 24370 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:59.688367 24067 leader_election.cc:343] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.688871 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.689668 24496 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.690928 24370 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:16:59.691752 24067 leader_election.cc:343] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.692245 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.694157 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.695071 24097 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:16:59.695458 24550 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.695485 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:59.696094 24550 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:16:59.700587 24141 leader_election.cc:343] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.696853 24447 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.715406 24249 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.726397 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.766132 23995 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.776006 24413 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.779482 24550 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:16:59.766764 24498 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:16:59.782617 24498 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:16:59.783176 24498 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.782859 23995 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:16:59.788960 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:16:59.799868 24413 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.801954 24413 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.806591 24552 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:16:59.812309 24413 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.817698 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.818746 24099 raft_consensus.cc:2393] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:16:59.819340 24290 tablet_bootstrap.cc:654] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
W20260709 12:16:59.849556 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49351.7us
I20260709 12:16:59.852684 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:16:59.851301 24498 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.848412 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:16:59.857504 24498 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:16:59.859349 24370 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.860390 24291 tablet_bootstrap.cc:654] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:16:59.861296 24141 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.864372 24370 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:16:59.865331 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:16:59.866011 24094 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:16:59.871291 24216 consensus_peers.cc:597] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:16:59.873513 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:16:59.874955 24480 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.876912 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:16:59.889744 24141 leader_election.cc:343] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:16:59.895839 24480 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:16:59.898491 24293 tablet_bootstrap.cc:492] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:16:59.904042 24293 ts_tablet_manager.cc:1403] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.277s	user 0.026s	sys 0.008s
I20260709 12:16:59.907616 24293 raft_consensus.cc:359] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.908504 24293 raft_consensus.cc:385] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.911334 24480 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:16:59.919772 24094 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:16:59.924425 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:16:59.908812 24293 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.929406 24550 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:16:59.941326 24291 tablet_bootstrap.cc:492] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:16:59.942517 24291 ts_tablet_manager.cc:1403] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.282s	user 0.016s	sys 0.015s
I20260709 12:16:59.948581 24293 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.952570 24370 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:16:59.952644 24293 ts_tablet_manager.cc:1434] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260709 12:16:59.950791 24291 raft_consensus.cc:359] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.953464 24291 raft_consensus.cc:385] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:16:59.953760 24291 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:16:59.954667 24293 tablet_bootstrap.cc:492] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:16:59.954458 24291 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.957811 24560 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:16:59.958278 24550 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:16:59.958408 24560 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:16:59.958825 24550 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.973846 24291 ts_tablet_manager.cc:1434] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.004s
I20260709 12:16:59.959487 24560 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:16:59.988023 24290 tablet_bootstrap.cc:492] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:16:59.988631 24290 ts_tablet_manager.cc:1403] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.326s	user 0.019s	sys 0.031s
I20260709 12:16:59.992108 24550 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:00.001459 24291 tablet_bootstrap.cc:492] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:00.011484 24290 raft_consensus.cc:359] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.012023 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.012387 24290 raft_consensus.cc:385] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.012691 24290 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.012885 24098 raft_consensus.cc:2393] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:00.017113 24290 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.013749 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.021097 24290 ts_tablet_manager.cc:1434] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:17:00.022727 24290 tablet_bootstrap.cc:492] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.035997 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:00.064007 24370 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.066308 24370 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.057906 24354 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.087884 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.088723 24096 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:00.102360 24293 tablet_bootstrap.cc:654] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.120352 24291 tablet_bootstrap.cc:654] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.126453 23997 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:00.129768 24354 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.129923 24290 tablet_bootstrap.cc:654] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.137909 24370 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.146209 24374 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:00.144484 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:00.159058 24498 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.159529 24498 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.159891 24498 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.175015 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:00.179000 24293 tablet_bootstrap.cc:492] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:00.180747 24293 ts_tablet_manager.cc:1403] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.226s	user 0.023s	sys 0.006s
I20260709 12:17:00.184578 24293 raft_consensus.cc:359] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.186555 24293 raft_consensus.cc:385] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.185775 24290 tablet_bootstrap.cc:492] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.187541 24290 ts_tablet_manager.cc:1403] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.165s	user 0.010s	sys 0.017s
I20260709 12:17:00.186841 24293 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.188671 24293 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.190375 24293 ts_tablet_manager.cc:1434] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:17:00.191510 24293 tablet_bootstrap.cc:492] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:00.197474 24290 raft_consensus.cc:359] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.198266 24290 raft_consensus.cc:385] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.198552 24290 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.199366 24290 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:00.205282 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:00.206606 24290 ts_tablet_manager.cc:1434] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.004s
I20260709 12:17:00.207886 24290 tablet_bootstrap.cc:492] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.214805 24290 tablet_bootstrap.cc:654] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.227644 24498 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:00.235800 24141 leader_election.cc:343] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.236248 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:00.237179 24096 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.242149 24480 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.242741 24480 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.245002 24480 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:00.250900 24290 tablet_bootstrap.cc:492] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.251565 24290 ts_tablet_manager.cc:1403] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.044s	user 0.028s	sys 0.012s
I20260709 12:17:00.250902 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.252821 24094 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:17:00.254601 24214 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:00.254853 24290 raft_consensus.cc:359] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.255434 24482 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.255671 24290 raft_consensus.cc:385] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.256037 24482 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.256629 24482 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.256040 24290 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.258538 24290 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.259073 24354 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.261472 24290 ts_tablet_manager.cc:1434] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:00.263352 24290 tablet_bootstrap.cc:492] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.265012 24482 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.267431 24482 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:00.268384 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:00.269058 24094 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.270452 24290 tablet_bootstrap.cc:654] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.276878 24290 tablet_bootstrap.cc:492] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.277419 24290 ts_tablet_manager.cc:1403] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:17:00.277717 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.279839 24291 tablet_bootstrap.cc:492] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:00.280349 24291 ts_tablet_manager.cc:1403] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.279s	user 0.008s	sys 0.013s
I20260709 12:17:00.280481 24290 raft_consensus.cc:359] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.281275 24290 raft_consensus.cc:385] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.281558 24290 raft_consensus.cc:740] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.282245 24290 consensus_queue.cc:260] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.285552 24290 ts_tablet_manager.cc:1434] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:17:00.286187 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:00.287289 24290 tablet_bootstrap.cc:492] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.287920 24291 raft_consensus.cc:359] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.288594 24291 raft_consensus.cc:385] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.288868 24291 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.289592 24291 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.291658 24094 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:00.293002 24214 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:00.293946 24483 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.294370 24290 tablet_bootstrap.cc:654] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.294445 24483 raft_consensus.cc:697] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:00.295450 24483 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:00.297904 24216 leader_election.cc:343] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:00.299223 24216 leader_election.cc:343] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.301519 24096 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:00.302964 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:00.305344 24498 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.286808 24293 tablet_bootstrap.cc:654] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.306327 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:00.307782 24141 leader_election.cc:343] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.305712 24370 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.308425 24370 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:00.309314 24370 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.311985 24290 tablet_bootstrap.cc:492] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.312680 24290 ts_tablet_manager.cc:1403] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.004s
I20260709 12:17:00.312043 24291 ts_tablet_manager.cc:1434] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:17:00.314563 24291 tablet_bootstrap.cc:492] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:00.316332 24290 raft_consensus.cc:359] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.317118 24290 raft_consensus.cc:385] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.317380 24290 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.318127 24290 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.320927 24290 ts_tablet_manager.cc:1434] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.003s
I20260709 12:17:00.322084 24290 tablet_bootstrap.cc:492] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.328583 24293 tablet_bootstrap.cc:492] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:00.328822 24290 tablet_bootstrap.cc:654] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.329139 24293 ts_tablet_manager.cc:1403] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.000s
I20260709 12:17:00.332430 24293 raft_consensus.cc:359] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.333428 24293 raft_consensus.cc:385] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.333753 24293 raft_consensus.cc:740] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.337110 24291 tablet_bootstrap.cc:654] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.329655 23999 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:00.334558 24293 consensus_queue.cc:260] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.347024 24293 ts_tablet_manager.cc:1434] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.003s
I20260709 12:17:00.348976 24293 tablet_bootstrap.cc:492] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:00.350067 24291 tablet_bootstrap.cc:492] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:00.350603 24290 tablet_bootstrap.cc:492] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.351150 24290 ts_tablet_manager.cc:1403] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.004s
I20260709 12:17:00.350652 24291 ts_tablet_manager.cc:1403] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.005s
I20260709 12:17:00.352984 23995 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:00.360365 24290 raft_consensus.cc:359] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.361155 24290 raft_consensus.cc:385] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.361438 24290 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.362730 24293 tablet_bootstrap.cc:654] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.363754 24290 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.366297 24290 ts_tablet_manager.cc:1434] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:17:00.367391 24290 tablet_bootstrap.cc:492] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.371189 24176 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.373452 24291 raft_consensus.cc:359] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.374243 24291 raft_consensus.cc:385] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.374522 24291 raft_consensus.cc:740] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.375308 24291 consensus_queue.cc:260] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.377650 24291 ts_tablet_manager.cc:1434] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:17:00.379810 24291 tablet_bootstrap.cc:492] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:00.387006 24291 tablet_bootstrap.cc:654] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.392416 24290 tablet_bootstrap.cc:654] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.404559 24293 tablet_bootstrap.cc:492] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:00.405192 24293 ts_tablet_manager.cc:1403] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.057s	user 0.027s	sys 0.003s
I20260709 12:17:00.408977 24293 raft_consensus.cc:359] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.409960 24293 raft_consensus.cc:385] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.410770 24370 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.411322 24370 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.410307 24293 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.412779 24293 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.413874 24291 tablet_bootstrap.cc:492] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:00.414451 24291 ts_tablet_manager.cc:1403] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.011s
I20260709 12:17:00.415282 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.415972 24096 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:00.417546 24293 ts_tablet_manager.cc:1434] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:17:00.419961 24293 tablet_bootstrap.cc:492] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:00.422785 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:00.423362 24291 raft_consensus.cc:359] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.424196 24291 raft_consensus.cc:385] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.424476 24291 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.425207 24291 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.426664 24293 tablet_bootstrap.cc:654] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.427567 24291 ts_tablet_manager.cc:1434] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.002s
I20260709 12:17:00.428743 24291 tablet_bootstrap.cc:492] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:00.430166 24290 tablet_bootstrap.cc:492] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.430687 24290 ts_tablet_manager.cc:1403] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.004s
I20260709 12:17:00.433774 24290 raft_consensus.cc:359] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.434473 24290 raft_consensus.cc:385] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.434741 24290 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.435369 24291 tablet_bootstrap.cc:654] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.435516 24290 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.437924 24290 ts_tablet_manager.cc:1434] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:17:00.438789 24370 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.440210 24290 tablet_bootstrap.cc:492] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
W20260709 12:17:00.444917 24141 leader_election.cc:343] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.450043 24140 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:00.459271 24291 tablet_bootstrap.cc:492] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:00.460136 24291 ts_tablet_manager.cc:1403] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.008s
I20260709 12:17:00.463620 24370 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.464179 24370 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.464609 24370 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.478554 24413 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.479205 24413 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.484560 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.484726 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:00.486276 24141 leader_election.cc:343] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.485196 24413 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.490234 24291 raft_consensus.cc:359] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.490949 24291 raft_consensus.cc:385] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.491236 24291 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.491891 24291 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.493458 24291 ts_tablet_manager.cc:1434] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.000s
I20260709 12:17:00.495564 24290 tablet_bootstrap.cc:654] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.497377 24370 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.498785 24293 tablet_bootstrap.cc:492] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:00.499351 24293 ts_tablet_manager.cc:1403] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.015s
I20260709 12:17:00.500207 24291 tablet_bootstrap.cc:492] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:00.502926 24293 raft_consensus.cc:359] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.503810 24370 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.505473 24290 tablet_bootstrap.cc:492] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.505344 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:00.507066 24140 leader_election.cc:343] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.507318 24290 ts_tablet_manager.cc:1403] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.068s	user 0.014s	sys 0.001s
I20260709 12:17:00.507947 24483 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:00.508169 24141 leader_election.cc:343] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.508432 24483 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.503647 24293 raft_consensus.cc:385] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.509368 24293 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.510358 24293 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.511272 24483 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:00.507532 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:00.514895 24293 ts_tablet_manager.cc:1434] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 12:17:00.515184 24370 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.516422 24293 tablet_bootstrap.cc:492] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:00.516841 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.517625 24094 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:17:00.518880 24214 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:00.519492 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.519747 24482 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.520170 24482 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.519960 24290 raft_consensus.cc:359] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.521270 24482 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.521456 24290 raft_consensus.cc:385] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.521788 24290 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.522533 24290 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.520198 24175 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:17:00.524853 24290 ts_tablet_manager.cc:1434] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:17:00.526093 24290 tablet_bootstrap.cc:492] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.526721 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:00.527420 24094 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.533288 24290 tablet_bootstrap.cc:654] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.505823 24291 tablet_bootstrap.cc:654] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.535674 24094 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:00.552474 24370 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.546969 24482 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.553354 24293 tablet_bootstrap.cc:654] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.553471 24498 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.556289 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:00.557148 24094 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.562173 24552 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.562621 24140 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:00.562965 24552 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.563937 24370 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.564464 24370 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:00.565363 24370 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.567279 24552 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.568065 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:00.569672 24066 leader_election.cc:343] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.574764 24293 tablet_bootstrap.cc:492] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:00.575397 24293 ts_tablet_manager.cc:1403] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.002s
I20260709 12:17:00.575909 24482 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:00.579936 24290 tablet_bootstrap.cc:492] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.580500 24290 ts_tablet_manager.cc:1403] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.055s	user 0.024s	sys 0.022s
I20260709 12:17:00.581236 24094 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:00.582607 24214 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:00.584303 24482 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.584816 24482 raft_consensus.cc:697] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:00.585632 24290 raft_consensus.cc:359] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.585924 24482 consensus_queue.cc:237] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.586405 24290 raft_consensus.cc:385] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.586723 24290 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.587477 24290 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.590490 24290 ts_tablet_manager.cc:1434] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:17:00.591634 24290 tablet_bootstrap.cc:492] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.591965 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:00.592578 24176 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.594259 24501 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.594750 24501 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.596966 24291 tablet_bootstrap.cc:492] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:00.597472 24291 ts_tablet_manager.cc:1403] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.098s	user 0.004s	sys 0.010s
I20260709 12:17:00.597775 24501 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.598641 24290 tablet_bootstrap.cc:654] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.600662 24291 raft_consensus.cc:359] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.601171 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.601440 24291 raft_consensus.cc:385] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.601814 24291 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.601976 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.602804 24098 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 1: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:00.599994 24176 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:00.600162 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:00.578541 24293 raft_consensus.cc:359] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.605453 24293 raft_consensus.cc:385] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.605747 24291 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.608595 24291 ts_tablet_manager.cc:1434] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:17:00.605767 24293 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.610550 24293 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.612882 24293 ts_tablet_manager.cc:1434] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:17:00.613919 24293 tablet_bootstrap.cc:492] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:00.609779 24291 tablet_bootstrap.cc:492] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
W20260709 12:17:00.616211 24067 leader_election.cc:343] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.616775 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:00.617460 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:00.623795 24370 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.619146 24553 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.654465 24413 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.655334 24413 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.671811 23996 catalog_manager.cc:5697] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:00.676177 24480 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.676803 24480 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.679308 24480 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:00.682181 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.683198 24098 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:00.684000 24290 tablet_bootstrap.cc:492] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.684551 24290 ts_tablet_manager.cc:1403] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.008s
I20260709 12:17:00.689213 24370 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.689781 24290 raft_consensus.cc:359] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.690522 24290 raft_consensus.cc:385] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.690790 24290 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.691660 24290 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.693272 24290 ts_tablet_manager.cc:1434] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:00.685989 24413 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.694511 24290 tablet_bootstrap.cc:492] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.694959 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:00.696619 24141 leader_election.cc:343] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.700291 24291 tablet_bootstrap.cc:654] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.700516 24293 tablet_bootstrap.cc:654] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.704617 24553 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.704948 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.705205 24553 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.709693 24553 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.712627 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:00.712726 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:00.715642 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.716322 24098 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:00.716523 24483 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.716809 24374 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.717309 24374 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.719588 24374 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:00.722919 24066 leader_election.cc:343] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.723771 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.725669 24094 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:17:00.726068 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:00.727315 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:00.727720 24498 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:00.723862 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.728246 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.728933 24172 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:17:00.729022 24354 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.729458 24354 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.729842 24354 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.725647 24598 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.727468 24501 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:00.733774 24501 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:00.734210 24501 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.737723 24290 tablet_bootstrap.cc:654] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:00.751262 24413 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.730522 24598 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.756940 24413 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.795600 23999 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:00.805605 24413 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.807400 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.811816 24291 tablet_bootstrap.cc:492] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:00.812469 24291 ts_tablet_manager.cc:1403] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.203s	user 0.020s	sys 0.009s
I20260709 12:17:00.818104 24291 raft_consensus.cc:359] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.819133 24291 raft_consensus.cc:385] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.819492 24291 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
W20260709 12:17:00.818749 24140 leader_election.cc:343] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.823627 24291 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.832186 24354 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.832801 24291 ts_tablet_manager.cc:1434] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.004s
I20260709 12:17:00.834084 24291 tablet_bootstrap.cc:492] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:00.834612 24354 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:00.841989 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:00.842552 24176 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.840644 24501 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.844318 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.845146 24483 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.845923 24174 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:00.846625 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:00.847296 24096 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.851608 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:00.857430 24291 tablet_bootstrap.cc:654] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:00.859182 24141 leader_election.cc:343] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.890676 24141 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:00.893864 24293 tablet_bootstrap.cc:492] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:00.894606 24293 ts_tablet_manager.cc:1403] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.281s	user 0.016s	sys 0.017s
I20260709 12:17:00.900238 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:00.901266 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44982.2us
I20260709 12:17:00.895390 24447 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.902477 24370 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.902657 24447 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:00.904326 24066 leader_election.cc:343] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.904857 24290 tablet_bootstrap.cc:492] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:00.905082 24447 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.905407 24290 ts_tablet_manager.cc:1403] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.211s	user 0.019s	sys 0.012s
I20260709 12:17:00.861255 24598 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.907294 24096 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:00.910957 24176 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:00.906814 24413 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:00.911760 24413 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.913727 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:00.916399 24351 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:00.915439 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:00.918105 24601 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:00.923722 24413 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.924381 24351 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:00.925055 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:00.925812 24351 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:00.926694 24066 leader_election.cc:343] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.923799 24290 raft_consensus.cc:359] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.931574 24290 raft_consensus.cc:385] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.932310 24290 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.933087 24290 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.931694 24293 raft_consensus.cc:359] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.937467 24293 raft_consensus.cc:385] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:00.937826 24293 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:00.948246 24290 ts_tablet_manager.cc:1434] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.001s
I20260709 12:17:00.934628 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.957536 24290 tablet_bootstrap.cc:492] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:00.960443 24291 tablet_bootstrap.cc:492] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:00.960964 24291 ts_tablet_manager.cc:1403] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.127s	user 0.014s	sys 0.006s
I20260709 12:17:00.956009 24293 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:00.967343 24141 leader_election.cc:343] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.953220 24172 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:17:00.977653 24598 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:00.977839 24067 leader_election.cc:343] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:00.978375 24067 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:00.978385 24598 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:00.979722 24067 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:00.980796 24598 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:00.981326 24598 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:00.985803 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:00.986155 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:00.986764 24100 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:00.990754 24293 ts_tablet_manager.cc:1434] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.096s	user 0.012s	sys 0.000s
I20260709 12:17:00.991588 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:00.982897 24553 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:00.987787 24480 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:17:01.012619 24290 tablet_bootstrap.cc:654] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.025624 24291 raft_consensus.cc:359] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.027077 24291 raft_consensus.cc:385] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.027417 24291 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.028271 24291 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.032888 24291 ts_tablet_manager.cc:1434] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.001s
I20260709 12:17:01.033490 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:01.034440 24250 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:17:01.055133 24293 tablet_bootstrap.cc:492] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:01.038587 24501 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.064779 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:01.065582 24482 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.071846 24482 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.072686 24553 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.074863 24447 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.076224 24482 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:01.078508 24447 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.087116 24291 tablet_bootstrap.cc:492] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
W20260709 12:17:01.087493 24067 leader_election.cc:343] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.091212 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:01.099040 24370 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.099417 24370 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.099745 24370 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.104141 24067 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:01.080554 24447 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.110044 24552 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.089069 24094 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:01.131760 24553 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.085724 24480 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 12:17:01.140833 24480 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:01.136670 24552 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.140892 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:01.119688 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:01.171952 24290 tablet_bootstrap.cc:492] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:01.172631 24290 ts_tablet_manager.cc:1403] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.215s	user 0.013s	sys 0.020s
I20260709 12:17:01.162689 24552 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.145131 24553 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.179836 24370 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:01.197898 24141 leader_election.cc:343] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.196988 24498 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.202261 24553 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.228155 24290 raft_consensus.cc:359] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.228964 24290 raft_consensus.cc:385] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.229305 24290 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.229956 24290 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.230671 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:01.231365 24096 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.226539 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:01.241060 24172 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:17:01.242563 24067 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:01.242743 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:01.224968 24498 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.247959 24613 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.248438 24613 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.248775 24613 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.252501 24290 ts_tablet_manager.cc:1434] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.003s
I20260709 12:17:01.264473 24291 tablet_bootstrap.cc:654] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.267247 24293 tablet_bootstrap.cc:654] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.271723 24099 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:01.281040 24498 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.285444 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:01.289655 24370 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.291997 24096 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
W20260709 12:17:01.299132 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 95343.3us
I20260709 12:17:01.286580 24097 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:01.301837 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:01.302488 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:01.304068 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:01.304133 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:01.308135 24617 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:17:01.311177 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:01.312125 24498 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.290516 24601 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.312134 24617 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:01.316210 24498 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.332202 24498 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.320077 24601 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.367754 24601 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.370012 24447 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.372345 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:01.371165 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:01.373988 24099 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:01.354522 24617 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.383703 24552 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.404841 24140 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:01.411283 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:01.405179 24613 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.424991 24552 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.429797 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:01.430269 24616 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:01.430627 24173 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.430698 24616 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:01.431191 24616 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.441566 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:01.442461 24168 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.445346 24370 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:01.446472 24290 tablet_bootstrap.cc:492] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:01.428360 24560 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.451361 24560 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:01.452411 24560 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:01.455305 24066 leader_election.cc:343] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.456207 24447 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.461635 24598 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.465457 24498 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.462215 24598 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.473641 24598 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.475442 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:01.480633 24097 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:01.479103 24141 leader_election.cc:343] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.485407 24173 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
W20260709 12:17:01.484795 24141 leader_election.cc:343] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.486714 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:01.489704 24291 tablet_bootstrap.cc:492] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:01.491405 24291 ts_tablet_manager.cc:1403] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.405s	user 0.025s	sys 0.014s
I20260709 12:17:01.489804 23995 catalog_manager.cc:5697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:01.487646 24498 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.502419 24067 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:01.497853 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:01.502421 24613 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.500551 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:01.510056 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:01.511608 24250 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.514016 24291 raft_consensus.cc:359] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.515576 24291 raft_consensus.cc:385] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.517976 24291 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.519050 24291 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:01.520700 24067 leader_election.cc:343] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:01.522965 24067 leader_election.cc:343] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.528285 24607 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.529013 24607 raft_consensus.cc:697] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:01.535907 24141 leader_election.cc:343] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.529983 24607 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.536587 24293 tablet_bootstrap.cc:492] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:01.537170 24293 ts_tablet_manager.cc:1403] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.505s	user 0.042s	sys 0.013s
I20260709 12:17:01.545523 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:01.556041 24141 leader_election.cc:343] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.558013 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:01.572557 24291 ts_tablet_manager.cc:1434] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:17:01.554780 24168 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:01.545112 24616 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.577353 24498 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:01.580567 24611 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:17:01.583634 24066 leader_election.cc:343] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:01.587165 24066 leader_election.cc:343] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.588169 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:01.590181 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:01.593639 24097 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:01.590376 24290 tablet_bootstrap.cc:654] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.594455 24616 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.579685 24291 tablet_bootstrap.cc:492] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:01.590803 24248 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.597823 24067 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:01.600337 24552 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.600419 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:01.600916 24552 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:01.601899 24552 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.604941 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:01.607702 24141 leader_election.cc:343] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:01.609994 24066 leader_election.cc:343] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:01.610615 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:01.622766 24613 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.643893 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:01.653236 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48347.1us
W20260709 12:17:01.653431 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 43497.5us
I20260709 12:17:01.654282 24099 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:01.663932 24293 raft_consensus.cc:359] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.664767 24293 raft_consensus.cc:385] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.665146 24293 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.665921 24290 tablet_bootstrap.cc:492] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:01.666456 24290 ts_tablet_manager.cc:1403] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.220s	user 0.015s	sys 0.005s
I20260709 12:17:01.667358 24293 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.664813 23999 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.686918 24293 ts_tablet_manager.cc:1434] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.149s	user 0.009s	sys 0.003s
I20260709 12:17:01.694425 24290 raft_consensus.cc:359] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.700800 24290 raft_consensus.cc:385] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:01.701308 24290 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:01.701752 24291 tablet_bootstrap.cc:654] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.683250 24618 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.709616 24290 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.710422 24214 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:01.721077 24099 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:01.722882 24293 tablet_bootstrap.cc:492] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:01.724161 24290 ts_tablet_manager.cc:1434] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.002s
I20260709 12:17:01.734859 24604 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:01.746637 24248 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:01.748956 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:01.751441 24140 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:01.743856 24612 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:17:01.758385 23996 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.724321 24618 raft_consensus.cc:697] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:01.770421 23996 catalog_manager.cc:5697] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:01.758119 24598 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.774596 24290 tablet_bootstrap.cc:492] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:01.764092 24617 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.777778 24598 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:01.783257 24618 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.776211 24626 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:01.778563 24617 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.783947 24598 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.798305 24293 tablet_bootstrap.cc:654] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.800175 24626 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:01.820078 24553 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.837538 24291 tablet_bootstrap.cc:492] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:01.839327 24291 ts_tablet_manager.cc:1403] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.260s	user 0.025s	sys 0.006s
W20260709 12:17:01.845566 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 76586.2us
I20260709 12:17:01.823355 24626 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.842522 24480 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:01.857213 24480 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.862136 24480 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:01.843528 24553 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:01.873255 24553 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.876317 24290 tablet_bootstrap.cc:654] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:01.891247 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:01.896735 24617 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:01.946480 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:01.908753 24646 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.046s
I20260709 12:17:01.950955 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:01.968894 24067 leader_election.cc:343] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:01.971496 24141 consensus_peers.cc:597] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:01.977396 24641 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.100s	user 0.003s	sys 0.002s
I20260709 12:17:01.948277 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:01.949855 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:01.991748 24141 leader_election.cc:343] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:01.983184 24640 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:17:02.002905 24291 raft_consensus.cc:359] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.003777 24291 raft_consensus.cc:385] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.004032 24291 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.004568 24291 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.007344 24094 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:02.007562 24291 ts_tablet_manager.cc:1434] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.168s	user 0.004s	sys 0.003s
I20260709 12:17:02.008751 24291 tablet_bootstrap.cc:492] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:02.024452 24290 tablet_bootstrap.cc:492] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:02.026605 24248 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:02.035406 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:02.044164 24290 ts_tablet_manager.cc:1403] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.287s	user 0.021s	sys 0.009s
W20260709 12:17:02.046590 24066 leader_election.cc:343] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.045746 24615 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:17:02.047178 24066 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:02.048818 24598 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:02.050061 24290 raft_consensus.cc:359] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.050902 24290 raft_consensus.cc:385] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.051237 24290 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.052098 24290 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.054005 24290 ts_tablet_manager.cc:1434] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:17:02.055145 24290 tablet_bootstrap.cc:492] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:02.070901 24291 tablet_bootstrap.cc:654] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:02.073207 24140 leader_election.cc:343] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.073683 24140 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:02.076242 24214 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:02.078044 24598 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.079314 24626 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:02.082176 24293 tablet_bootstrap.cc:492] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:02.082697 24293 ts_tablet_manager.cc:1403] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.373s	user 0.023s	sys 0.008s
I20260709 12:17:02.078608 24598 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.090123 24611 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:02.100539 24615 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:02.102401 24598 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:02.103641 23996 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.105366 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:02.112035 24066 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:02.113955 24501 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:02.112984 24066 leader_election.cc:343] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.120503 24293 raft_consensus.cc:359] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.121265 24293 raft_consensus.cc:385] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.121531 24293 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.125190 24293 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.127676 24293 ts_tablet_manager.cc:1434] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
I20260709 12:17:02.129254 24293 tablet_bootstrap.cc:492] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:02.141613 24293 tablet_bootstrap.cc:654] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.145339 24598 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:17:02.148262 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:02.162561 24067 leader_election.cc:343] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.163260 24067 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:02.165962 24598 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:02.185815 24290 tablet_bootstrap.cc:654] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.191992 24291 tablet_bootstrap.cc:492] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:02.192821 24291 ts_tablet_manager.cc:1403] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.184s	user 0.016s	sys 0.009s
I20260709 12:17:02.211622 24291 raft_consensus.cc:359] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.212687 24291 raft_consensus.cc:385] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.213073 24291 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.215622 24291 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.217749 24291 ts_tablet_manager.cc:1434] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260709 12:17:02.220357 24291 tablet_bootstrap.cc:492] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:02.247505 24290 tablet_bootstrap.cc:492] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:02.248112 24290 ts_tablet_manager.cc:1403] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.193s	user 0.017s	sys 0.013s
W20260709 12:17:02.291070 24066 consensus_peers.cc:597] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:02.298200 24290 raft_consensus.cc:359] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.302563 24290 raft_consensus.cc:385] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.302898 24290 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.303779 24290 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.304388 24293 tablet_bootstrap.cc:492] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:02.305300 24293 ts_tablet_manager.cc:1403] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.177s	user 0.024s	sys 0.007s
I20260709 12:17:02.307144 24291 tablet_bootstrap.cc:654] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.309660 24293 raft_consensus.cc:359] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.414641 24660 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.415318 24660 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.417333 24660 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:02.420485 24660 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.420957 24660 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.422808 24660 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:02.432026 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:02.436815 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:02.439659 24067 leader_election.cc:343] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.439800 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:02.442588 24066 leader_election.cc:343] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:02.444633 24067 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:02.445329 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:02.445539 24067 leader_election.cc:343] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.447561 24067 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:02.450670 24447 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:17:02.452484 24066 leader_election.cc:343] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.453086 24066 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:02.454056 24660 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:02.485551 24607 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:02.540292 24498 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.540925 24498 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.542713 24498 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:02.546025 24247 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:02.557291 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:02.565899 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:02.570546 24498 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:17:02.580492 24141 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:17:02.584489 24141 leader_election.cc:343] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.588637 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:02.572418 24290 ts_tablet_manager.cc:1434] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.324s	user 0.011s	sys 0.000s
I20260709 12:17:02.578903 24291 tablet_bootstrap.cc:492] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:02.310796 24293 raft_consensus.cc:385] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.591646 24293 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.592353 24290 tablet_bootstrap.cc:492] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:02.592490 24293 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.594453 24293 ts_tablet_manager.cc:1434] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.289s	user 0.009s	sys 0.001s
I20260709 12:17:02.595515 23995 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:17:02.598306 24293 tablet_bootstrap.cc:492] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:02.607348 24291 ts_tablet_manager.cc:1403] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.388s	user 0.015s	sys 0.013s
I20260709 12:17:02.610636 24291 raft_consensus.cc:359] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.611474 24291 raft_consensus.cc:385] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.611830 24291 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.619233 23999 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.621758 24293 tablet_bootstrap.cc:654] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.621553 23999 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:02.623287 24291 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.629130 24291 ts_tablet_manager.cc:1434] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.002s
I20260709 12:17:02.630391 24291 tablet_bootstrap.cc:492] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:02.636416 24291 tablet_bootstrap.cc:654] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
W20260709 12:17:02.639041 24140 leader_election.cc:343] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.639639 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:02.641544 24293 tablet_bootstrap.cc:492] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:02.642376 24293 ts_tablet_manager.cc:1403] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.008s
I20260709 12:17:02.644433 24616 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:02.645260 24615 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:02.647119 24293 raft_consensus.cc:359] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.648075 24293 raft_consensus.cc:385] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.648407 24293 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.649048 24290 tablet_bootstrap.cc:654] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.649206 24293 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.651135 24293 ts_tablet_manager.cc:1434] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:17:02.653241 24293 tablet_bootstrap.cc:492] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:02.662707 24550 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.663486 24550 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.666750 24613 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:02.680497 24615 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:17:02.701531 24604 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.702006 24550 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:02.702191 24604 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.709296 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:02.732200 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:02.739266 24604 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:02.755422 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:02.754057 24501 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:02.764827 24501 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.781306 24290 tablet_bootstrap.cc:492] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:02.781867 24290 ts_tablet_manager.cc:1403] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.190s	user 0.026s	sys 0.027s
I20260709 12:17:02.785459 24291 tablet_bootstrap.cc:492] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:02.785934 24291 ts_tablet_manager.cc:1403] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.156s	user 0.015s	sys 0.009s
I20260709 12:17:02.782845 24501 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:02.793043 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:02.794413 24293 tablet_bootstrap.cc:654] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.794258 24291 raft_consensus.cc:359] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.795097 24291 raft_consensus.cc:385] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.795411 24291 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
W20260709 12:17:02.795646 24140 leader_election.cc:343] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:02.795966 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49677.6us
I20260709 12:17:02.804694 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:02.806066 24550 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:02.811609 24291 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.814638 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:02.815992 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:02.818379 24141 leader_election.cc:343] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:02.818840 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:02.819190 24216 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:02.820063 24622 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:02.820092 24483 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:02.828145 24290 raft_consensus.cc:359] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.828913 24290 raft_consensus.cc:385] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.829149 24290 raft_consensus.cc:740] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.829905 24290 consensus_queue.cc:260] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.832861 24290 ts_tablet_manager.cc:1434] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:17:02.833921 24290 tablet_bootstrap.cc:492] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:02.842141 24290 tablet_bootstrap.cc:654] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.854178 24293 tablet_bootstrap.cc:492] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:02.854729 24293 ts_tablet_manager.cc:1403] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.202s	user 0.014s	sys 0.004s
I20260709 12:17:02.857816 24293 raft_consensus.cc:359] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.865943 24293 raft_consensus.cc:385] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.866272 24293 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.864737 24291 ts_tablet_manager.cc:1434] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.002s
I20260709 12:17:02.868889 24293 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.871351 24293 ts_tablet_manager.cc:1434] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:17:02.878168 24291 tablet_bootstrap.cc:492] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:02.898998 24290 tablet_bootstrap.cc:492] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:02.899606 24290 ts_tablet_manager.cc:1403] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.013s
I20260709 12:17:02.902109 24293 tablet_bootstrap.cc:492] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:02.904762 24290 raft_consensus.cc:359] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.905778 24290 raft_consensus.cc:385] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.906157 24290 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.907112 24290 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.909014 24291 tablet_bootstrap.cc:654] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.909891 24290 ts_tablet_manager.cc:1434] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:17:02.915138 24293 tablet_bootstrap.cc:654] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.915648 24290 tablet_bootstrap.cc:492] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:02.922384 24290 tablet_bootstrap.cc:654] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.931645 24293 tablet_bootstrap.cc:492] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:02.932482 24291 tablet_bootstrap.cc:492] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:02.932782 24293 ts_tablet_manager.cc:1403] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.011s
I20260709 12:17:02.933012 24291 ts_tablet_manager.cc:1403] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.061s	user 0.007s	sys 0.007s
I20260709 12:17:02.935822 24293 raft_consensus.cc:359] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.936591 24293 raft_consensus.cc:385] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.936866 24293 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.937394 24291 raft_consensus.cc:359] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.937604 24293 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.938089 24291 raft_consensus.cc:385] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.938437 24291 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.939167 24291 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.941453 24291 ts_tablet_manager.cc:1434] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:17:02.944628 24291 tablet_bootstrap.cc:492] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:02.949925 24290 tablet_bootstrap.cc:492] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:02.950098 24293 ts_tablet_manager.cc:1434] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:17:02.950574 24290 ts_tablet_manager.cc:1403] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.000s
I20260709 12:17:02.951053 24291 tablet_bootstrap.cc:654] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.953732 24290 raft_consensus.cc:359] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:02.954720 24290 raft_consensus.cc:385] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:02.954969 24293 tablet_bootstrap.cc:492] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:02.961462 24291 tablet_bootstrap.cc:492] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:02.962097 24291 ts_tablet_manager.cc:1403] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 12:17:02.965009 24293 tablet_bootstrap.cc:654] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:02.969456 24290 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:02.977700 24291 raft_consensus.cc:359] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.003221 24291 raft_consensus.cc:385] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.003695 24291 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.004309 24290 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.004565 24291 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.012633 24291 ts_tablet_manager.cc:1434] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.014s
I20260709 12:17:03.013797 24291 tablet_bootstrap.cc:492] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:03.014060 24290 ts_tablet_manager.cc:1434] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.002s
I20260709 12:17:03.015879 24248 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.016505 24293 tablet_bootstrap.cc:492] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:03.017601 24293 ts_tablet_manager.cc:1403] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.002s
I20260709 12:17:03.009344 24607 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.018690 24607 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.020992 24607 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.024824 24291 tablet_bootstrap.cc:654] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.027835 24293 raft_consensus.cc:359] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.033270 24293 raft_consensus.cc:385] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.029881 24246 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.031136 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:03.041728 24067 leader_election.cc:343] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.029572 24290 tablet_bootstrap.cc:492] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:03.045317 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:03.047537 24066 leader_election.cc:343] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.047998 24066 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.048823 24607 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:03.056766 24291 tablet_bootstrap.cc:492] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:03.057337 24291 ts_tablet_manager.cc:1403] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.020s
I20260709 12:17:03.060209 24290 tablet_bootstrap.cc:654] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.060487 24291 raft_consensus.cc:359] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.061311 24291 raft_consensus.cc:385] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.061617 24291 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.062613 24291 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.063102 24293 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.063980 24293 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.065402 24291 ts_tablet_manager.cc:1434] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:17:03.067543 24291 tablet_bootstrap.cc:492] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1: Bootstrap starting.
I20260709 12:17:03.076481 24293 ts_tablet_manager.cc:1434] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.001s
I20260709 12:17:03.086186 24293 tablet_bootstrap.cc:492] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:03.092864 24483 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:03.099936 24483 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.107935 24293 tablet_bootstrap.cc:654] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.113860 24291 tablet_bootstrap.cc:654] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.114826 24290 tablet_bootstrap.cc:492] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:03.115410 24290 ts_tablet_manager.cc:1403] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.086s	user 0.019s	sys 0.017s
I20260709 12:17:03.120433 24483 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:03.121052 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:03.122223 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:03.125272 24216 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:03.126320 24483 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:03.120327 24290 raft_consensus.cc:359] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.127657 24290 raft_consensus.cc:385] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.128031 24290 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.131946 24290 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.134298 24290 ts_tablet_manager.cc:1434] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:17:03.134498 24607 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.135074 24607 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.137373 24607 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.138286 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:03.139608 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:03.141541 24066 leader_election.cc:343] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:03.142927 24067 leader_election.cc:343] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.143375 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.144093 24607 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:03.144410 24501 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.144925 24501 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.155416 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:03.155416 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:03.158080 24290 tablet_bootstrap.cc:492] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:03.162176 24141 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.163152 24616 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:03.165745 24290 tablet_bootstrap.cc:654] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.167076 24501 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.170878 24291 tablet_bootstrap.cc:492] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1: No bootstrap required, opened a new log
I20260709 12:17:03.171645 24291 ts_tablet_manager.cc:1403] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1: Time spent bootstrapping tablet: real 0.105s	user 0.011s	sys 0.008s
I20260709 12:17:03.172957 24293 tablet_bootstrap.cc:492] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:03.173657 24293 ts_tablet_manager.cc:1403] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.010s
I20260709 12:17:03.175016 24291 raft_consensus.cc:359] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.175858 24291 raft_consensus.cc:385] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.176211 24291 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.177294 24291 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.185138 24613 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.185971 24613 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.189921 24613 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.191263 24290 tablet_bootstrap.cc:492] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:03.191133 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:03.191820 24290 ts_tablet_manager.cc:1403] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.000s
I20260709 12:17:03.191944 24169 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:17:03.193976 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:03.196132 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:03.197646 24066 leader_election.cc:343] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.200453 24290 raft_consensus.cc:359] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.201237 24290 raft_consensus.cc:385] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.201537 24290 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.202099 24613 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:03.202256 24290 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.202677 24613 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.203805 24613 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.205207 24293 raft_consensus.cc:359] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.205916 24293 raft_consensus.cc:385] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.206202 24293 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.208703 24290 ts_tablet_manager.cc:1434] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:17:03.206866 24293 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.211218 24293 ts_tablet_manager.cc:1434] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.037s	user 0.014s	sys 0.003s
I20260709 12:17:03.212536 24291 ts_tablet_manager.cc:1434] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1: Time spent starting tablet: real 0.040s	user 0.009s	sys 0.008s
I20260709 12:17:03.212551 24293 tablet_bootstrap.cc:492] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:03.217969 24290 tablet_bootstrap.cc:492] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:03.222155 24613 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.231233 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:03.231920 24169 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.234778 24293 tablet_bootstrap.cc:654] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.240514 24290 tablet_bootstrap.cc:654] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.248001 24293 tablet_bootstrap.cc:492] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:03.248489 24293 ts_tablet_manager.cc:1403] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.000s
I20260709 12:17:03.251227 24293 raft_consensus.cc:359] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.252075 24293 raft_consensus.cc:385] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.252338 24293 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.253023 24293 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.254552 24290 tablet_bootstrap.cc:492] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:03.254755 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:03.255203 24290 ts_tablet_manager.cc:1403] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.004s
W20260709 12:17:03.256254 24066 leader_election.cc:343] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.256875 24613 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.258139 24290 raft_consensus.cc:359] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.259614 24169 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:03.261179 24613 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.261330 24293 ts_tablet_manager.cc:1434] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:17:03.258841 24290 raft_consensus.cc:385] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.261790 24613 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.262349 24290 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.262528 24293 tablet_bootstrap.cc:492] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:03.262884 24616 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.263207 24290 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.263387 24616 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.265514 24616 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.267436 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:03.267771 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:03.269598 24141 leader_election.cc:343] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:17:03.270949 24066 leader_election.cc:343] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.275483 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.277096 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:03.277652 24293 tablet_bootstrap.cc:654] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.277812 24175 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:17:03.279206 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.278258 24613 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.280089 24553 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:03.280462 24553 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.280663 24290 ts_tablet_manager.cc:1434] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:17:03.280788 24553 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.281800 24290 tablet_bootstrap.cc:492] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:03.279057 24607 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:03.282413 24607 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:03.283144 24622 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.283360 24607 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.283670 24622 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.285842 24622 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.289299 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:03.289422 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:03.288480 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:03.295748 24100 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:03.296309 24095 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:03.299748 24560 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.300312 24560 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.301327 24246 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.302428 24560 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.297783 24140 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:17:03.305037 24141 leader_election.cc:343] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.306793 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:03.307530 24247 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:03.309131 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.314090 24560 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:03.310719 24616 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:03.314613 24560 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.315192 24560 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:03.315531 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3380 after lost signal to thread 22906
I20260709 12:17:03.312695 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:03.316349 24501 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:17:03.316794 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1e60 after lost signal to thread 24033
W20260709 12:17:03.318172 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08002b10c0 after lost signal to thread 24125
W20260709 12:17:03.320859 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08002b1900 after lost signal to thread 24200
I20260709 12:17:03.316723 24501 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:03.322017 24122 debug-util.cc:398] Leaking SignalData structure 0x7b0800249060 after lost signal to thread 24274
W20260709 12:17:03.324745 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45603.6us
I20260709 12:17:03.322031 24501 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.314735 24616 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.329558 24616 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.346132 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:03.353889 24122 debug-util.cc:398] Leaking SignalData structure 0x7b080027cf40 after lost signal to thread 24639
I20260709 12:17:03.363653 24095 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:03.377574 23995 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:03.379590 24247 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.374842 24552 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.383685 24552 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.386356 24552 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.391814 24553 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.397997 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:03.405483 24553 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.397921 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:03.409317 24172 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:17:03.401726 24169 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.410895 24067 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:03.412181 24696 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:03.412668 24696 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.413110 24696 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.415256 24501 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.417644 24501 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.417847 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:03.418690 24169 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:03.419400 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:03.419976 24066 leader_election.cc:343] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.420208 24250 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.423776 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:03.424770 24248 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 0.
I20260709 12:17:03.428982 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.433712 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:03.434398 24598 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:03.406844 24168 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.440442 24250 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:03.441079 24622 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.441601 24622 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.443822 24622 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.445520 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:03.447872 24099 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:03.445678 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:03.449185 24140 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:03.450224 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:03.438411 24100 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.451308 24615 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:03.450364 24501 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:03.451844 24615 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.452317 24615 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:17:03.452786 24141 leader_election.cc:343] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.454862 24560 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.449113 24598 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:03.458650 24598 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.459357 24560 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.457307 24696 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.479401 24501 raft_consensus.cc:697] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:03.482492 24696 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.484387 24615 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.486060 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:03.487620 24250 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.489670 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:03.485675 24293 tablet_bootstrap.cc:492] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:03.492628 24501 consensus_queue.cc:237] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.496949 24290 tablet_bootstrap.cc:654] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.455503 24616 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.506848 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:03.507617 24095 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.510149 24100 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:03.490684 24293 ts_tablet_manager.cc:1403] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.228s	user 0.013s	sys 0.005s
W20260709 12:17:03.493448 24141 leader_election.cc:343] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.514010 24616 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.517246 24615 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.521245 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:03.525774 24250 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
W20260709 12:17:03.526917 24141 leader_election.cc:343] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.535490 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:03.535532 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:03.536267 24098 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.536213 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:03.536446 24096 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.536893 24174 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.538496 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:03.558867 24141 leader_election.cc:343] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.559530 24293 raft_consensus.cc:359] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.565249 24293 raft_consensus.cc:385] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.565515 24293 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.566543 24293 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.569664 24096 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:03.571501 24140 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.596058 24293 ts_tablet_manager.cc:1434] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.084s	user 0.009s	sys 0.000s
I20260709 12:17:03.590181 24696 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.602160 24696 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.597913 24675 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.604666 24675 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.609476 24293 tablet_bootstrap.cc:492] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:03.589922 24501 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:03.613741 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:03.633010 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:03.608848 24675 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:03.608978 24696 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.636710 24552 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:17:03.640228 24066 leader_election.cc:343] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.635974 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:03.639236 24552 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:03.652767 24552 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.684389 24710 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.685298 24710 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.688706 24710 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:03.689589 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:03.665233 24174 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
W20260709 12:17:03.699362 24047 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:17:03.678676 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:03.716244 24290 tablet_bootstrap.cc:492] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:03.717021 24290 ts_tablet_manager.cc:1403] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.435s	user 0.031s	sys 0.011s
W20260709 12:17:03.723395 24067 leader_election.cc:343] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.724110 24067 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.706563 24501 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:03.719451 24616 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:03.732846 24613 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:03.724080 24097 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:17:03.733740 24095 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:03.767547 24098 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:03.758675 24616 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:03.773892 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45762.4us
I20260709 12:17:03.793212 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:03.796957 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:03.807238 24176 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:03.807801 24293 tablet_bootstrap.cc:654] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:03.816797 24616 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:03.818552 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:03.824133 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.825327 24140 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.827908 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:03.829298 24141 leader_election.cc:343] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:03.830281 24216 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:03.834475 24616 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:03.835587 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:03.836274 24095 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:03.844924 24665 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.845994 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:03.847566 24703 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:03.848315 24715 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:03.848790 24715 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.849102 24715 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.849867 24616 raft_consensus.cc:697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:03.863306 24290 raft_consensus.cc:359] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.864423 24290 raft_consensus.cc:385] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:03.864810 24290 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:03.865675 24290 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.828011 24550 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:03.866950 24550 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:03.867352 24616 consensus_queue.cc:237] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.868464 24290 ts_tablet_manager.cc:1434] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.151s	user 0.004s	sys 0.004s
I20260709 12:17:03.870168 24290 tablet_bootstrap.cc:492] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:03.866158 24703 raft_consensus.cc:697] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:03.784126 24501 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.881165 24607 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:17:03.867345 24550 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.893576 24703 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.896809 24170 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 0.
I20260709 12:17:03.982532 24550 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.988823 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:03.989526 24097 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:03.992331 24715 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:03.996465 24550 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:03.998057 23995 catalog_manager.cc:5697] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:04.009776 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44100.6us
I20260709 12:17:04.005283 24715 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:04.013311 24097 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:04.048633 24665 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:04.053785 24290 tablet_bootstrap.cc:654] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:04.065311 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:04.068729 24141 leader_election.cc:343] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.078734 24293 tablet_bootstrap.cc:492] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:04.079411 24293 ts_tablet_manager.cc:1403] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.479s	user 0.020s	sys 0.020s
W20260709 12:17:04.081509 24066 consensus_peers.cc:597] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:04.091696 24727 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.106559 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:04.118474 23997 catalog_manager.cc:5697] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.122790 23997 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.114945 24665 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:04.144963 24703 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.149117 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:04.149911 24173 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.156301 24665 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:04.157393 24665 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.123536 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:04.159430 24094 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.186476 24173 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:04.186336 24697 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.199695 24293 raft_consensus.cc:359] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.200592 24293 raft_consensus.cc:385] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.201417 24293 raft_consensus.cc:740] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.202109 24293 consensus_queue.cc:260] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.203296 24553 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.215029 24696 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.237360 24293 ts_tablet_manager.cc:1434] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.158s	user 0.006s	sys 0.002s
I20260709 12:17:04.246238 24293 tablet_bootstrap.cc:492] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:04.248088 23997 catalog_manager.cc:5697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.250659 23997 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.252404 23997 catalog_manager.cc:5697] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.227411 24094 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:04.228070 24702 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 12:17:04.286896 24290 tablet_bootstrap.cc:492] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:04.287539 24290 ts_tablet_manager.cc:1403] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.418s	user 0.020s	sys 0.016s
I20260709 12:17:04.280752 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:04.291946 23999 catalog_manager.cc:5697] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 0 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:04.291622 24702 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:04.297453 24702 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:04.305691 24702 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.305064 24290 raft_consensus.cc:359] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.313138 24290 raft_consensus.cc:385] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.313482 24290 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.319844 24290 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.332101 24293 tablet_bootstrap.cc:654] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:04.349599 24703 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.362917 24290 ts_tablet_manager.cc:1434] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.003s
W20260709 12:17:04.394253 24141 consensus_peers.cc:597] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:04.408897 24290 tablet_bootstrap.cc:492] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Bootstrap starting.
I20260709 12:17:04.412426 24293 tablet_bootstrap.cc:492] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:04.413022 24293 ts_tablet_manager.cc:1403] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.172s	user 0.014s	sys 0.016s
I20260709 12:17:04.416225 24293 raft_consensus.cc:359] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.416987 24293 raft_consensus.cc:385] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.417264 24293 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.418102 24293 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.420792 24293 ts_tablet_manager.cc:1434] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
W20260709 12:17:04.433306 24141 consensus_peers.cc:597] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:04.434125 24293 tablet_bootstrap.cc:492] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:04.441718 24249 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.464988 23995 catalog_manager.cc:5697] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.467119 24290 tablet_bootstrap.cc:654] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:04.478974 24293 tablet_bootstrap.cc:654] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:04.482743 24702 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.485688 24702 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.489756 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:04.491165 24141 leader_election.cc:343] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.492168 24702 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:04.501509 24710 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.502341 24710 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.506156 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:04.507290 24101 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:04.510551 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:04.511489 24094 raft_consensus.cc:2393] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:04.514362 24140 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:04.512564 24615 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:17:04.518188 24710 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:04.525794 24664 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.526363 24664 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.528304 24293 tablet_bootstrap.cc:492] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:04.528927 24293 ts_tablet_manager.cc:1403] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.095s	user 0.012s	sys 0.002s
I20260709 12:17:04.518819 24702 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:04.530920 24702 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.531831 24702 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.523705 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:04.532498 24615 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:17:04.544124 24216 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:04.545624 24710 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.546429 24664 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:04.548789 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:04.551803 24290 tablet_bootstrap.cc:492] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: No bootstrap required, opened a new log
I20260709 12:17:04.552634 24290 ts_tablet_manager.cc:1403] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.012s
I20260709 12:17:04.556514 24290 raft_consensus.cc:359] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.557267 24290 raft_consensus.cc:385] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.557614 24290 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.558548 24290 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.559716 24293 raft_consensus.cc:359] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.561223 24293 raft_consensus.cc:385] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.561378 24616 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:04.563706 24293 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.564606 24293 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.567022 24293 ts_tablet_manager.cc:1434] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.002s
I20260709 12:17:04.568195 24293 tablet_bootstrap.cc:492] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:04.563279 24290 ts_tablet_manager.cc:1434] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:17:04.569324 24702 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.570914 24704 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.571445 24704 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.574138 24710 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:04.576400 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:04.579921 24216 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:04.582284 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:04.583050 24100 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.583959 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:04.584594 24101 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 0.
I20260709 12:17:04.585608 24710 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:04.588449 24704 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:04.584362 24293 tablet_bootstrap.cc:654] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:04.594455 24100 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:04.601156 24140 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:04.602774 24140 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:04.604045 24715 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:04.604553 24715 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:04.605445 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:04.608069 24141 leader_election.cc:343] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.605501 24715 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.606623 24703 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:17:04.611310 24703 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:04.611660 24703 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.607182 24702 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:04.619415 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:04.644826 24141 leader_election.cc:343] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.652087 24709 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.652761 24709 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.655193 24709 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:04.658507 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:04.659415 24100 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:04.671573 24709 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:04.668653 24703 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.674098 24703 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:04.671133 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 63724.9us
I20260709 12:17:04.680276 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:04.681865 24141 leader_election.cc:343] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:17:04.685992 24293 tablet_bootstrap.cc:492] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:04.686556 24293 ts_tablet_manager.cc:1403] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.119s	user 0.032s	sys 0.015s
I20260709 12:17:04.689273 24293 raft_consensus.cc:359] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.689647 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:04.690064 24293 raft_consensus.cc:385] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.690285 24099 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.690405 24293 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.686304 23999 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.696967 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:04.700575 24099 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:04.703274 24293 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.705989 24293 ts_tablet_manager.cc:1434] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 12:17:04.707078 24293 tablet_bootstrap.cc:492] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:04.713603 24293 tablet_bootstrap.cc:654] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:04.735499 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:04.736793 24483 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.740028 24140 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:04.740929 24703 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:17:04.754813 24703 raft_consensus.cc:697] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:04.758060 24703 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.790794 24729 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.796834 24483 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:04.830786 23999 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 0 to 1, leader changed from <none> to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:04.833752 24703 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.834883 24293 tablet_bootstrap.cc:492] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:04.847220 24293 ts_tablet_manager.cc:1403] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.140s	user 0.027s	sys 0.018s
I20260709 12:17:04.850885 24293 raft_consensus.cc:359] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.851145 24751 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:17:04.851788 24293 raft_consensus.cc:385] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.852169 24293 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.853111 24293 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.856086 24293 ts_tablet_manager.cc:1434] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:17:04.874735 24293 tablet_bootstrap.cc:492] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:04.890448 24293 tablet_bootstrap.cc:654] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:04.918476 24719 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:04.923391 24719 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.925869 24719 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:04.928638 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:04.934674 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:04.935652 24099 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:04.939288 24214 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:04.941088 24483 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:04.985904 24293 tablet_bootstrap.cc:492] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:04.985877 24483 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:04.986596 24293 ts_tablet_manager.cc:1403] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.112s	user 0.021s	sys 0.015s
I20260709 12:17:04.990031 24293 raft_consensus.cc:359] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.990849 24293 raft_consensus.cc:385] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:04.991187 24293 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:04.992033 24293 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:04.993765 24293 ts_tablet_manager.cc:1434] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:17:04.994925 24293 tablet_bootstrap.cc:492] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Bootstrap starting.
I20260709 12:17:05.004987 24293 tablet_bootstrap.cc:654] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Neither blocks nor log segments found. Creating new log.
I20260709 12:17:05.019013 24293 tablet_bootstrap.cc:492] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: No bootstrap required, opened a new log
I20260709 12:17:05.019619 24293 ts_tablet_manager.cc:1403] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.008s
I20260709 12:17:05.022976 24293 raft_consensus.cc:359] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:05.023802 24293 raft_consensus.cc:385] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:17:05.024135 24293 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Initialized, Role: FOLLOWER
I20260709 12:17:05.025133 24293 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:05.027741 24293 ts_tablet_manager.cc:1434] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:17:05.081007 24712 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:05.082856 24483 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.083441 24483 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:05.085788 24483 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:05.087803 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:05.103391 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:05.107260 24501 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:05.115043 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:05.115878 24729 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:05.141384 24483 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.141983 24483 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:05.145733 24483 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:05.147498 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:05.148403 24100 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 1: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:05.150764 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:05.155638 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:05.156430 24729 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.178853 24729 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:05.220986 24616 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:05.232407 24616 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:17:05.271343 24247 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.293517 24709 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:05.294232 24709 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:05.296573 24709 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:05.300145 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:05.305387 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:05.310913 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:05.311791 24719 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:17:05.486570 24247 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:17:05.547555 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:17:05.591526 24770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:05.629333 24769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:17:05.629916 24772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:17:05.635449 22903 server_base.cc:1061] running on GCE node
I20260709 12:17:05.637828 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:17:05.638168 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:17:05.638412 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599425638393 us; error 0 us; skew 500 ppm
I20260709 12:17:05.639401 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:17:05.645531 22903 webserver.cc:533] Webserver started at http://127.22.93.196:38455/ using document root <none> and password file <none>
I20260709 12:17:05.646338 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:17:05.646631 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:17:05.647225 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:17:05.649247 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-3-root/instance:
uuid: "c090031f610346ed82285cd847bca6d6"
format_stamp: "Formatted at 2026-07-09 12:17:05 on dist-test-slave-k289"
I20260709 12:17:05.660010 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.002s	sys 0.007s
I20260709 12:17:05.664578 24777 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:05.665642 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:17:05.665992 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-3-root
uuid: "c090031f610346ed82285cd847bca6d6"
format_stamp: "Formatted at 2026-07-09 12:17:05 on dist-test-slave-k289"
I20260709 12:17:05.666349 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:17:05.726784 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:17:05.728698 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:17:05.731021 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:17:05.734266 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:17:05.734551 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:17:05.734874 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:17:05.735169 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:17:05.888006 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.196:44187
I20260709 12:17:05.888172 24839 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.196:44187 every 8 connection(s)
I20260709 12:17:05.948734 22903 auto_leader_rebalancer-test.cc:439] add a tserver: c090031f610346ed82285cd847bca6d6
I20260709 12:17:05.965293 24840 heartbeater.cc:344] Connected to a master server at 127.22.93.254:36285
I20260709 12:17:05.965929 24840 heartbeater.cc:461] Registering TS with master...
I20260709 12:17:05.967049 24840 heartbeater.cc:507] Master 127.22.93.254:36285 requested a full tablet report, sending...
I20260709 12:17:05.969581 23999 ts_manager.cc:194] Registered new tserver with Master: c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:05.971684 23999 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43784
I20260709 12:17:06.073788 24250 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:06.111270 24173 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:06.115890 24095 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:06.117755 24729 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:17:06.122207 24709 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:06.158736 24215 consensus_peers.cc:597] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4b5c00e5364f4911a535f428ee9a0f9c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:06.166447 24709 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.176414 24095 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.202890 24247 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:06.217197 23999 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:06.236331 24215 consensus_peers.cc:597] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f9a75b1a807b49b791d2de5abd8f8ca1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:06.239435 24099 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:06.241160 24729 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:06.238125 24173 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.247618 24171 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:06.250840 24729 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.264487 24729 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.268054 24100 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.298535 24173 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.332034 24168 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:06.362959 23995 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.371618 24095 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.372117 24247 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:06.378306 24715 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.379462 24616 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:06.395908 24141 consensus_peers.cc:597] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e33dc2dd26074c7d8437ce5a91c0f8bf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:06.428395 24715 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.431329 24100 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.460990 24173 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:06.467216 24250 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.463758 23995 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 2 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.482565 24100 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:06.484347 24247 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:06.484248 24863 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:06.486312 24863 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:17:06.503976 24141 consensus_peers.cc:597] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 680463fca31f47d494316f240f1df66a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:06.532452 24715 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.542924 24099 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.559504 24247 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:06.586542 23997 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:06.637717 24867 ts_tablet_manager.cc:933] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:06.654877 24867 tablet_copy_client.cc:323] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:17:06.679526 24260 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet f9a75b1a807b49b791d2de5abd8f8ca1 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:17:06.680301 24260 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet f9a75b1a807b49b791d2de5abd8f8ca1 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-f9a75b1a807b49b791d2de5abd8f8ca1
I20260709 12:17:06.684392 24871 ts_tablet_manager.cc:933] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:06.690415 24260 tablet_copy_source_session.cc:215] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:06.695736 24867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9a75b1a807b49b791d2de5abd8f8ca1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:06.699726 24871 tablet_copy_client.cc:323] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:17:06.711692 24260 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 4b5c00e5364f4911a535f428ee9a0f9c from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:17:06.712263 24260 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 4b5c00e5364f4911a535f428ee9a0f9c from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-4b5c00e5364f4911a535f428ee9a0f9c
I20260709 12:17:06.719779 24260 tablet_copy_source_session.cc:215] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:06.724614 24871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b5c00e5364f4911a535f428ee9a0f9c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:06.753311 24867 tablet_copy_client.cc:806] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:06.754180 24867 tablet_copy_client.cc:670] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:06.763425 24871 tablet_copy_client.cc:806] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:06.764025 24871 tablet_copy_client.cc:670] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:06.782115 24867 tablet_copy_client.cc:538] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:06.786938 24871 tablet_copy_client.cc:538] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:06.803155 24871 tablet_bootstrap.cc:492] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:06.810739 24867 tablet_bootstrap.cc:492] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:06.863300 24871 tablet_bootstrap.cc:492] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:06.867120 24871 tablet_bootstrap.cc:492] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:06.868203 24871 ts_tablet_manager.cc:1403] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.020s
I20260709 12:17:06.873317 24871 raft_consensus.cc:359] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:06.874646 24871 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:06.875468 24871 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:06.876792 24867 tablet_bootstrap.cc:492] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:06.877894 24867 tablet_bootstrap.cc:492] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:06.878698 24867 ts_tablet_manager.cc:1403] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.068s	user 0.018s	sys 0.025s
I20260709 12:17:06.882268 24867 raft_consensus.cc:359] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:06.883282 24867 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:06.884024 24867 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:06.889703 24840 heartbeater.cc:499] Master 127.22.93.254:36285 was elected leader, sending a full tablet report...
I20260709 12:17:06.900957 24867 ts_tablet_manager.cc:1434] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 12:17:06.903053 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-f9a75b1a807b49b791d2de5abd8f8ca1 received from {username='slave'} at 127.0.0.1:59766
I20260709 12:17:06.903642 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-f9a75b1a807b49b791d2de5abd8f8ca1 on tablet f9a75b1a807b49b791d2de5abd8f8ca1 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:06.904326 24871 ts_tablet_manager.cc:1434] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 12:17:06.908843 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-4b5c00e5364f4911a535f428ee9a0f9c received from {username='slave'} at 127.0.0.1:59766
I20260709 12:17:06.909299 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-4b5c00e5364f4911a535f428ee9a0f9c on tablet 4b5c00e5364f4911a535f428ee9a0f9c with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:06.964900 24871 ts_tablet_manager.cc:933] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:06.969049 24871 tablet_copy_client.cc:323] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:17:06.989378 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet e33dc2dd26074c7d8437ce5a91c0f8bf from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:17:06.989992 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet e33dc2dd26074c7d8437ce5a91c0f8bf from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-e33dc2dd26074c7d8437ce5a91c0f8bf
I20260709 12:17:06.998246 24186 tablet_copy_source_session.cc:215] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:07.002306 24871 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e33dc2dd26074c7d8437ce5a91c0f8bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:07.017993 24871 tablet_copy_client.cc:806] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:07.018627 24871 tablet_copy_client.cc:670] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:07.022617 24871 tablet_copy_client.cc:538] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:07.024577 24867 ts_tablet_manager.cc:933] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:07.034149 24871 tablet_bootstrap.cc:492] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:07.040297 24867 tablet_copy_client.cc:323] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:17:07.042241 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet 680463fca31f47d494316f240f1df66a from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:17:07.042807 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet 680463fca31f47d494316f240f1df66a from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-680463fca31f47d494316f240f1df66a
I20260709 12:17:07.061480 24186 tablet_copy_source_session.cc:215] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:07.071581 24867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 680463fca31f47d494316f240f1df66a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:07.100962 24871 tablet_bootstrap.cc:492] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:07.102172 24871 tablet_bootstrap.cc:492] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:07.102967 24871 ts_tablet_manager.cc:1403] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.069s	user 0.022s	sys 0.004s
I20260709 12:17:07.110327 24871 raft_consensus.cc:359] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:07.111279 24867 tablet_copy_client.cc:806] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:07.124668 24867 tablet_copy_client.cc:670] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:07.112135 24871 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:07.128793 24871 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:07.135208 24867 tablet_copy_client.cc:538] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:07.136394 24871 ts_tablet_manager.cc:1434] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:17:07.141371 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-e33dc2dd26074c7d8437ce5a91c0f8bf received from {username='slave'} at 127.0.0.1:44066
I20260709 12:17:07.141860 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-e33dc2dd26074c7d8437ce5a91c0f8bf on tablet e33dc2dd26074c7d8437ce5a91c0f8bf with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:07.163945 24815 raft_consensus.cc:1217] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:07.168872 24867 tablet_bootstrap.cc:492] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:07.227641 24867 tablet_bootstrap.cc:492] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:07.228899 24867 tablet_bootstrap.cc:492] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:07.230891 24867 ts_tablet_manager.cc:1403] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.062s	user 0.022s	sys 0.007s
I20260709 12:17:07.234172 24867 raft_consensus.cc:359] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:07.235289 24867 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:07.236356 24867 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:07.239701 24867 ts_tablet_manager.cc:1434] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:07.242609 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-680463fca31f47d494316f240f1df66a received from {username='slave'} at 127.0.0.1:44066
I20260709 12:17:07.243142 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-680463fca31f47d494316f240f1df66a on tablet 680463fca31f47d494316f240f1df66a with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:07.247972 24815 raft_consensus.cc:1217] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:07.492664 24815 raft_consensus.cc:1217] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:17:07.559062 24815 raft_consensus.cc:1217] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:07.701865 24729 raft_consensus.cc:1064] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:07.705029 24729 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:07.790374 24709 raft_consensus.cc:1064] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:07.840018 24709 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:07.891564 24815 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:07.892254 24100 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:07.894232 24729 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:07.895149 24883 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:07.946182 24884 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:07.948071 24099 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:07.962585 24815 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:07.981459 23999 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:07.994436 24715 raft_consensus.cc:1064] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:07.997205 24715 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:08.014272 24170 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:08.020455 24814 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:08.022498 24729 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.032584 24250 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:08.032934 24812 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:08.036700 24099 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:08.037855 24751 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.038368 24709 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.063442 24715 raft_consensus.cc:1064] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:08.053717 24751 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:17:08.066200 24715 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:08.078061 24891 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:08.101989 24095 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:17:08.106570 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 59667.4us
I20260709 12:17:08.103613 24729 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:17:08.115181 24173 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:08.139235 24247 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:08.192080 24100 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:08.205802 24863 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.210767 24883 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.185788 24814 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:08.227427 24099 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.234712 24884 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
W20260709 12:17:08.248312 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44887.7us
I20260709 12:17:08.253968 23997 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.256497 24751 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:08.257058 24715 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:08.271719 24814 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.277330 24715 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.294154 24247 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.292236 24174 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.318162 24812 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.319455 24863 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:17:08.358680 24171 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.398904 24249 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:08.414135 24095 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.419759 24814 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.426867 24815 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:08.429445 24101 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:08.429934 24883 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:08.432406 24709 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:08.388249 24751 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.436884 24101 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.454808 24883 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.459125 24095 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.483273 24247 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.466795 23999 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.498175 24815 raft_consensus.cc:2955] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.503798 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f9a75b1a807b49b791d2de5abd8f8ca1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:08.435760 23995 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.620672 23999 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.634416 24171 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:08.642593 24815 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:08.644483 24751 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:08.654773 24895 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.664271 24812 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.662921 24174 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:08.687674 24249 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:08.690023 24751 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:08.698196 24101 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:08.699563 24249 raft_consensus.cc:2955] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.703302 24715 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:08.711881 24899 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.716355 23998 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.714603 24099 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.726155 24812 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:08.730788 24715 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:08.756608 24812 raft_consensus.cc:2955] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.769843 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e33dc2dd26074c7d8437ce5a91c0f8bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:08.799939 23997 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 2 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.815162 24247 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:08.822083 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet 680463fca31f47d494316f240f1df66a with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:37600
I20260709 12:17:08.826423 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet e33dc2dd26074c7d8437ce5a91c0f8bf with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40964
I20260709 12:17:08.848564 24812 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:08.853951 24910 tablet_replica.cc:333] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:17:08.854905 24883 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:08.869086 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet f9a75b1a807b49b791d2de5abd8f8ca1 with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59342
I20260709 12:17:08.872002 24910 raft_consensus.cc:2243] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:08.873190 24910 raft_consensus.cc:2272] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:08.862201 24911 tablet_replica.cc:333] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:17:08.865772 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 680463fca31f47d494316f240f1df66a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:08.874861 24174 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:08.877552 24883 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:08.898502 24910 ts_tablet_manager.cc:1916] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:08.900080 24812 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.892956 24709 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.908650 24174 raft_consensus.cc:2955] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.916342 24912 tablet_replica.cc:333] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:17:08.919411 24912 raft_consensus.cc:2243] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:08.920176 24912 raft_consensus.cc:2272] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:08.951365 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4b5c00e5364f4911a535f428ee9a0f9c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:08.963068 23997 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:08.965092 24910 ts_tablet_manager.cc:1929] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:08.965732 24910 log.cc:1199] T 680463fca31f47d494316f240f1df66a P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/680463fca31f47d494316f240f1df66a
I20260709 12:17:08.968045 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet 680463fca31f47d494316f240f1df66a (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:08.926132 24912 ts_tablet_manager.cc:1916] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:08.992352 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet 4b5c00e5364f4911a535f428ee9a0f9c with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37600
I20260709 12:17:08.993896 24910 tablet_replica.cc:333] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:17:09.001016 24911 raft_consensus.cc:2243] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.001989 24911 raft_consensus.cc:2272] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.006649 24911 ts_tablet_manager.cc:1916] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:09.009618 24910 raft_consensus.cc:2243] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:09.010619 24910 raft_consensus.cc:2272] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:09.013631 24910 ts_tablet_manager.cc:1916] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:09.035501 24911 ts_tablet_manager.cc:1929] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:17:09.036116 24911 log.cc:1199] T e33dc2dd26074c7d8437ce5a91c0f8bf P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/e33dc2dd26074c7d8437ce5a91c0f8bf
I20260709 12:17:09.037964 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet e33dc2dd26074c7d8437ce5a91c0f8bf (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:09.045066 24912 ts_tablet_manager.cc:1929] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:09.045552 24912 log.cc:1199] T f9a75b1a807b49b791d2de5abd8f8ca1 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/f9a75b1a807b49b791d2de5abd8f8ca1
I20260709 12:17:09.046842 24910 ts_tablet_manager.cc:1929] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:09.047287 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet f9a75b1a807b49b791d2de5abd8f8ca1 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:09.047436 24910 log.cc:1199] T 4b5c00e5364f4911a535f428ee9a0f9c P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/4b5c00e5364f4911a535f428ee9a0f9c
I20260709 12:17:09.049351 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet 4b5c00e5364f4911a535f428ee9a0f9c (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:10.139467 24174 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:10.158864 24250 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.159359 24095 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.161177 24715 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:10.162411 24141 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c07ef51fde0145f3ab7d32fa63626a55. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.163303 24915 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:17:10.180534 24916 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.184438 24101 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.194964 24249 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.256455 23997 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.304926 24101 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:10.343838 24171 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.350365 24598 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:17:10.353642 24249 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.355638 24889 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:10.364552 24889 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.369024 24171 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
W20260709 12:17:10.381260 24066 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07fcc70b8c0d43ae8334ea802c9a9924. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.396915 24249 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:10.396740 24245 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.436731 23996 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.446826 24171 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:10.450393 24215 consensus_peers.cc:597] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 683c964dc5814af698a7b4af6649e9ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.451995 24917 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:10.450217 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47822us
I20260709 12:17:10.463114 24095 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.467514 24709 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:10.490796 24709 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.524454 24169 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.574613 24101 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.584937 24174 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:10.590852 23996 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:10.617825 24940 ts_tablet_manager.cc:933] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:10.630859 24940 tablet_copy_client.cc:323] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:17:10.635546 24245 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.635673 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet c07ef51fde0145f3ab7d32fa63626a55 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:17:10.636407 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet c07ef51fde0145f3ab7d32fa63626a55 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-c07ef51fde0145f3ab7d32fa63626a55
I20260709 12:17:10.640154 24924 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:10.649030 24141 consensus_peers.cc:597] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 882bb02a9e9e423bbbc4df3dd0c55540. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:10.653578 24186 tablet_copy_source_session.cc:215] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:10.666604 24940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c07ef51fde0145f3ab7d32fa63626a55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.671692 24094 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:10.675978 24895 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:10.723694 24895 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.732581 24094 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.739657 24245 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.752586 24940 tablet_copy_client.cc:806] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:10.753443 24940 tablet_copy_client.cc:670] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:10.757917 24940 tablet_copy_client.cc:538] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:10.765057 23996 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:10.770115 24940 tablet_bootstrap.cc:492] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:10.821050 24940 tablet_bootstrap.cc:492] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:10.822126 24940 tablet_bootstrap.cc:492] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:10.822885 24940 ts_tablet_manager.cc:1403] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.021s
I20260709 12:17:10.826332 24940 raft_consensus.cc:359] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:10.827304 24940 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:10.828269 24940 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:10.833261 24940 ts_tablet_manager.cc:1434] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:17:10.835597 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-c07ef51fde0145f3ab7d32fa63626a55 received from {username='slave'} at 127.0.0.1:44066
I20260709 12:17:10.836053 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-c07ef51fde0145f3ab7d32fa63626a55 on tablet c07ef51fde0145f3ab7d32fa63626a55 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:10.905086 24940 ts_tablet_manager.cc:933] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:10.916288 24940 tablet_copy_client.cc:323] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:17:10.918681 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 683c964dc5814af698a7b4af6649e9ed from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:17:10.919371 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 683c964dc5814af698a7b4af6649e9ed from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-683c964dc5814af698a7b4af6649e9ed
I20260709 12:17:10.928342 24259 tablet_copy_source_session.cc:215] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:10.932782 24940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 683c964dc5814af698a7b4af6649e9ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:10.944509 24949 ts_tablet_manager.cc:933] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:17:10.960793 24949 tablet_copy_client.cc:323] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
I20260709 12:17:10.978263 24940 tablet_copy_client.cc:806] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:10.979106 24940 tablet_copy_client.cc:670] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:10.984946 24940 tablet_copy_client.cc:538] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:11.001368 24940 tablet_bootstrap.cc:492] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:11.027792 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet 07fcc70b8c0d43ae8334ea802c9a9924 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:17:11.028568 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet 07fcc70b8c0d43ae8334ea802c9a9924 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-07fcc70b8c0d43ae8334ea802c9a9924
I20260709 12:17:11.040846 24111 tablet_copy_source_session.cc:215] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:11.042629 24940 tablet_bootstrap.cc:492] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:11.044737 24940 tablet_bootstrap.cc:492] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:11.045619 24940 ts_tablet_manager.cc:1403] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.007s
I20260709 12:17:11.049804 24949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07fcc70b8c0d43ae8334ea802c9a9924. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.049244 24940 raft_consensus.cc:359] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:11.059882 24940 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:11.060823 24940 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:11.063431 24940 ts_tablet_manager.cc:1434] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260709 12:17:11.065281 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-683c964dc5814af698a7b4af6649e9ed received from {username='slave'} at 127.0.0.1:59766
I20260709 12:17:11.065737 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-683c964dc5814af698a7b4af6649e9ed on tablet 683c964dc5814af698a7b4af6649e9ed with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:11.082234 24949 tablet_copy_client.cc:806] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:11.082933 24949 tablet_copy_client.cc:670] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:11.087488 24949 tablet_copy_client.cc:538] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:11.109186 24815 raft_consensus.cc:1217] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:11.109309 24949 tablet_bootstrap.cc:492] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:11.157577 24940 ts_tablet_manager.cc:933] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:11.197134 24949 tablet_bootstrap.cc:492] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:11.198313 24949 tablet_bootstrap.cc:492] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:11.199172 24949 ts_tablet_manager.cc:1403] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.090s	user 0.024s	sys 0.046s
I20260709 12:17:11.202652 24949 raft_consensus.cc:359] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:11.203665 24949 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:11.204435 24949 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:11.207358 24949 ts_tablet_manager.cc:1434] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:17:11.209233 24111 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-07fcc70b8c0d43ae8334ea802c9a9924 received from {username='slave'} at 127.0.0.1:50598
I20260709 12:17:11.209687 24111 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-07fcc70b8c0d43ae8334ea802c9a9924 on tablet 07fcc70b8c0d43ae8334ea802c9a9924 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:11.248057 24940 tablet_copy_client.cc:323] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:17:11.259204 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet 882bb02a9e9e423bbbc4df3dd0c55540 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:17:11.259881 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet 882bb02a9e9e423bbbc4df3dd0c55540 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-882bb02a9e9e423bbbc4df3dd0c55540
I20260709 12:17:11.283577 24186 tablet_copy_source_session.cc:215] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:11.287411 24940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 882bb02a9e9e423bbbc4df3dd0c55540. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:11.310604 24940 tablet_copy_client.cc:806] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:11.311296 24940 tablet_copy_client.cc:670] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:11.316159 24940 tablet_copy_client.cc:538] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:11.331362 24940 tablet_bootstrap.cc:492] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:11.359206 24940 tablet_bootstrap.cc:492] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:11.360405 24940 tablet_bootstrap.cc:492] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:11.361161 24940 ts_tablet_manager.cc:1403] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.002s
I20260709 12:17:11.367447 24940 raft_consensus.cc:359] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:11.369222 24940 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:11.369879 24940 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:11.372252 24940 ts_tablet_manager.cc:1434] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:17:11.374563 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-882bb02a9e9e423bbbc4df3dd0c55540 received from {username='slave'} at 127.0.0.1:44066
I20260709 12:17:11.375128 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-882bb02a9e9e423bbbc4df3dd0c55540 on tablet 882bb02a9e9e423bbbc4df3dd0c55540 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:11.382804 24815 raft_consensus.cc:1217] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:11.442070 24815 raft_consensus.cc:1217] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:11.546241 24715 raft_consensus.cc:1064] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:11.549069 24715 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:11.598706 24249 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.598773 24815 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.601590 24895 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.603382 24895 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.615664 24099 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.619133 24715 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.635082 24943 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:11.641685 24095 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:11.645040 24815 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:11.662544 23996 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:11.688407 24249 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:11.734481 24812 raft_consensus.cc:1217] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:11.787451 24174 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:11.797824 24099 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:11.800719 24815 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:11.802449 24964 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.804607 24943 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:11.818480 24883 raft_consensus.cc:1064] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:11.852072 24943 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:11.822281 24883 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:11.860407 24095 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:11.903050 24099 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.903945 24812 raft_consensus.cc:2955] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:11.905766 24883 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:11.911628 24938 raft_consensus.cc:1064] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:11.915100 24814 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.917229 24938 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:11.919231 24883 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.939034 24171 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.951177 24815 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.952809 24245 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.953470 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c07ef51fde0145f3ab7d32fa63626a55 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:11.955140 24889 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:11.957278 24889 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:11.968952 23997 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:11.978451 24955 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:11.981978 24174 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:11.984460 24938 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:17:12.005033 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet c07ef51fde0145f3ab7d32fa63626a55 with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40964
I20260709 12:17:12.039378 24973 tablet_replica.cc:333] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:17:12.040858 24973 raft_consensus.cc:2243] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:12.041774 24973 raft_consensus.cc:2272] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:12.044910 24958 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.054600 24815 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.056458 24883 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.058615 24812 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.071822 24099 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.060695 24174 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.099618 24973 ts_tablet_manager.cc:1916] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:12.113020 24173 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.136598 24943 raft_consensus.cc:1064] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:12.141348 24245 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.146900 23995 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.146173 24943 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:12.158238 24973 ts_tablet_manager.cc:1929] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:12.159037 24973 log.cc:1199] T c07ef51fde0145f3ab7d32fa63626a55 P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/c07ef51fde0145f3ab7d32fa63626a55
I20260709 12:17:12.161525 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet c07ef51fde0145f3ab7d32fa63626a55 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:12.172104 24247 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:12.180269 24815 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.187451 24955 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:12.187781 24173 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.194794 24939 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:12.203063 24917 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.209435 24815 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.220620 24173 raft_consensus.cc:2955] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.231083 23995 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.248131 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 683c964dc5814af698a7b4af6649e9ed with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:12.250813 24812 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:12.254837 24964 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:12.256575 24245 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:12.259234 24967 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:12.261031 24101 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:12.270596 24967 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:12.286963 24099 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:12.298337 24814 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.300760 24245 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.302294 24938 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:12.310297 24938 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:12.327795 24815 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.335218 24247 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.336694 24938 raft_consensus.cc:2955] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.352785 23995 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:12.373284 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet 683c964dc5814af698a7b4af6649e9ed with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37600
I20260709 12:17:12.397375 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 07fcc70b8c0d43ae8334ea802c9a9924 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:12.407788 24924 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.394253 23997 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.415328 24812 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.429508 24247 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.437384 24981 tablet_replica.cc:333] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:17:12.438657 24981 raft_consensus.cc:2243] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:12.439533 24981 raft_consensus.cc:2272] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:12.447716 24101 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.449923 23998 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:12.468803 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet 07fcc70b8c0d43ae8334ea802c9a9924 with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59342
I20260709 12:17:12.480019 24981 ts_tablet_manager.cc:1916] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:12.490217 24174 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:12.492100 24982 tablet_replica.cc:333] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:17:12.498478 24812 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.504374 24964 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:12.517885 24943 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.529688 24812 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.542009 24099 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:12.543134 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 882bb02a9e9e423bbbc4df3dd0c55540 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:12.551273 24981 ts_tablet_manager.cc:1929] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:12.551903 24981 log.cc:1199] T 683c964dc5814af698a7b4af6649e9ed P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/683c964dc5814af698a7b4af6649e9ed
I20260709 12:17:12.553910 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet 683c964dc5814af698a7b4af6649e9ed (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:12.555703 24924 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:12.559128 24982 raft_consensus.cc:2243] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:12.565891 24982 raft_consensus.cc:2272] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:12.559939 23996 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:12.567837 24101 raft_consensus.cc:2955] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:12.571996 24982 ts_tablet_manager.cc:1916] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:12.599138 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet 882bb02a9e9e423bbbc4df3dd0c55540 with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40964
I20260709 12:17:12.600322 24973 tablet_replica.cc:333] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:17:12.601662 24973 raft_consensus.cc:2243] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:12.602571 24973 raft_consensus.cc:2272] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:12.606685 24973 ts_tablet_manager.cc:1916] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:12.642290 24982 ts_tablet_manager.cc:1929] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:12.642902 24982 log.cc:1199] T 07fcc70b8c0d43ae8334ea802c9a9924 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/07fcc70b8c0d43ae8334ea802c9a9924
I20260709 12:17:12.644738 24973 ts_tablet_manager.cc:1929] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:12.644804 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet 07fcc70b8c0d43ae8334ea802c9a9924 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:12.645412 24973 log.cc:1199] T 882bb02a9e9e423bbbc4df3dd0c55540 P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/882bb02a9e9e423bbbc4df3dd0c55540
I20260709 12:17:12.647234 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet 882bb02a9e9e423bbbc4df3dd0c55540 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:13.709972 24246 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:13.719010 24174 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:13.719485 24215 consensus_peers.cc:597] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4e320f288fdb4be0ada8bfff79b41a9a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.719460 24101 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:13.720628 24984 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:13.721741 24917 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.735075 24939 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:13.737234 24101 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:13.741391 24174 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:13.758412 24170 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:13.766908 23997 catalog_manager.cc:5697] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:13.807402 24101 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:13.807387 24141 consensus_peers.cc:597] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9dd67e018d26493bae6d921a57dfc306. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.809181 24715 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:13.837668 24924 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:13.839692 24094 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:13.852561 24246 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:13.861654 24246 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:13.869483 24715 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:13.887079 24215 consensus_peers.cc:597] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 010e8fce74be491b8432c9ea63b75515. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:13.890542 24101 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:13.893790 24984 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:13.897696 24170 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:13.919734 24247 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
W20260709 12:17:13.943084 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44766us
I20260709 12:17:13.951297 24917 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:13.960198 24939 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:13.988903 24099 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
W20260709 12:17:14.029992 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 77901.9us
I20260709 12:17:14.031591 24099 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:14.047427 23997 catalog_manager.cc:5697] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:14.049510 23997 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:14.056318 24247 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:14.058163 24938 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:17:14.062189 24066 consensus_peers.cc:597] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f5cb153ce4e4ac387672e2345a08fa5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:14.074570 24170 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:17:14.082855 24938 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:17:14.104436 24598 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
W20260709 12:17:14.120934 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55492.7us
I20260709 12:17:14.122574 24248 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:14.132296 24170 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:14.165968 24174 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:14.182480 23997 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 3, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:14.293721 25009 ts_tablet_manager.cc:933] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:14.303340 25010 ts_tablet_manager.cc:933] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:14.313527 25010 tablet_copy_client.cc:323] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:17:14.315522 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet 9dd67e018d26493bae6d921a57dfc306 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:17:14.316140 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet 9dd67e018d26493bae6d921a57dfc306 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-9dd67e018d26493bae6d921a57dfc306
I20260709 12:17:14.318186 25009 tablet_copy_client.cc:323] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:17:14.320305 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 4e320f288fdb4be0ada8bfff79b41a9a from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:17:14.320875 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 4e320f288fdb4be0ada8bfff79b41a9a from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-4e320f288fdb4be0ada8bfff79b41a9a
I20260709 12:17:14.327164 24186 tablet_copy_source_session.cc:215] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:14.332404 25010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9dd67e018d26493bae6d921a57dfc306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:14.334750 24259 tablet_copy_source_session.cc:215] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:14.361544 25009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e320f288fdb4be0ada8bfff79b41a9a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:14.371939 25010 tablet_copy_client.cc:806] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:14.372849 25010 tablet_copy_client.cc:670] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:14.378640 25013 ts_tablet_manager.cc:933] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:14.379078 25010 tablet_copy_client.cc:538] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:14.397429 25010 tablet_bootstrap.cc:492] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:14.398557 25013 tablet_copy_client.cc:323] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:17:14.400528 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 010e8fce74be491b8432c9ea63b75515 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:17:14.401103 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 010e8fce74be491b8432c9ea63b75515 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-010e8fce74be491b8432c9ea63b75515
I20260709 12:17:14.410188 25009 tablet_copy_client.cc:806] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:14.410975 25009 tablet_copy_client.cc:670] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:14.411087 24259 tablet_copy_source_session.cc:215] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:14.417972 25013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 010e8fce74be491b8432c9ea63b75515. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:14.425887 25009 tablet_copy_client.cc:538] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:14.442128 25015 ts_tablet_manager.cc:933] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:17:14.450155 25009 tablet_bootstrap.cc:492] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:14.457438 25010 tablet_bootstrap.cc:492] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:14.458638 25010 tablet_bootstrap.cc:492] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:14.459474 25010 ts_tablet_manager.cc:1403] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.062s	user 0.023s	sys 0.006s
I20260709 12:17:14.463002 25010 raft_consensus.cc:359] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:14.463927 25010 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:14.464635 25010 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:14.469789 25015 tablet_copy_client.cc:323] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
I20260709 12:17:14.472046 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet 6f5cb153ce4e4ac387672e2345a08fa5 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:17:14.472647 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet 6f5cb153ce4e4ac387672e2345a08fa5 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-6f5cb153ce4e4ac387672e2345a08fa5
I20260709 12:17:14.481316 24111 tablet_copy_source_session.cc:215] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:14.484982 25010 ts_tablet_manager.cc:1434] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.000s
I20260709 12:17:14.490907 25015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f5cb153ce4e4ac387672e2345a08fa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:14.502903 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-9dd67e018d26493bae6d921a57dfc306 received from {username='slave'} at 127.0.0.1:44066
I20260709 12:17:14.503537 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-9dd67e018d26493bae6d921a57dfc306 on tablet 9dd67e018d26493bae6d921a57dfc306 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:14.523417 25013 tablet_copy_client.cc:806] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:14.524168 25013 tablet_copy_client.cc:670] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:14.533170 25013 tablet_copy_client.cc:538] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:14.542335 25015 tablet_copy_client.cc:806] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:14.545861 25015 tablet_copy_client.cc:670] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:14.554366 25015 tablet_copy_client.cc:538] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:14.563102 25009 tablet_bootstrap.cc:492] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:14.564227 25009 tablet_bootstrap.cc:492] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:14.565049 25009 ts_tablet_manager.cc:1403] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.021s
I20260709 12:17:14.569562 25009 raft_consensus.cc:359] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:14.570441 25009 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:14.571162 25009 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:14.574030 25009 ts_tablet_manager.cc:1434] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:17:14.575764 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-4e320f288fdb4be0ada8bfff79b41a9a received from {username='slave'} at 127.0.0.1:59766
I20260709 12:17:14.576290 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-4e320f288fdb4be0ada8bfff79b41a9a on tablet 4e320f288fdb4be0ada8bfff79b41a9a with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:14.579947 25013 tablet_bootstrap.cc:492] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:14.586941 25015 tablet_bootstrap.cc:492] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:14.627933 25013 tablet_bootstrap.cc:492] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:14.629096 25013 tablet_bootstrap.cc:492] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:14.629866 25013 ts_tablet_manager.cc:1403] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.050s	user 0.026s	sys 0.005s
I20260709 12:17:14.630136 25015 tablet_bootstrap.cc:492] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:14.632488 25015 tablet_bootstrap.cc:492] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:14.633302 25015 ts_tablet_manager.cc:1403] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.020s
I20260709 12:17:14.633455 25013 raft_consensus.cc:359] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:14.634642 25013 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:14.635466 25013 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:14.640116 25013 ts_tablet_manager.cc:1434] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:17:14.641909 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-010e8fce74be491b8432c9ea63b75515 received from {username='slave'} at 127.0.0.1:59766
I20260709 12:17:14.642627 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-010e8fce74be491b8432c9ea63b75515 on tablet 010e8fce74be491b8432c9ea63b75515 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:14.641906 25015 raft_consensus.cc:359] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:14.643271 25015 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:14.644591 25015 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:14.647518 25015 ts_tablet_manager.cc:1434] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:17:14.652837 24111 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-6f5cb153ce4e4ac387672e2345a08fa5 received from {username='slave'} at 127.0.0.1:50598
I20260709 12:17:14.653302 24111 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-6f5cb153ce4e4ac387672e2345a08fa5 on tablet 6f5cb153ce4e4ac387672e2345a08fa5 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:14.682703 24812 raft_consensus.cc:1217] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:14.829860 24812 raft_consensus.cc:1217] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:14.850350 24812 raft_consensus.cc:1217] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:14.996745 24815 raft_consensus.cc:1217] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:17:15.173362 25003 raft_consensus.cc:1064] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:15.176443 25003 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:15.185237 24170 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.186039 24815 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.186842 25003 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:15.188762 24100 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.188712 24988 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:15.191409 24988 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.212157 24988 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.214179 24815 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.217859 24101 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.227881 24170 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.233453 23997 catalog_manager.cc:5697] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.274322 24248 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:15.282311 24983 raft_consensus.cc:1064] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:15.285436 24983 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:15.291273 24101 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.292136 24815 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.294000 25003 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:15.296511 24939 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.322646 25022 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.334759 24815 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.338749 24101 raft_consensus.cc:2955] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.351251 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4e320f288fdb4be0ada8bfff79b41a9a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:15.361158 23998 catalog_manager.cc:5697] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.362738 24100 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.365789 24983 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.371660 24812 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.380724 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet 4e320f288fdb4be0ada8bfff79b41a9a with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59342
I20260709 12:17:15.382942 25023 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:15.397691 24248 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.400036 25022 raft_consensus.cc:1064] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:15.407223 25022 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:15.416517 24983 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.419605 24814 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.421226 24939 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.423256 24174 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.432457 24939 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:15.461251 24983 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.473871 24248 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.476171 24101 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.492869 23995 catalog_manager.cc:5697] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.508348 25003 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.510352 24099 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:15.523882 24814 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.534294 24988 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:15.536121 24812 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.540746 25034 tablet_replica.cc:333] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:17:15.542375 25034 raft_consensus.cc:2243] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.543220 25034 raft_consensus.cc:2272] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.550784 25034 ts_tablet_manager.cc:1916] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:15.555655 24170 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.566114 24174 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:15.566903 23995 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.576434 24101 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.581779 25023 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.588101 25034 ts_tablet_manager.cc:1929] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:15.588618 25034 log.cc:1199] T 4e320f288fdb4be0ada8bfff79b41a9a P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/4e320f288fdb4be0ada8bfff79b41a9a
I20260709 12:17:15.598268 24983 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.607883 24938 raft_consensus.cc:1064] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:15.615362 24101 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.621060 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet 4e320f288fdb4be0ada8bfff79b41a9a (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:15.623018 24938 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:15.631781 24812 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.633503 25023 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.641364 24812 raft_consensus.cc:2955] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.643392 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9dd67e018d26493bae6d921a57dfc306 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:15.651993 24248 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:15.658524 24814 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.663015 25003 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.667558 23998 catalog_manager.cc:5697] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:15.671370 25035 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.679613 24247 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:15.687247 25002 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:15.688545 24812 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.679613 24814 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:15.705020 24171 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:15.707635 25002 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:15.708750 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet 9dd67e018d26493bae6d921a57dfc306 with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40964
I20260709 12:17:15.706604 24094 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.711024 25047 tablet_replica.cc:333] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:17:15.712159 25047 raft_consensus.cc:2243] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.712996 25047 raft_consensus.cc:2272] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.734586 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 010e8fce74be491b8432c9ea63b75515 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:15.739107 25041 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:15.740362 23997 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.741529 25047 ts_tablet_manager.cc:1916] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:15.750731 24174 raft_consensus.cc:2955] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.769268 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet 010e8fce74be491b8432c9ea63b75515 with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37600
I20260709 12:17:15.791689 25052 tablet_replica.cc:333] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:17:15.800761 25052 raft_consensus.cc:2243] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:15.801626 25047 ts_tablet_manager.cc:1929] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:15.802218 25047 log.cc:1199] T 9dd67e018d26493bae6d921a57dfc306 P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/9dd67e018d26493bae6d921a57dfc306
I20260709 12:17:15.805219 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet 9dd67e018d26493bae6d921a57dfc306 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:15.806257 25052 raft_consensus.cc:2272] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:15.810348 25052 ts_tablet_manager.cc:1916] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:15.833114 25048 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.838042 24174 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:17:15.842024 24814 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.844050 25046 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:15.863425 24247 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.876622 23995 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 3 to 4, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:15.890945 24174 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.901554 25052 ts_tablet_manager.cc:1929] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:15.904728 24094 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:15.903622 25052 log.cc:1199] T 010e8fce74be491b8432c9ea63b75515 P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/010e8fce74be491b8432c9ea63b75515
I20260709 12:17:15.953164 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet 010e8fce74be491b8432c9ea63b75515 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
W20260709 12:17:15.958451 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47780us
I20260709 12:17:15.966116 24247 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:15.972712 25046 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:15.976804 24814 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:15.982056 25044 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:15.983018 25046 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.986686 24812 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:15.996325 24250 raft_consensus.cc:2955] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:16.016613 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6f5cb153ce4e4ac387672e2345a08fa5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:16.017613 23998 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 4 to 5, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:16.044698 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet 6f5cb153ce4e4ac387672e2345a08fa5 with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:59342
I20260709 12:17:16.045842 25034 tablet_replica.cc:333] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:17:16.047056 25034 raft_consensus.cc:2243] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:16.047799 25034 raft_consensus.cc:2272] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:16.052663 25034 ts_tablet_manager.cc:1916] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:16.068967 25034 ts_tablet_manager.cc:1929] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:17:16.069327 25034 log.cc:1199] T 6f5cb153ce4e4ac387672e2345a08fa5 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/6f5cb153ce4e4ac387672e2345a08fa5
I20260709 12:17:16.071034 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet 6f5cb153ce4e4ac387672e2345a08fa5 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:17.113354 24094 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.122427 24174 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:17.123730 24066 consensus_peers.cc:597] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2152258f0d654836a042cc0cf00d66a3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:17.124101 24250 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:17.124498 25059 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.125995 25046 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.135000 25059 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.136878 24174 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.141772 24247 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.154095 24169 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.168773 23997 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:17.217527 24247 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:17.218423 24141 consensus_peers.cc:597] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a36a91a0b5548f28dd004a49f5cac15. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:17.221055 24924 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.224421 24094 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:17.227201 25057 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.233521 25057 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.236229 24247 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.263485 24100 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.269182 24099 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.279202 24245 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:17.282063 24174 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:17.285392 24066 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d84a44368371490a8287d9cb8d1620d0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:17.286005 25060 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:17.288887 25046 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.301481 25060 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.296509 23995 catalog_manager.cc:5697] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.305510 24174 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.315495 24245 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.344533 23998 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.345731 24247 consensus_queue.cc:237] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.375739 24174 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:17.376564 24099 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:17.376643 24215 consensus_peers.cc:597] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2391737d1a8643bd885a4db57ceba96c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:17.378298 25003 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.379710 25064 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:17.390692 25003 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.392519 24174 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.394052 24100 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.417975 23997 catalog_manager.cc:5697] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:17.635692 25079 ts_tablet_manager.cc:933] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:17:17.637905 25079 tablet_copy_client.cc:323] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
I20260709 12:17:17.639674 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet 2152258f0d654836a042cc0cf00d66a3 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:17:17.640259 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet 2152258f0d654836a042cc0cf00d66a3 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-2152258f0d654836a042cc0cf00d66a3
I20260709 12:17:17.648902 24111 tablet_copy_source_session.cc:215] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.654374 25079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2152258f0d654836a042cc0cf00d66a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.674579 25079 tablet_copy_client.cc:806] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.675294 25079 tablet_copy_client.cc:670] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.684124 25079 tablet_copy_client.cc:538] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.695094 25079 tablet_bootstrap.cc:492] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:17.719630 25079 tablet_bootstrap.cc:492] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.720798 25079 tablet_bootstrap.cc:492] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:17.721633 25079 ts_tablet_manager.cc:1403] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.007s
I20260709 12:17:17.725555 25079 raft_consensus.cc:359] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.726545 25079 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:17.727334 25079 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.734462 25082 ts_tablet_manager.cc:933] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:17:17.746076 25079 ts_tablet_manager.cc:1434] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.024s	user 0.000s	sys 0.013s
I20260709 12:17:17.758947 25082 tablet_copy_client.cc:323] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
I20260709 12:17:17.761261 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet d84a44368371490a8287d9cb8d1620d0 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:17:17.761838 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet d84a44368371490a8287d9cb8d1620d0 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-d84a44368371490a8287d9cb8d1620d0
I20260709 12:17:17.769383 24110 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-2152258f0d654836a042cc0cf00d66a3 received from {username='slave'} at 127.0.0.1:50598
I20260709 12:17:17.769896 24110 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-2152258f0d654836a042cc0cf00d66a3 on tablet 2152258f0d654836a042cc0cf00d66a3 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:17.785326 25079 ts_tablet_manager.cc:933] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:17.785414 24111 tablet_copy_source_session.cc:215] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.789255 25082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d84a44368371490a8287d9cb8d1620d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.790807 25079 tablet_copy_client.cc:323] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:17:17.793735 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet 0a36a91a0b5548f28dd004a49f5cac15 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:17:17.794339 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet 0a36a91a0b5548f28dd004a49f5cac15 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-0a36a91a0b5548f28dd004a49f5cac15
I20260709 12:17:17.804500 24186 tablet_copy_source_session.cc:215] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.809163 25079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a36a91a0b5548f28dd004a49f5cac15. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.815935 25082 tablet_copy_client.cc:806] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.816728 25082 tablet_copy_client.cc:670] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.818197 25086 ts_tablet_manager.cc:933] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:17.828583 25082 tablet_copy_client.cc:538] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.830844 25086 tablet_copy_client.cc:323] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:17:17.832787 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 2391737d1a8643bd885a4db57ceba96c from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:17:17.833374 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 2391737d1a8643bd885a4db57ceba96c from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-2391737d1a8643bd885a4db57ceba96c
I20260709 12:17:17.840401 25082 tablet_bootstrap.cc:492] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:17.845104 24259 tablet_copy_source_session.cc:215] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:17.852182 25086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2391737d1a8643bd885a4db57ceba96c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:17.877810 25086 tablet_copy_client.cc:806] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.878772 25086 tablet_copy_client.cc:670] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.884236 25086 tablet_copy_client.cc:538] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.888386 25079 tablet_copy_client.cc:806] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:17.889086 25079 tablet_copy_client.cc:670] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:17.890609 25082 tablet_bootstrap.cc:492] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.892308 25082 tablet_bootstrap.cc:492] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:17.893191 25082 ts_tablet_manager.cc:1403] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.013s
I20260709 12:17:17.896159 25079 tablet_copy_client.cc:538] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:17.903415 25082 raft_consensus.cc:359] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.906950 25082 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:17.912006 25086 tablet_bootstrap.cc:492] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:17.910018 25082 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.920876 25082 ts_tablet_manager.cc:1434] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.027s	user 0.000s	sys 0.012s
I20260709 12:17:17.922648 25079 tablet_bootstrap.cc:492] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:17.923087 24111 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-d84a44368371490a8287d9cb8d1620d0 received from {username='slave'} at 127.0.0.1:50598
I20260709 12:17:17.925800 24111 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-d84a44368371490a8287d9cb8d1620d0 on tablet d84a44368371490a8287d9cb8d1620d0 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:17.953835 25079 tablet_bootstrap.cc:492] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.958863 25079 tablet_bootstrap.cc:492] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:17.959751 25079 ts_tablet_manager.cc:1403] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.007s
I20260709 12:17:17.962647 25079 raft_consensus.cc:359] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.963614 25079 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:17.964330 25079 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.966405 25079 ts_tablet_manager.cc:1434] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:17:17.968879 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-0a36a91a0b5548f28dd004a49f5cac15 received from {username='slave'} at 127.0.0.1:44066
I20260709 12:17:17.969362 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-0a36a91a0b5548f28dd004a49f5cac15 on tablet 0a36a91a0b5548f28dd004a49f5cac15 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:17.970238 25086 tablet_bootstrap.cc:492] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:17.971259 25086 tablet_bootstrap.cc:492] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:17.972440 25086 ts_tablet_manager.cc:1403] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.061s	user 0.021s	sys 0.010s
I20260709 12:17:17.980252 25086 raft_consensus.cc:359] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.981232 25086 raft_consensus.cc:740] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:17.981950 25086 consensus_queue.cc:260] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:17.984602 25086 ts_tablet_manager.cc:1434] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:17:17.986375 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-2391737d1a8643bd885a4db57ceba96c received from {username='slave'} at 127.0.0.1:59766
I20260709 12:17:17.986841 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-2391737d1a8643bd885a4db57ceba96c on tablet 2391737d1a8643bd885a4db57ceba96c with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:18.079653 24814 raft_consensus.cc:1217] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:18.139863 24814 raft_consensus.cc:1217] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:18.312656 24814 raft_consensus.cc:1217] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:18.366537 24814 raft_consensus.cc:1217] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:18.655563 25060 raft_consensus.cc:1064] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:18.657857 25060 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:18.664908 24814 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.671746 24174 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.672423 25059 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.675565 24250 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.675905 25092 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.682858 25059 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.694779 25054 raft_consensus.cc:1064] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:18.700027 25054 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:18.711330 25092 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:18.715221 24245 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:18.754846 24812 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.754086 24174 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:18.759312 24247 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.774262 24924 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.780233 24812 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:18.785848 24099 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.789505 25093 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.800328 25093 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:18.808386 25060 raft_consensus.cc:1064] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:18.825678 25060 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:18.840354 23998 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:18.881685 24812 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.885494 25098 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.888113 24171 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.890254 25059 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:18.910471 25057 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:18.949200 24245 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:17:18.975497 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 59856us
I20260709 12:17:18.993408 25077 raft_consensus.cc:1064] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:18.995514 24250 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:18.997403 25108 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:19.012081 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:19.012501 25077 consensus_queue.cc:237] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:19.018141 24250 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.023295 25108 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.043689 24812 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.057104 24814 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.061223 24812 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:19.062354 24094 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:19.062718 25078 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:19.064654 25077 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:19.089586 25078 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.091094 24099 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.091908 24095 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.104537 24815 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.117616 24174 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.123821 24171 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:19.131623 24099 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:19.134356 25078 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:19.138566 23995 catalog_manager.cc:5697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.143338 23995 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.144501 24815 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:19.151796 25108 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:19.164891 24174 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:19.163851 25108 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.166335 23997 catalog_manager.cc:5697] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.190541 25106 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:19.195467 24094 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:19.195793 24169 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.203549 24814 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:19.203708 24245 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:19.208945 25060 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:19.193061 24815 raft_consensus.cc:2955] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.203887 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2152258f0d654836a042cc0cf00d66a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:19.213598 24171 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.210811 25060 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:17:19.231295 25106 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.239873 24174 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:19.242517 24814 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.247995 24812 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:19.248250 24245 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:19.244597 24250 raft_consensus.cc:2955] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.250034 24924 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:19.247300 23997 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:19.255087 25093 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:19.280313 24813 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.275391 24924 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.288353 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet 2152258f0d654836a042cc0cf00d66a3 with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40964
I20260709 12:17:19.296205 24245 raft_consensus.cc:2955] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.310878 25120 tablet_replica.cc:333] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:17:19.313781 23995 catalog_manager.cc:5697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.319614 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d84a44368371490a8287d9cb8d1620d0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:19.325935 25120 raft_consensus.cc:2243] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.332165 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a36a91a0b5548f28dd004a49f5cac15 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:19.345810 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a36a91a0b5548f28dd004a49f5cac15 with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37600
I20260709 12:17:19.357570 23998 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.368737 25120 raft_consensus.cc:2272] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.370505 25121 tablet_replica.cc:333] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:17:19.371850 25121 raft_consensus.cc:2243] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.372709 25121 raft_consensus.cc:2272] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.378922 25121 ts_tablet_manager.cc:1916] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:19.389101 25120 ts_tablet_manager.cc:1916] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:19.398139 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet d84a44368371490a8287d9cb8d1620d0 with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59342
I20260709 12:17:19.400159 25122 tablet_replica.cc:333] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:17:19.401388 25122 raft_consensus.cc:2243] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.404815 25122 raft_consensus.cc:2272] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.409878 25122 ts_tablet_manager.cc:1916] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:19.442247 25122 ts_tablet_manager.cc:1929] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:19.442844 25122 log.cc:1199] T d84a44368371490a8287d9cb8d1620d0 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/d84a44368371490a8287d9cb8d1620d0
I20260709 12:17:19.444943 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet d84a44368371490a8287d9cb8d1620d0 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:19.446381 25121 ts_tablet_manager.cc:1929] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:19.454797 25120 ts_tablet_manager.cc:1929] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:19.455440 25120 log.cc:1199] T 2152258f0d654836a042cc0cf00d66a3 P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/2152258f0d654836a042cc0cf00d66a3
I20260709 12:17:19.446900 25121 log.cc:1199] T 0a36a91a0b5548f28dd004a49f5cac15 P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/0a36a91a0b5548f28dd004a49f5cac15
I20260709 12:17:19.457170 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet 2152258f0d654836a042cc0cf00d66a3 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:19.458417 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet 0a36a91a0b5548f28dd004a49f5cac15 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:19.802702 24245 consensus_queue.cc:237] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:19.814788 24815 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:19.815557 24169 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:19.817435 25124 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:19.823089 25126 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:19.829717 25125 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.831833 24814 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.863648 24169 raft_consensus.cc:2955] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.880365 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2391737d1a8643bd885a4db57ceba96c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:19.899740 23998 catalog_manager.cc:5697] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 3 to 4, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:19.941285 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet 2391737d1a8643bd885a4db57ceba96c with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:37600
I20260709 12:17:19.943652 25121 tablet_replica.cc:333] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:17:19.948472 25121 raft_consensus.cc:2243] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:19.950814 25121 raft_consensus.cc:2272] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:19.955667 25121 ts_tablet_manager.cc:1916] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:19.976207 25121 ts_tablet_manager.cc:1929] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:19.976626 25121 log.cc:1199] T 2391737d1a8643bd885a4db57ceba96c P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/2391737d1a8643bd885a4db57ceba96c
I20260709 12:17:19.978884 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet 2391737d1a8643bd885a4db57ceba96c (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:21.033443 24099 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.040251 24247 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:21.041666 24169 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:17:21.041981 24066 consensus_peers.cc:597] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ee66a7413b024d4b8e542242a567c0cf. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:21.043284 25060 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:21.044116 25133 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:21.053819 25060 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.056052 24169 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.057111 24247 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.080863 23995 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.085476 24099 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
W20260709 12:17:21.098062 24066 consensus_peers.cc:597] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ce278f8a39b344f9a0cd7dcd099a3b66. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:21.100800 24169 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:21.100827 24247 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:21.103139 25133 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:21.104166 25060 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:21.142200 25060 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.147545 24169 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.147545 24247 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.179226 24247 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.179210 23997 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:21.190589 24099 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:21.192225 25125 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:21.194242 24215 consensus_peers.cc:597] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7b5b70d71470484d8fc5f942623adb98. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:21.195287 24174 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:21.201396 25146 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:21.209023 25146 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.218148 24099 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.228390 24174 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.235033 24169 consensus_queue.cc:237] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.238384 23995 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:21.257725 24141 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c29a1bdc82674a4ab1ad6c3b54c69e25. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:17:21.259976 24250 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:21.260820 24099 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:17:21.261776 25134 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:21.265203 25134 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:21.287628 25135 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.289947 24250 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.311364 24099 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.312682 23998 catalog_manager.cc:5697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 2, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:17:21.486409 25154 ts_tablet_manager.cc:933] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:17:21.489066 25154 tablet_copy_client.cc:323] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
I20260709 12:17:21.491160 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet ce278f8a39b344f9a0cd7dcd099a3b66 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:17:21.491739 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet ce278f8a39b344f9a0cd7dcd099a3b66 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-ce278f8a39b344f9a0cd7dcd099a3b66
I20260709 12:17:21.499933 24111 tablet_copy_source_session.cc:215] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:21.504334 25154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce278f8a39b344f9a0cd7dcd099a3b66. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.524819 25154 tablet_copy_client.cc:806] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:21.526216 25154 tablet_copy_client.cc:670] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:21.528285 25156 ts_tablet_manager.cc:933] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:17:21.531999 25156 tablet_copy_client.cc:323] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
I20260709 12:17:21.533424 25154 tablet_copy_client.cc:538] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:21.534540 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet ee66a7413b024d4b8e542242a567c0cf from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:17:21.535254 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet ee66a7413b024d4b8e542242a567c0cf from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-ee66a7413b024d4b8e542242a567c0cf
I20260709 12:17:21.545009 24111 tablet_copy_source_session.cc:215] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:21.546650 25154 tablet_bootstrap.cc:492] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:21.550333 25156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee66a7413b024d4b8e542242a567c0cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.596964 25154 tablet_bootstrap.cc:492] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:21.598204 25154 tablet_bootstrap.cc:492] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:21.599116 25154 ts_tablet_manager.cc:1403] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.053s	user 0.020s	sys 0.013s
I20260709 12:17:21.602821 25154 raft_consensus.cc:359] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.603858 25154 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:21.604723 25154 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.605481 25156 tablet_copy_client.cc:806] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:21.606232 25156 tablet_copy_client.cc:670] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:21.610644 25156 tablet_copy_client.cc:538] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:21.621479 25154 ts_tablet_manager.cc:1434] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.010s
I20260709 12:17:21.625775 24111 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-ce278f8a39b344f9a0cd7dcd099a3b66 received from {username='slave'} at 127.0.0.1:50598
I20260709 12:17:21.626375 24111 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-ce278f8a39b344f9a0cd7dcd099a3b66 on tablet ce278f8a39b344f9a0cd7dcd099a3b66 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:21.633158 25156 tablet_bootstrap.cc:492] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:21.653743 25154 ts_tablet_manager.cc:933] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:21.674587 25154 tablet_copy_client.cc:323] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:17:21.679049 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 7b5b70d71470484d8fc5f942623adb98 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:17:21.679754 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 7b5b70d71470484d8fc5f942623adb98 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-7b5b70d71470484d8fc5f942623adb98
I20260709 12:17:21.714754 24259 tablet_copy_source_session.cc:215] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:21.719389 25154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b5b70d71470484d8fc5f942623adb98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.724390 25160 ts_tablet_manager.cc:933] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:21.724397 25156 tablet_bootstrap.cc:492] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:21.726482 25160 tablet_copy_client.cc:323] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:17:21.727588 25156 tablet_bootstrap.cc:492] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:21.728420 25156 ts_tablet_manager.cc:1403] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.096s	user 0.039s	sys 0.052s
I20260709 12:17:21.729020 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:17:21.729629 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet c29a1bdc82674a4ab1ad6c3b54c69e25 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-c29a1bdc82674a4ab1ad6c3b54c69e25
I20260709 12:17:21.731990 25156 raft_consensus.cc:359] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.732950 25156 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:21.733686 25156 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.736639 25156 ts_tablet_manager.cc:1434] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:17:21.738485 24111 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-ee66a7413b024d4b8e542242a567c0cf received from {username='slave'} at 127.0.0.1:50598
I20260709 12:17:21.738906 24111 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-ee66a7413b024d4b8e542242a567c0cf on tablet ee66a7413b024d4b8e542242a567c0cf with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:21.739324 24186 tablet_copy_source_session.cc:215] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:17:21.741719 25154 tablet_copy_client.cc:806] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:21.742815 25154 tablet_copy_client.cc:670] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:21.748019 25154 tablet_copy_client.cc:538] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:21.749984 25160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c29a1bdc82674a4ab1ad6c3b54c69e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:17:21.759094 25154 tablet_bootstrap.cc:492] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:21.768165 25160 tablet_copy_client.cc:806] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:17:21.768986 25160 tablet_copy_client.cc:670] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:17:21.809782 25160 tablet_copy_client.cc:538] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:17:21.850442 25160 tablet_bootstrap.cc:492] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:17:21.880684 25154 tablet_bootstrap.cc:492] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:21.881916 25154 tablet_bootstrap.cc:492] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:21.882912 25154 ts_tablet_manager.cc:1403] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.124s	user 0.033s	sys 0.007s
I20260709 12:17:21.891214 25154 raft_consensus.cc:359] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.892339 25154 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:21.893159 25154 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.898551 25160 tablet_bootstrap.cc:492] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:17:21.900729 25160 tablet_bootstrap.cc:492] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:17:21.901711 25160 ts_tablet_manager.cc:1403] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.013s
I20260709 12:17:21.905229 25160 raft_consensus.cc:359] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.906147 25160 raft_consensus.cc:740] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:17:21.906919 25160 consensus_queue.cc:260] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:17:21.909348 25154 ts_tablet_manager.cc:1434] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:17:21.928813 25160 ts_tablet_manager.cc:1434] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:17:21.933430 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-7b5b70d71470484d8fc5f942623adb98 received from {username='slave'} at 127.0.0.1:59766
I20260709 12:17:21.934003 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-7b5b70d71470484d8fc5f942623adb98 on tablet 7b5b70d71470484d8fc5f942623adb98 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:21.936643 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-c29a1bdc82674a4ab1ad6c3b54c69e25 received from {username='slave'} at 127.0.0.1:44066
I20260709 12:17:21.937186 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-c29a1bdc82674a4ab1ad6c3b54c69e25 on tablet c29a1bdc82674a4ab1ad6c3b54c69e25 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:17:22.065047 24814 raft_consensus.cc:1217] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:22.070891 24814 raft_consensus.cc:1217] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:22.105671 24814 raft_consensus.cc:1217] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:22.256945 24814 raft_consensus.cc:1217] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:17:22.477525 25108 raft_consensus.cc:1064] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:22.480633 25108 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:22.488291 24814 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.491493 25133 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:22.499282 24250 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.499368 24171 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.505630 25133 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:22.508363 25133 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:22.547317 25164 raft_consensus.cc:1064] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:22.555424 25164 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:22.557529 25060 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.563925 24171 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.567651 24814 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.591342 24250 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.595700 23995 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.602046 24815 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.603684 24171 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.606400 24094 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.608014 25127 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:22.613358 25172 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:22.622723 25127 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:17:22.653520 25146 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.662120 24813 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.669021 25132 raft_consensus.cc:1064] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:22.676527 25132 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:22.686347 25134 raft_consensus.cc:1064] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:17:22.689874 25134 consensus_queue.cc:237] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:22.724546 24245 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.726527 24813 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.728641 25133 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:22.726488 25165 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:22.730862 24099 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:22.734678 23996 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.738823 24245 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.742564 24171 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.744328 24169 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.749547 24814 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.757834 25132 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:22.763127 24095 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:17:22.765249 25179 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:22.763762 25060 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:22.772742 25135 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:22.721570 24094 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.818670 24814 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:22.821138 24245 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:22.823963 25108 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:22.826185 25108 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:22.844376 24814 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.848188 25133 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.861685 25165 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.873170 25060 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.874917 24812 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.880115 24174 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.901831 23997 catalog_manager.cc:5697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:22.899116 24813 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.910319 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ce278f8a39b344f9a0cd7dcd099a3b66 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:22.917855 23995 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:22.910549 24100 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.910315 24248 raft_consensus.cc:2955] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.934823 24247 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.937146 24245 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:22.951169 24250 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:22.957420 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet ce278f8a39b344f9a0cd7dcd099a3b66 with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59342
I20260709 12:17:22.958607 23998 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 2 to 3, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:23.003342 24815 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:23.005159 25146 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:23.008410 24094 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:23.010802 25172 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:23.013221 24099 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:23.027259 24815 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:23.031826 24174 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:17:23.040752 25132 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:23.044210 25132 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:17:23.044387 24814 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:23.047099 25172 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:23.052098 24099 raft_consensus.cc:2955] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:23.063587 25194 tablet_replica.cc:333] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:17:23.062893 25108 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:23.080655 24815 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:23.085064 25194 raft_consensus.cc:2243] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:23.086165 25194 raft_consensus.cc:2272] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:23.088729 24174 raft_consensus.cc:2955] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:23.122121 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ee66a7413b024d4b8e542242a567c0cf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:23.199033 25194 ts_tablet_manager.cc:1916] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:17:24.290542 22908 debug-util.cc:398] Leaking SignalData structure 0x7b080000fb20 after lost signal to thread 24216
W20260709 12:17:24.291419 22908 kernel_stack_watchdog.cc:198] Thread 24216 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 242ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 12:17:24.364137 24030 debug-util.cc:398] Leaking SignalData structure 0x7b080003b5a0 after lost signal to thread 22906
W20260709 12:17:24.365900 24030 debug-util.cc:398] Leaking SignalData structure 0x7b080008b380 after lost signal to thread 24033
W20260709 12:17:24.545686 24142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.373s	user 0.014s	sys 0.021s
W20260709 12:17:24.546765 24142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.374s	user 0.015s	sys 0.021s
I20260709 12:17:24.549242 25205 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.550186 25205 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.552605 25205 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.558523 25205 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.559211 25205 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.559691 25207 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.560451 25203 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.561385 25200 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.561757 25205 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.562484 25205 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.562143 25200 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.563088 25205 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.563633 25208 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.565762 25203 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.564252 25208 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.567461 25200 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.568378 25205 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.560424 25207 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.571170 25203 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.569093 25206 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.577162 25209 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.577448 25207 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:24.577729 25206 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.579310 25209 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.581195 25206 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.578570 25208 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.581593 25209 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.590240 25209 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.590365 25208 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.591146 25208 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.591010 25209 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.593945 25209 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.594480 25209 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:24.594779 24814 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.499s	user 0.014s	sys 0.024s
W20260709 12:17:24.595162 24814 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.499s	user 0.015s	sys 0.024s
I20260709 12:17:24.594969 25209 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.595930 24814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 182) took 1552 ms. Trace:
I20260709 12:17:24.596050 25210 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.596508 25210 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.597162 25209 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.596387 24814 rpcz_store.cc:276] 0709 12:17:23.043530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.043696 (+   166us) service_pool.cc:224] Handling call
0709 12:17:23.044037 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:23.044244 (+   207us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:23.095891 (+ 51647us) log.cc:844] Serialized 14 byte log entry
0709 12:17:24.595496 (+1499605us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:24.595564 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:24.595613 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:24.595698 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:24.595835 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16629,"raft.run_cpu_time_us":232,"raft.run_wall_time_us":6719,"thread_start_us":1499294,"threads_started":1}
I20260709 12:17:24.598466 25210 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.598963 25200 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.599587 25200 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.600843 25208 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.601404 25208 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.601891 25208 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.603997 25208 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.617648 25211 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.618438 25211 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.621613 25211 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.629019 25210 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.629806 25210 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.634428 25210 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.635414 25213 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.638700 25212 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.636080 25213 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.643622 25212 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.644387 25213 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.645166 25213 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.636070 25211 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.660882 25211 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.662876 25212 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:24.656610 25213 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.669716 25211 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.648401 25215 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.672457 25204 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.673707 25204 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.674449 25218 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.675267 25218 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.676956 25204 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:24.677692 25204 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.678321 25204 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.678784 25218 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.682829 25214 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.683019 25210 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.683249 25204 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.668174 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:24.684965 24814 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:24.683503 25214 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.687278 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:24.686007 25204 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.689968 25218 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.689968 25211 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:24.691504 25211 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.691200 25218 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.691915 25211 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.692004 25214 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.693270 25218 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:24.693825 25204 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.684595 25215 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.683815 25210 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.699545 25210 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.698652 25215 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.700233 25217 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.697968 25204 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.703346 25200 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.704278 25213 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:24.706090 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:24.706813 24814 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:24.706135 25214 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.700832 25217 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.708678 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:17:24.713233 24139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.548s	user 0.020s	sys 0.016s
I20260709 12:17:24.713343 25133 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:24.713799 25133 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.714190 25133 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:24.714524 24139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.553s	user 0.021s	sys 0.016s
I20260709 12:17:24.714107 25214 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.711432 25216 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.719889 25216 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.726140 25159 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.728820 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:24.727015 25200 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.729481 24099 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:24.723927 25194 ts_tablet_manager.cc:1929] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:24.732100 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:24.726702 25211 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.734108 25218 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.734367 25211 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:24.735172 24100 raft_consensus.cc:2393] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:24.730084 25210 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.729820 25200 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.723167 25213 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.726794 25159 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.736254 25210 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.737380 25215 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.739916 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:24.738492 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:24.741297 24814 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:24.741444 24094 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:24.739230 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:24.742228 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:24.742470 24095 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:24.742959 25215 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.743245 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:24.726642 25216 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.752065 25215 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.752530 25210 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.738449 25194 log.cc:1199] T ce278f8a39b344f9a0cd7dcd099a3b66 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/ce278f8a39b344f9a0cd7dcd099a3b66
I20260709 12:17:24.755270 25213 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.734710 25218 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.748438 25200 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.744441 25211 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.758560 25214 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.731285 25204 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.729465 25221 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.756317 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:24.749887 25212 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.753474 25159 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.763588 25204 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.763746 25212 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.764200 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:24.758666 25211 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.775671 25204 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:24.775857 25211 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.775969 24814 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:24.779050 25212 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.782140 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:24.784605 25218 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.787035 25060 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:24.787636 25060 raft_consensus.cc:697] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:24.768692 25213 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.764837 25221 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.789390 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:24.792069 24100 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:24.792930 25060 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.773972 24097 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:24.781502 25220 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.804845 25212 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:24.804909 24216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.754s	user 0.018s	sys 0.095s
I20260709 12:17:24.805038 25133 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.805552 25212 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:24.806457 24216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.770s	user 0.018s	sys 0.095s
W20260709 12:17:24.806942 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 1.77021e+06us
I20260709 12:17:24.804212 25215 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.808238 25133 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:24.808068 25215 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.811291 25200 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.811774 25215 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.812021 25200 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.809157 25207 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.815588 25208 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.816161 25208 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.814448 25207 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.822525 25159 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.821615 25209 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.823328 25159 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.791668 25205 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.825914 25209 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.826360 25205 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.790421 25194 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59342 (request call id 70) took 1832 ms. Trace:
I20260709 12:17:24.798489 25206 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.821837 25208 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.824172 25210 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.837651 25206 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.838214 25210 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.828159 25212 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.840539 25206 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.840932 25210 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.841318 25206 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.842466 25203 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.843266 25203 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.844424 25207 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.845171 25207 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.846030 25203 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.845752 25207 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.836371 25209 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.836905 25205 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:24.836495 24140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.685s	user 0.014s	sys 0.027s
W20260709 12:17:24.854754 24140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.751s	user 0.015s	sys 0.027s
W20260709 12:17:24.855286 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 1.75857e+06us
I20260709 12:17:24.814901 25200 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.797482 25220 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.862030 25211 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.862346 25213 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.862653 25133 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.863157 25215 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.846832 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:24.887461 25215 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.883704 25217 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:24.882918 25211 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.903260 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:24.860235 25206 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.904946 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:24.905604 24815 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:24.907224 25207 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.882668 25133 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.907742 25211 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:24.909616 25172 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.769s	user 0.010s	sys 0.032s
I20260709 12:17:24.909737 25133 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:24.910040 25172 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.788s	user 0.010s	sys 0.032s
I20260709 12:17:24.910501 25172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40964 (request call id 70) took 1978 ms. Trace:
I20260709 12:17:24.881098 25213 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.913049 25212 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.913615 25212 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.914038 25224 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.914633 25224 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.915481 25212 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.917043 25224 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.910873 25172 rpcz_store.cc:276] 0709 12:17:22.931984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.937280 (+  5296us) service_pool.cc:224] Handling call
0709 12:17:22.995212 (+ 57932us) log.cc:844] Serialized 501 byte log entry
0709 12:17:24.910396 (+1915184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1165,"raft.run_cpu_time_us":1007,"raft.run_wall_time_us":1095}
I20260709 12:17:24.900600 25216 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.903219 25205 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.924532 25205 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.924482 25216 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:24.901533 25200 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:24.898135 25217 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:24.933859 25211 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.941218 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:24.942165 24174 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:24.942575 25060 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.902078 25159 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.939536 25223 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:24.900930 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 114971us
I20260709 12:17:24.943248 25060 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.939730 25211 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.949576 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:24.944448 25212 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.926865 25205 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.950199 25211 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.919999 25215 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.927380 25200 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:24.952703 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:24.954541 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:24.957877 24814 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:24.947573 24215 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:24.964692 25060 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:24.947674 25133 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.955674 25134 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.003031 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:24.951148 25217 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:24.955897 25212 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.017104 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:25.286955 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.095718 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:25.047487 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:24.961393 25200 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.044313 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:25.293128 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:25.285588 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.150s	user 0.024s	sys 0.024s
I20260709 12:17:24.829367 25194 rpcz_store.cc:276] 0709 12:17:22.956867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:22.957114 (+   247us) service_pool.cc:224] Handling call
0709 12:17:23.062874 (+105760us) ts_tablet_manager.cc:1151] Deleting tablet ce278f8a39b344f9a0cd7dcd099a3b66
0709 12:17:23.062946 (+    72us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:17:24.694800 (+1631854us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:24.723754 (+ 28954us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:24.787737 (+ 63983us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19936,"tablet-delete.queue_time_us":104789,"thread_start_us":105289,"threads_started":1}
I20260709 12:17:25.267124 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:25.044376 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:25.043924 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:25.295630 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.161s	user 0.024s	sys 0.024s
I20260709 12:17:25.148239 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.300807 24245 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
W20260709 12:17:25.300577 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 2.16556e+06us
I20260709 12:17:25.121862 25060 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.097947 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:25.292289 22908 debug-util.cc:398] Leaking SignalData structure 0x7b080000fb40 after lost signal to thread 24216
I20260709 12:17:25.287909 24171 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:25.293561 24173 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
W20260709 12:17:25.247380 24214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.990s	user 0.032s	sys 0.060s
I20260709 12:17:24.993716 25204 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:25.285815 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:25.299857 24168 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:25.312216 25060 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:25.319535 24214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.197s	user 0.034s	sys 0.068s
I20260709 12:17:25.266253 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:24.962296 25223 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:25.002552 25213 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.332314 24174 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:25.321166 24176 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:25.285072 25205 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.184859 25193 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:24.969362 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:25.267233 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:25.103025 25133 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.342833 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.103852 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7b5b70d71470484d8fc5f942623adb98 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:17:25.343106 25060 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.341513 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.292899 25216 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:25.313031 25221 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:25.333321 25215 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.285406 24781 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:25.357508 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:25.361701 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.360266 25233 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:25.299742 25134 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.366462 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.373291 24245 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:25.369158 25230 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:25.369711 25228 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.035861 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:25.322098 25204 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.361344 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.367324 25213 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.375571 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.355072 25220 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:25.378867 25159 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:25.384624 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:25.370472 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 102578us
I20260709 12:17:25.346660 25224 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.368553 25209 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:25.393237 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.395004 24247 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:25.367172 25216 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:25.367319 23985 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 270806us
I20260709 12:17:25.390130 24100 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:25.401662 25060 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.391914 25233 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.404580 25060 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:25.366240 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 408882us
I20260709 12:17:25.346338 25226 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:25.351831 25205 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.401973 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.392371 25204 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.392607 25212 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.358093 25193 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.411863 25226 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.413144 24246 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:25.396520 25159 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.444651 25159 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.445267 25179 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.365389 25215 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.403275 25209 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.395968 25230 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:25.447307 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.460829 24246 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 1.
I20260709 12:17:25.469130 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.469599 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.470224 24247 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:25.470244 24245 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:25.479282 25108 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.437994 25185 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.402623 25213 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.402936 25228 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.483080 25108 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:25.451135 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49994.3us
I20260709 12:17:25.460019 25209 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.490950 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.430094 25232 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.462802 25223 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:25.478816 24030 debug-util.cc:398] Leaking SignalData structure 0x7b080031fb40 after lost signal to thread 24125
I20260709 12:17:25.496730 25134 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.462507 25230 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.409356 25224 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.471696 25212 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.504710 25108 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.506932 25211 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.410485 25216 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.489321 25185 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.501642 25223 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.484148 25205 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.515372 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.489989 25172 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:25.519845 24779 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:25.502144 24030 debug-util.cc:398] Leaking SignalData structure 0x7b080005e680 after lost signal to thread 24126
I20260709 12:17:25.512588 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.532572 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.522818 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:25.513137 25217 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:25.462446 25179 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.542707 25205 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:25.543171 24030 debug-util.cc:398] Leaking SignalData structure 0x7b08001cbc00 after lost signal to thread 24200
I20260709 12:17:25.548873 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.561746 24247 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:25.550343 25060 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.553638 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.522626 25212 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.516983 24781 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:17:25.563596 24030 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9520 after lost signal to thread 24201
I20260709 12:17:25.589104 25134 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:25.609203 24780 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:25.589556 25226 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.553895 25172 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.537364 25211 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.513880 25232 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.615660 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.587877 25233 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:25.559667 25223 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.564209 25205 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.640661 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.653609 24248 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:25.585922 25234 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.661787 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.615728 25134 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.664268 25212 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.666190 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.663447 24095 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:25.667116 24094 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:25.668632 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.665622 25134 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:25.652773 24030 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6060 after lost signal to thread 24274
I20260709 12:17:25.673336 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.646729 25227 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.687788 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.688114 25134 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.688944 25134 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.689414 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.691181 25179 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.692826 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.701205 25232 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:25.709463 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.660739 25228 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:25.676644 24030 debug-util.cc:398] Leaking SignalData structure 0x7b0800301720 after lost signal to thread 24275
I20260709 12:17:25.711215 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.671398 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.652374 24243 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:25.671563 25215 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.730490 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.736806 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.737476 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.737761 24096 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:25.725878 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.659811 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.789230 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.742640 25216 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:25.737409 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.756916 25213 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.742853 25193 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.730298 25227 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.785683 25192 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.833356 25172 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:25.698316 25234 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:25.768817 24242 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:25.761325 25220 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.838119 25206 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:25.838429 24030 debug-util.cc:398] Leaking SignalData structure 0x7b0800137fe0 after lost signal to thread 24839
I20260709 12:17:25.838728 25133 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.841879 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.852187 25242 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:25.855370 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 276517us
W20260709 12:17:25.855969 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 397505us
I20260709 12:17:25.832703 25236 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:25.822338 25232 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.805169 25205 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.818706 25211 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.866413 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:25.791153 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 267885us
I20260709 12:17:25.834316 25223 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.814399 25240 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.865504 25243 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:25.865442 24780 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:25.792587 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.842137 25192 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:25.856240 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 346866us
I20260709 12:17:25.875164 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.919844 24094 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:25.854597 25185 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.894907 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.904201 24780 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:25.855742 25220 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.877688 25242 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:25.917670 25192 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:25.939460 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.941573 24094 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:25.940515 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.866647 25232 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:25.929447 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.910959 25243 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.950747 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.929680 25242 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:25.953261 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49250.6us
I20260709 12:17:25.954093 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:25.955977 25227 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:25.957765 25134 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.959514 23998 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 202) took 2955 ms. Trace:
I20260709 12:17:25.959867 23998 rpcz_store.cc:276] 0709 12:17:23.004485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:23.004648 (+   163us) service_pool.cc:224] Handling call
0709 12:17:25.959404 (+2954756us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4523,"reported_tablets":3}
I20260709 12:17:25.960856 24812 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:25.961864 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.961216 23995 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 3 to 4, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 1 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:25.962493 24095 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:25.963294 25244 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:25.960340 25224 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:25.965229 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.966050 24248 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:25.966915 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.969084 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.914489 25204 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:25.963642 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.879226 25236 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:25.975806 25246 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.963768 25244 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:25.975903 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.977072 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.929534 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:25.981951 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.986195 24250 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 2: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:25.983058 25247 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:25.952037 25243 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.984795 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.946403 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:25.954736 25242 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:25.988180 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:25.992303 25231 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:25.995466 25247 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:25.998462 25247 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.000362 25236 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:25.982024 25244 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:25.972394 25211 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:17:26.011341 25245 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:25.943374 25240 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:26.003201 25200 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.007s
I20260709 12:17:25.993203 25231 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:26.019965 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 65952.1us
I20260709 12:17:26.025271 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.026767 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.027467 24095 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:26.032647 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:26.050930 25242 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:26.059912 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.055608 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.075009 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:25.991595 25246 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:26.088696 25232 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:26.092044 24245 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:26.023483 25200 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:26.074434 25220 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:26.101073 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:26.106245 24814 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:26.099242 25159 consensus_meta.cc:287] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.654s	user 0.009s	sys 0.008s
I20260709 12:17:26.109787 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:26.024075 25245 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:26.104990 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:26.110316 25240 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:26.117152 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.117777 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:26.108234 25185 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.118808 25134 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:26.119801 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:26.118947 25185 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:26.105638 25204 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:26.022181 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:26.124058 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.127408 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.127682 25200 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:26.128398 25200 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.128787 25200 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:26.129184 25200 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.129504 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.130673 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.131280 24171 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:26.120105 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.131285 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 188) took 1310 ms. Trace:
I20260709 12:17:25.874049 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet ce278f8a39b344f9a0cd7dcd099a3b66 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:26.136885 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:26.131971 23996 rpcz_store.cc:276] 0709 12:17:24.810635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.810813 (+   178us) service_pool.cc:224] Handling call
0709 12:17:26.121067 (+1310254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":506393,"reported_tablets":1}
I20260709 12:17:26.129026 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.164676 25222 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.165275 25222 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:26.165704 25222 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.166476 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:26.113253 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 173479us
I20260709 12:17:26.105440 25247 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:26.116242 25248 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.131920 25185 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.114915 25159 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:26.195467 25134 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.207934 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.217216 24173 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:26.212697 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.219341 24168 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:26.197744 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:26.216182 24215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.929s	user 0.020s	sys 0.045s
W20260709 12:17:26.221856 24215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.020s	sys 0.045s
I20260709 12:17:26.222035 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:26.222312 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 1.21934e+06us
I20260709 12:17:26.223922 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.224525 24176 raft_consensus.cc:1813] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Handling vote request from an unknown peer fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:26.224180 25235 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.207360 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.238368 25235 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:26.238574 24176 raft_consensus.cc:2410] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:17:26.238821 25235 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.238957 25245 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:26.239297 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.239503 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.233534 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.198230 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.236878 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.236960 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.226665 24813 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:26.216262 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.214890 25134 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:26.247016 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.250213 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.216948 25246 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:26.251533 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.208865 25248 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:26.253599 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.211890 25249 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.259320 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.260351 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.215770 24779 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:26.261445 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.252041 24167 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:26.265172 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.251574 25134 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.267709 23997 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 95) took 1391 ms. Trace:
I20260709 12:17:26.268352 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.269577 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.222031 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.270128 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.274880 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.272004 23997 rpcz_store.cc:276] 0709 12:17:24.875880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.876472 (+   592us) service_pool.cc:224] Handling call
0709 12:17:26.267586 (+1391114us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:17:26.280659 24097 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:26.215718 25234 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:26.287657 23986 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 424394us
I20260709 12:17:26.322006 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.320427 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:26.565254 24780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.005s	sys 0.006s
W20260709 12:17:26.681190 24780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.006s	sys 0.011s
I20260709 12:17:26.320973 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:26.681831 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 649172us
I20260709 12:17:26.679402 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.283502 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:26.256152 25248 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.679402 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:26.263655 25249 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:26.285331 24066 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.636s (SENT) [suppressed 1 similar messages]
W20260709 12:17:26.706045 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 420734us
I20260709 12:17:26.282474 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:26.759574 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.013s	sys 0.011s
W20260709 12:17:26.761132 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.014s	sys 0.011s
W20260709 12:17:26.761567 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 547243us
I20260709 12:17:26.763525 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:26.764613 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 64017.7us
I20260709 12:17:26.281674 25247 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:26.287850 25231 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:26.690582 25242 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:26.748955 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.435786 25244 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:26.690913 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 479430us
I20260709 12:17:26.706002 25159 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:26.696520 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 767035us
W20260709 12:17:26.781515 25230 consensus_meta.cc:287] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.274s	user 0.016s	sys 0.004s
I20260709 12:17:26.706449 25249 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.808522 25254 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:26.809111 25254 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:26.811429 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:26.812323 24811 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:26.813978 24810 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:26.801689 25209 consensus_meta.cc:287] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 1.292s	user 0.016s	sys 0.005s
W20260709 12:17:26.827710 25243 consensus_meta.cc:287] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.840s	user 0.009s	sys 0.004s
I20260709 12:17:26.828223 25243 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:26.830551 25243 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:26.832257 25244 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:26.799361 25247 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.793668 25250 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.804164 25230 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:26.838749 25247 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:26.841231 25250 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:26.852591 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:26.855569 24812 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.025s	sys 0.092s
I20260709 12:17:26.838023 25209 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:26.855948 24812 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.025s	sys 0.092s
I20260709 12:17:26.851270 25247 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.858282 24249 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 2: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:26.858564 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:26.850351 25254 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:26.879703 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:26.851215 25250 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:26.895470 24216 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.018s
W20260709 12:17:26.895884 24216 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.000s	sys 0.018s
W20260709 12:17:26.896226 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 557782us
W20260709 12:17:26.884302 25235 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.645s	user 0.008s	sys 0.005s
W20260709 12:17:26.897348 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 108176us
I20260709 12:17:26.886796 25244 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.904147 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:26.904769 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 105616us
W20260709 12:17:26.901754 25200 consensus_meta.cc:287] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.772s	user 0.014s	sys 0.000s
I20260709 12:17:26.888957 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.902427 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:26.917483 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:26.919451 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:26.910521 25231 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.923631 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:26.910346 25234 consensus_queue.cc:1059] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:17:26.905563 25235 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:26.936474 25165 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:26.909246 24781 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:26.920496 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.952875 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:26.959719 25252 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:26.959913 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56284us
I20260709 12:17:26.960450 25252 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:26.960899 25252 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.961191 24781 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:26.923753 25231 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:26.913527 25200 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:26.965310 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 466299us
W20260709 12:17:26.969578 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 70392.8us
I20260709 12:17:26.962337 25254 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:26.983446 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.983897 25133 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:26.984624 25134 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.679s	user 0.008s	sys 0.003s
I20260709 12:17:26.985086 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.985387 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.986600 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.987284 24099 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:26.988143 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.976859 25231 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:26.992951 24247 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:26.990711 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.995951 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.986548 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:26.939286 25260 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:26.997185 24814 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:26.995990 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.005872 24246 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:27.005957 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.006850 24245 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:26.998940 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.999228 25235 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:26.985118 25134 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:26.983639 24249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 26) took 1672 ms (client timeout 1842 ms). Trace:
I20260709 12:17:27.000288 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:27.043519 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 64045.8us
I20260709 12:17:27.043394 24098 raft_consensus.cc:2393] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:27.040172 24249 rpcz_store.cc:269] 0709 12:17:25.311369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.312026 (+   657us) service_pool.cc:224] Handling call
0709 12:17:26.983375 (+1671349us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540008d9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:26.983541 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3361981824}
I20260709 12:17:27.046761 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:26.979192 25254 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:26.978904 25223 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:27.049654 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.050066 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.052343 24245 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:27.056034 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.056391 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:27.056711 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 141237us
I20260709 12:17:27.057717 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.058512 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.001677 25133 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.051137 25254 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.049111 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.000654 24781 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:27.074798 25261 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
W20260709 12:17:27.075497 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 97109.3us
I20260709 12:17:27.073263 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:27.056414 25209 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.060283 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:27.060917 25230 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:27.063820 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.056100 25223 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.083949 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.064185 25218 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.094269 24099 raft_consensus.cc:1813] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Handling vote request from an unknown peer 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:27.101465 24099 raft_consensus.cc:2410] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:17:27.099757 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:27.106436 24810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 121) took 1147 ms. Trace:
W20260709 12:17:27.108808 25222 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.943s	user 0.013s	sys 0.027s
I20260709 12:17:27.109227 25222 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.109570 24811 raft_consensus.cc:1240] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.110448 24170 raft_consensus.cc:2393] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:17:27.110714 25185 consensus_meta.cc:287] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.897s	user 0.002s	sys 0.011s
I20260709 12:17:27.079733 25243 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.129179 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.130677 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.131806 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.132041 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.132575 24093 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:27.133213 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.133590 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.134529 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.135367 24813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 191) took 1107 ms. Trace:
I20260709 12:17:27.136019 25218 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.137468 25133 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:27.138181 25134 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.138439 25218 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:27.135820 24813 rpcz_store.cc:276] 0709 12:17:26.027865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.029229 (+  1364us) service_pool.cc:224] Handling call
0709 12:17:26.060157 (+ 30928us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.246122 (+185965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.113433 (+867311us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b540070f654. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:27.135285 (+ 21852us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":356498816}
I20260709 12:17:27.139905 25222 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.140650 24813 raft_consensus.cc:1240] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.142216 24813 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.142536 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 787) took 1386 ms. Trace:
I20260709 12:17:27.142910 24247 rpcz_store.cc:276] 0709 12:17:25.756512 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.038837 (+282325us) service_pool.cc:224] Handling call
0709 12:17:26.992784 (+953947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.993327 (+   543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.142292 (+148965us) spinlock_profiling.cc:243] Waited 945 ms on lock 0x7b540008d9d0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:27.142449 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2173992704}
I20260709 12:17:27.102360 25244 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.153767 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1186) took 1016 ms. Trace:
I20260709 12:17:27.143982 25243 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:27.121486 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45180.2us
I20260709 12:17:27.163069 24814 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.159374 24170 rpcz_store.cc:276] 0709 12:17:26.130211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.168331 (+ 38120us) service_pool.cc:224] Handling call
0709 12:17:27.146465 (+978134us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b540009f454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:27.146603 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1964429568}
I20260709 12:17:27.167567 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:27.168661 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 108459us
I20260709 12:17:27.122642 25185 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.104995 24092 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:27.173238 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.106895 24810 rpcz_store.cc:276] 0709 12:17:25.959571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:25.972118 (+ 12547us) service_pool.cc:224] Handling call
0709 12:17:25.974483 (+  2365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:26.814414 (+839931us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.085783 (+271369us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54006ffed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:27.106293 (+ 20510us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1907362688}
I20260709 12:17:27.165190 25243 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:27.171494 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 252111us
I20260709 12:17:27.174132 25250 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.163553 25200 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:27.156957 25218 consensus_queue.cc:1059] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:17:27.180766 24174 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:27.158442 25264 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:17:27.176447 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.186882 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1183) took 1057 ms. Trace:
I20260709 12:17:27.187294 24174 rpcz_store.cc:276] 0709 12:17:26.129343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.236718 (+107375us) service_pool.cc:224] Handling call
0709 12:17:27.186674 (+949956us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54002adfd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:27.186817 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2154240896}
I20260709 12:17:27.188174 25223 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:27.189837 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:27.193331 25244 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:27.194779 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.196362 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.197713 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.199111 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.200439 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.201022 24169 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.203625 25250 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.205145 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.209498 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:27.213917 25243 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.180693 24140 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.217244 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.218119 25185 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.218782 25185 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.219316 25260 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.185318 25206 raft_consensus.cc:3055] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.220747 25206 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:27.221737 25206 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.219266 25185 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:27.223170 25206 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.223407 25185 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.180358 25255 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:27.227052 24169 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
W20260709 12:17:27.183171 25263 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:17:27.218708 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.235791 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.236199 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:27.237454 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 179768us
I20260709 12:17:27.229121 24814 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.238085 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.239097 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.239462 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.239903 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.241293 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.242887 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.243259 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.243901 24094 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:27.234572 24808 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.244968 25269 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.245749 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.245522 25269 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.250509 25204 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.251031 25204 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:27.252023 25204 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.253329 25204 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.253532 24806 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:27.253718 25248 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.003s
I20260709 12:17:27.254457 24812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 127) took 1144 ms. Trace:
I20260709 12:17:27.254153 25248 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.303676 24815 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.304867 25248 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.306747 25243 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:27.263520 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:27.255271 25247 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.310056 25247 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.310731 24809 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.265303 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:27.271086 25218 raft_consensus.cc:3055] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.312844 25218 raft_consensus.cc:740] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:27.273499 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:27.315052 25254 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.275162 24140 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.316228 24806 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.317404 25271 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.234786 25255 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.275738 25260 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.249477 25234 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.254877 24812 rpcz_store.cc:276] 0709 12:17:26.109881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.111730 (+  1849us) service_pool.cc:224] Handling call
0709 12:17:26.123153 (+ 11423us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:26.857471 (+734318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:26.857492 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:26.869461 (+ 11969us) log.cc:844] Serialized 26 byte log entry
0709 12:17:26.919367 (+ 49906us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:26.919395 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:26.919449 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:27.250855 (+331406us) raft_consensus.cc:1685] finished
0709 12:17:27.250880 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:27.254385 (+  3505us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9481,"raft.queue_time_us":665092,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":7380,"thread_start_us":756373,"threads_started":2,"wal-append.queue_time_us":62956}
I20260709 12:17:27.278713 25134 consensus_queue.cc:1059] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:27.279066 25207 consensus_queue.cc:1059] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:17:27.280354 25222 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:27.280586 25230 consensus_queue.cc:1059] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:27.281303 25235 consensus_queue.cc:1059] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:27.302858 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 74676.9us
I20260709 12:17:27.283773 25252 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.285117 24781 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:27.214787 25231 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.287340 25269 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:27.290150 25185 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.300493 25249 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:27.329690 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72335.9us
I20260709 12:17:27.330086 25247 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.331446 24781 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:27.332458 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:27.333786 25231 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.334203 25234 raft_consensus.cc:3055] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.334483 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.335381 24174 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.323447 24815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 128) took 1213 ms. Trace:
I20260709 12:17:27.281919 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:27.329046 25134 raft_consensus.cc:3055] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.334667 25234 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:17:27.338748 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56913us
I20260709 12:17:27.321930 24140 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.314174 25218 consensus_queue.cc:260] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.338415 24169 consensus_queue.cc:237] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.340827 25264 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.338482 24815 rpcz_store.cc:276] 0709 12:17:26.110263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:26.110520 (+   257us) service_pool.cc:224] Handling call
0709 12:17:26.126124 (+ 15604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:27.304231 (+1178107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:27.306774 (+  2543us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54005d7fd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:27.323303 (+ 16529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2707493248}
I20260709 12:17:27.342691 24216 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:27.323093 25254 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.344673 24140 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.340690 25247 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.351503 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.352476 24807 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.352975 25255 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:27.348503 25269 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.353833 25234 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.349522 25230 consensus_queue.cc:1059] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:17:27.347977 25264 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:27.331434 25249 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:27.363912 24140 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.368208 24140 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.341818 25134 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:27.343057 25243 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:27.370693 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.374516 25259 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.366757 25135 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.376350 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.348019 25271 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.377511 25273 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.377940 25252 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.350091 25222 consensus_queue.cc:1059] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:17:27.326721 25267 consensus_queue.cc:1059] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:17:27.358204 25264 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.381603 25185 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.382298 25234 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.385959 25255 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:27.388127 25275 raft_consensus.cc:3055] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.388307 24174 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:27.389886 25262 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:17:27.394438 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 66987.8us
I20260709 12:17:27.422437 25222 consensus_queue.cc:1243] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer 729aa4b1ccec48b588c14e67652c61e1 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:27.422509 25275 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:27.425117 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:27.390820 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:27.391390 25204 raft_consensus.cc:3055] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.392581 25253 raft_consensus.cc:3055] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.444228 25275 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.400296 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.401132 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.362955 25235 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.405676 24807 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.407693 25218 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:27.410141 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53590.2us
I20260709 12:17:27.411649 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.413439 25231 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.426719 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:27.399960 25243 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:17:27.457891 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 67183.4us
W20260709 12:17:27.456497 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45010.5us
I20260709 12:17:27.457566 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:27.443513 24781 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:27.443651 25204 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:27.458940 24214 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:27.448474 25253 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:27.466665 25253 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.467514 25220 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.467962 25220 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.468138 25253 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.468339 25220 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.462333 24140 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.469090 24214 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:27.457046 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:27.449640 25277 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.474256 25277 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.474682 25277 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.460805 25185 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.459185 25240 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:27.464349 25252 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:27.483040 24140 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:27.483492 25252 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:27.483919 25222 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.484493 25252 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.484997 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:27.464849 25133 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:17:27.487893 25266 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.488162 25222 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.488338 25266 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:27.488551 25255 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.488730 25222 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:27.489008 25255 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:27.489205 25222 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.489390 25266 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.478174 25204 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.493021 25204 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.461858 25262 raft_consensus.cc:3055] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.483040 25240 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.495327 25262 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:27.495682 25240 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.496133 25240 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.464651 25270 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.458151 25275 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.468989 25223 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.503273 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.510813 24171 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:27.476349 25165 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.514006 24168 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.475425 25185 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:27.472694 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46258.2us
W20260709 12:17:27.525404 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.518296 24170 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.519376 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:27.519681 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:27.520124 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 52836.4us
I20260709 12:17:27.520534 24174 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.523447 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.524065 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.489420 25255 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.460319 25134 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:27.532889 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 68539.9us
I20260709 12:17:27.508735 25269 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.496387 25262 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.532357 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:27.511966 25223 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.507823 25270 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:27.536883 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 81055.4us
I20260709 12:17:27.538908 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.525555 25185 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.526288 25230 raft_consensus.cc:3055] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.541061 25230 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:27.534850 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.542055 25230 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.544176 25282 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.539011 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:27.528092 25260 raft_consensus.cc:3055] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.535086 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.574575 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.577163 24216 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:27.578548 25230 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.578666 25283 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.537796 25223 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.589027 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.589455 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.590006 24246 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 2: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:27.591184 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.591439 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.583947 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.581563 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.581487 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.546348 25270 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.592573 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.591899 24248 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.598555 25223 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.599802 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.602859 25223 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.603669 25223 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:27.604220 24248 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:27.604910 24247 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:27.611254 24780 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.612231 25252 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.612599 24246 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:27.606281 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.622756 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.624907 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.625000 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.575139 25260 raft_consensus.cc:740] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:27.604606 25270 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.616816 25231 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:27.587553 24172 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:27.618379 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.619693 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.620036 24169 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.619942 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.582762 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.608295 25223 consensus_queue.cc:1059] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:27.579953 25269 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.630330 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.630179 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.638707 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:27.644654 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 112430us
I20260709 12:17:27.620693 25262 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.536615 25243 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.670209 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.671363 24170 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:27.671898 23995 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 188) took 2807 ms. Trace:
I20260709 12:17:27.670542 24214 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:27.652907 25269 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:27.653512 24243 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.679275 25285 raft_consensus.cc:3055] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.679764 25285 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:27.686275 24170 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.674768 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.640156 25231 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.681517 25282 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.681133 25269 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.697810 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:27.699966 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:27.705068 25268 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.705348 24173 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.704614 24214 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:27.706406 25278 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:27.706820 25278 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:27.685425 25260 consensus_queue.cc:260] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.707382 25204 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.711373 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.712224 24094 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:27.712864 25185 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.696906 24241 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:27.721529 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.696554 25282 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.726326 24245 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:27.700073 25273 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:27.722226 24100 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:27.729387 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.732599 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.732920 24097 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:27.732422 25278 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.734706 25278 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.736289 25222 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.737783 24176 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:27.743471 24098 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:27.743916 25185 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.752264 25288 raft_consensus.cc:3055] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:27.753787 25288 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:27.753432 25287 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:17:27.718685 25286 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.672271 23995 rpcz_store.cc:276] 0709 12:17:24.864080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:24.864298 (+   218us) service_pool.cc:224] Handling call
0709 12:17:27.671816 (+2807518us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:26.824743 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:26.831638 (+  6895us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:26.831675 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:17:26.831696 (+    21us) tablet.cc:662] Decoding operations
0709 12:17:26.832114 (+   418us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:26.832186 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:26.832213 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:17:26.832430 (+   217us) tablet.cc:701] Row locks acquired
0709 12:17:26.832448 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:17:26.832624 (+   176us) write_op.cc:270] Start()
0709 12:17:26.832741 (+   117us) write_op.cc:276] Timestamp: P: 1783599446832568 usec, L: 0
0709 12:17:26.832765 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:17:26.833521 (+   756us) log.cc:844] Serialized 535 byte log entry
0709 12:17:27.320261 (+486740us) op_driver.cc:464] REPLICATION: finished
0709 12:17:27.479052 (+158791us) write_op.cc:301] APPLY: starting
0709 12:17:27.497768 (+ 18716us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:27.502969 (+  5201us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:27.503162 (+   193us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:27.530422 (+ 27260us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:27.530615 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:17:27.530671 (+    56us) write_op.cc:312] APPLY: finished
0709 12:17:27.573297 (+ 42626us) log.cc:844] Serialized 22 byte log entry
0709 12:17:27.573563 (+   266us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:27.573676 (+   113us) write_op.cc:454] Released schema lock
0709 12:17:27.573727 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:27.579930 (+  6203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:27.587364 (+  7434us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":455382,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":136501,"apply.run_cpu_time_us":3068,"apply.run_wall_time_us":98429,"num_ops":1,"prepare.queue_time_us":830205,"prepare.run_cpu_time_us":26494,"prepare.run_wall_time_us":83296,"raft.queue_time_us":243858,"raft.run_cpu_time_us":3549,"raft.run_wall_time_us":95968,"replication_time_us":487295,"thread_start_us":745708,"threads_started":4,"wal-append.queue_time_us":89811}]]}
I20260709 12:17:27.755468 25286 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.778023 25286 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.738890 25222 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.754787 25288 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.680722 25285 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.730926 25282 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.809988 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.810371 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.811307 24170 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:27.813189 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:27.813793 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:27.814154 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.813910 24175 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:27.729671 25252 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.843410 25285 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.779017 25273 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:27.848613 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.848062 25270 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:27.851687 25204 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:27.854555 25268 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:27.865590 25268 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.858268 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.859730 25134 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.868327 25268 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:27.864526 25204 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.869647 25273 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:27.866767 24094 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:27.858114 25289 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.872830 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:27.873862 24807 raft_consensus.cc:2393] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:27.876137 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:27.876753 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:27.882198 24214 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:27.882797 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 306339us
I20260709 12:17:27.884858 25268 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.913978 25268 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.914402 25268 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.913396 25204 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:27.929616 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:27.930548 24176 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:27.874305 25260 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.937395 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.939718 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.941599 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.942348 24247 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.932108 25231 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:27.949467 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:27.949524 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 67495.2us
I20260709 12:17:27.947609 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:27.872885 25289 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.943599 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:27.953029 24249 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:27.954732 24214 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:27.959455 24807 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:27.974378 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.974423 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.976804 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:27.976312 24247 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
W20260709 12:17:27.980073 25220 consensus_meta.cc:287] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.511s	user 0.026s	sys 0.000s
I20260709 12:17:27.980589 25220 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:27.981027 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:27.981711 24247 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:27.983101 25281 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.983642 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.983752 25281 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:27.984354 24247 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.984788 24241 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:27.985191 25289 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:27.986228 25281 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:27.971095 25133 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:27.956650 25204 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:27.999719 25204 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:28.000190 25204 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.951350 25266 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.003702 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:27.995388 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.005061 24176 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:28.006052 24247 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:28.004437 24241 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:27.992406 25220 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:27.951773 25290 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:27.971514 25275 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:28.034230 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.020324 25275 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:28.035367 25275 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.035439 25255 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.035953 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.037346 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.039319 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.039352 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:28.042925 25286 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.043834 24812 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:28.045303 25286 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:28.046303 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:28.047204 24807 raft_consensus.cc:2393] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:28.048382 24815 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.048115 25275 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.050395 25275 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:28.052529 25277 consensus_meta.cc:287] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.577s	user 0.013s	sys 0.010s
I20260709 12:17:28.052987 25277 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:28.057147 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.064678 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.066327 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.067090 24170 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.056066 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.068465 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:28.065469 24175 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
W20260709 12:17:28.071157 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.074134 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 84932.8us
I20260709 12:17:28.076092 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:28.012323 25270 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:17:28.091198 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:28.092502 24815 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:28.031189 25281 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:17:28.082896 25252 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:28.091343 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 58479.9us
I20260709 12:17:28.106717 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.108256 24250 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:28.113472 24094 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.089227 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.025556 25290 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.120451 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:28.120669 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 52340.5us
I20260709 12:17:28.095754 25275 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.124274 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:28.125094 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:28.127956 25264 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.705s	user 0.018s	sys 0.004s
I20260709 12:17:28.099252 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.128556 25270 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:28.129302 24175 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:28.129287 24171 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:28.091495 25268 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:28.130893 25234 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.708s	user 0.018s	sys 0.004s
I20260709 12:17:28.148453 24094 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:28.148658 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.122258 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.115245 25277 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:28.151297 24780 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:28.145602 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:28.171859 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.153059 24214 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.130040 24098 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.153463 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.181845 24245 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.155035 24176 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:28.152889 23996 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 3 to 4, term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to <none>, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 2 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:28.158398 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.159197 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.159281 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.128448 25264 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.160459 25268 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:28.163331 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.164052 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.147073 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.164781 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.165477 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.200755 24168 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.201648 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.201753 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.202091 24168 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.173923 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.172993 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:28.203648 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.132670 25270 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:28.203946 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.205237 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.205075 25270 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.206059 24250 raft_consensus.cc:2393] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:28.199641 24093 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.206660 25270 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.207108 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet ee66a7413b024d4b8e542242a567c0cf with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:40964
I20260709 12:17:28.216349 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.185864 23996 catalog_manager.cc:5697] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:28.197500 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.164355 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.206955 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:28.186688 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.168798 25243 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.179375 25134 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:28.224833 24246 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:28.192327 25291 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.230885 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.228682 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.184262 25234 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.235348 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.232810 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:28.200639 24243 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.012s
W20260709 12:17:28.185824 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 55588.6us
I20260709 12:17:28.243820 25234 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:28.244196 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.244875 24171 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.245011 25234 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:28.247663 25292 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:17:28.209285 25273 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.208105 25135 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:28.207670 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.240458 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:28.223069 24097 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.209614 25255 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:28.266759 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:28.264916 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 113973us
I20260709 12:17:28.269227 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.271771 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.278666 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.279222 24173 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.270923 24170 raft_consensus.cc:2376] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:28.279577 24780 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:28.276839 24175 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:28.201294 25252 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:28.289011 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.289296 24066 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:28.243052 24243 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:28.306257 24247 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.265663 25296 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:28.299229 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.299917 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.302528 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.271257 25288 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.333097 25204 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.265534 25135 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:28.228583 25295 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:17:28.313952 24176 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.263449 25299 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.264241 25235 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:28.275314 25273 raft_consensus.cc:697] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:28.315943 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:28.302672 25262 consensus_meta.cc:287] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.627s	user 0.016s	sys 0.009s
I20260709 12:17:28.313812 25303 tablet_replica.cc:333] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:17:28.304528 25289 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.321342 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:28.349088 25282 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.014s
I20260709 12:17:28.322003 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:28.365818 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.322800 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:28.323551 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.367555 24170 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
W20260709 12:17:28.325415 24244 consensus_meta.cc:287] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.649s	user 0.020s	sys 0.024s
W20260709 12:17:28.328838 25278 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.593s	user 0.020s	sys 0.007s
W20260709 12:17:28.333689 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.373172 24242 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:28.263603 25291 raft_consensus.cc:697] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:28.374481 25291 consensus_queue.cc:237] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.375205 24172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "c090031f610346ed82285cd847bca6d6"
 from {username='slave'} at 127.0.0.1:51222
I20260709 12:17:28.375989 24172 raft_consensus.cc:606] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Received request to transfer leadership to TS c090031f610346ed82285cd847bca6d6
I20260709 12:17:28.376397 24172 raft_consensus.cc:614] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:28.342409 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.377065 24095 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:28.316382 25240 consensus_meta.cc:287] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.818s	user 0.012s	sys 0.015s
I20260709 12:17:28.377982 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.378443 24248 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:28.379621 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.381067 24170 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.357129 25295 consensus_queue.cc:1243] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:28.349709 24066 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.349778 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.353636 24175 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:28.357635 24245 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:28.358820 24249 raft_consensus.cc:2393] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:17:28.321468 25269 consensus_meta.cc:287] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.613s	user 0.007s	sys 0.013s
I20260709 12:17:28.347100 25135 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.324327 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.397343 24173 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:28.378654 24176 raft_consensus.cc:2376] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:28.382570 24247 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
W20260709 12:17:28.347210 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 67709.7us
I20260709 12:17:28.393584 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.398856 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:28.394550 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:28.399467 24247 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.400915 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.401834 24780 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.317330 25252 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.395146 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.406637 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:28.403254 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 80530.3us
I20260709 12:17:28.357471 25235 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:28.435304 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.377108 24244 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:28.421052 25266 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:28.382896 25301 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.393018 25243 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:28.382158 25240 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.407037 25234 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.382699 25306 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.432085 24170 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.430593 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.429837 24247 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:28.440567 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.452009 24249 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:28.395699 25133 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:28.371138 25282 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.408756 25299 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:28.425529 25281 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:28.457849 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.454815 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.425076 25307 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:17:28.457700 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.458518 24173 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.459444 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:28.395361 25269 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.460683 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:28.463835 24248 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.454620 25133 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:28.436504 25290 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:28.460167 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.443117 25266 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:28.434589 25296 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:17:28.460820 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 59077.4us
I20260709 12:17:28.462394 24246 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:28.466580 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.465662 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.449069 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.472225 24780 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:28.479091 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:28.480607 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.455269 25264 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:28.506546 24248 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:28.509121 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.457276 25275 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:28.458299 25281 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:28.514344 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.467133 25133 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.435638 25273 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.461350 25302 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.515671 25303 raft_consensus.cc:2243] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:28.539278 25310 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.539038 25243 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.518826 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:28.523981 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:28.513706 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.525914 25235 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:28.527889 25240 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:28.512997 24097 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:28.500078 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 52107.4us
I20260709 12:17:28.561926 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:28.562175 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:28.539726 25303 raft_consensus.cc:2272] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:28.545991 24807 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:28.536753 25281 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:28.581790 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.555279 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:28.543427 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.556957 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.560767 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:28.516482 25285 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.535650 25309 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:28.539865 25310 raft_consensus.cc:697] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:28.568440 24244 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.558899 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.569856 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.571431 24245 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.571446 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.572224 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:28.630182 25304 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260709 12:17:28.571787 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.631477 24168 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:28.578142 25303 ts_tablet_manager.cc:1916] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:17:28.598379 24067 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.518s (SENT)
I20260709 12:17:28.599049 24246 raft_consensus.cc:2393] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:28.635036 24245 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.636646 24245 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.599427 24247 raft_consensus.cc:2393] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:28.599944 24248 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.638828 24248 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.638996 24812 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.640332 24248 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.600749 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:28.598383 25235 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.603690 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.537469 25266 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.611824 25285 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:28.612524 24249 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.644743 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.564095 25302 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:28.636934 24067 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:28.648787 24245 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.642762 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.608532 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:28.609793 24095 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:28.656716 24168 raft_consensus.cc:2410] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 2 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:17:28.645665 24247 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.657065 25235 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.659219 24172 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:28.659078 24247 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.661629 25235 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:28.662834 25285 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.663434 24247 raft_consensus.cc:1240] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:28.601617 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 296652us
I20260709 12:17:28.668118 24174 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:28.669636 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.669881 25302 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.679096 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.679193 25310 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.533126 25299 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.685578 25311 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.685822 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:28.690124 25133 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.636873 24098 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:28.691696 25282 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:28.693341 25204 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:28.635495 24093 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:28.681461 25135 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.702167 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:28.703171 24172 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:28.704118 25135 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:28.707468 25269 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:28.673735 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1109) took 1034 ms. Trace:
W20260709 12:17:28.655454 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 53066.3us
I20260709 12:17:28.708405 24244 rpcz_store.cc:276] 0709 12:17:27.640702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.567678 (+926976us) service_pool.cc:224] Handling call
0709 12:17:28.568137 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:28.632557 (+ 64420us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:28.666618 (+ 34061us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:28.711123 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:28.714135 25297 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:28.717754 24247 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:28.718726 24241 consensus_meta.cc:287] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.003s
I20260709 12:17:28.736330 24246 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.744491 24241 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:28.745404 24248 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.731173 25297 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:28.727056 25289 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:28.753947 25134 consensus_queue.cc:1059] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:28.755625 25134 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:28.699874 25311 raft_consensus.cc:697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:28.762140 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.756606 25134 raft_consensus.cc:3055] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:28.752405 25270 consensus_meta.cc:287] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.003s
I20260709 12:17:28.770300 25135 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:28.770534 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.742779 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 39) took 1154 ms. Trace:
I20260709 12:17:28.766160 25260 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.763832 25231 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:28.770860 25311 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.774160 25266 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.628141 25296 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:28.777220 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 168811us
W20260709 12:17:28.777338 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 191791us
W20260709 12:17:28.789227 24067 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.516s (SENT)
I20260709 12:17:28.789649 24067 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:28.765765 25134 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:28.790844 25135 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:28.791276 25135 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:28.779769 25223 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:28.778533 25288 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:28.783017 25231 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:28.798942 25295 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:28.795549 25270 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:28.801358 25135 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.803145 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:28.781240 25235 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:17:28.780767 24242 rpcz_store.cc:276] 0709 12:17:27.588234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.619037 (+ 30803us) service_pool.cc:224] Handling call
0709 12:17:27.974216 (+355179us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:28.742573 (+768357us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54003598d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:28.742708 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":952822528}
I20260709 12:17:28.819041 24101 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:28.822039 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.784807 25260 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.823359 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.829874 24100 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.785562 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.833665 25300 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:17:28.835028 25300 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:28.835397 25300 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:28.836314 25300 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.837613 25300 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.842170 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.808202 25223 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:17:28.843989 24101 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.846064 24101 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.847445 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.849977 24101 raft_consensus.cc:1240] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.818835 25290 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:28.856659 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 384493us
I20260709 12:17:28.822445 25295 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:28.860585 24780 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:28.863129 25295 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:28.828608 25289 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:17:28.876747 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.884866 25312 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:28.884884 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:28.884452 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:28.882755 25135 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.883244 25309 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:28.889264 25234 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:28.907382 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:28.909758 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:28.878031 25295 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.885679 25312 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:28.905416 25307 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:28.858212 25134 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.905551 25133 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:28.950546 25301 raft_consensus.cc:697] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:28.859869 25231 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:28.979463 25312 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:28.980757 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:28.954391 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:28.921115 25288 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:17:28.988292 24097 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:28.985312 24806 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:28.989137 25134 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.002436 25260 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:28.988974 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:29.003350 24242 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:28.988976 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.004495 24174 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:28.924162 25307 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:29.005910 25307 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.005818 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:28.997030 24168 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:28.999287 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:28.997586 25313 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 12:17:28.952198 25301 consensus_queue.cc:237] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:29.010622 25312 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:29.011279 25312 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:29.011821 25312 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:29.009624 24098 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
W20260709 12:17:29.030437 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.037199 25295 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:28.858543 25297 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:29.044340 25297 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:29.060352 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.041267 25231 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:29.110479 24216 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.509s (SENT)
I20260709 12:17:29.111052 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:29.105527 25261 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.019s	sys 0.050s
W20260709 12:17:29.092190 25252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.018s	sys 0.015s
W20260709 12:17:29.114776 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 349374us
W20260709 12:17:29.120500 25261 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.020s	sys 0.051s
W20260709 12:17:29.120761 25291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.030s
I20260709 12:17:29.119455 25204 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:29.121102 25252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.019s	sys 0.015s
I20260709 12:17:29.108873 25281 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:29.109813 25314 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 12:17:29.143211 24214 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.003s	sys 0.032s
W20260709 12:17:29.147972 24214 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.003s	sys 0.032s
W20260709 12:17:29.140631 25291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.004s	sys 0.031s
I20260709 12:17:29.152464 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:29.180549 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:29.181408 24096 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.163404 25243 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.158974 25281 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:29.193239 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:29.221709 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:29.222693 24246 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:29.235569 24246 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:29.243379 25285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.009s	sys 0.029s
I20260709 12:17:29.184060 25135 consensus_queue.cc:1059] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:17:29.248207 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 827) took 1228 ms. Trace:
I20260709 12:17:29.184717 25134 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:17:29.216355 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:29.237481 25290 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:29.236771 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:29.209931 25243 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:29.255472 25285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.010s	sys 0.029s
I20260709 12:17:29.262459 24250 rpcz_store.cc:276] 0709 12:17:28.019291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.291513 (+272222us) service_pool.cc:224] Handling call
0709 12:17:29.247833 (+956320us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54000b5ed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:29.248100 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1881730304}
I20260709 12:17:29.286691 24168 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.316594 24096 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:29.327874 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:29.330334 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 490508us
W20260709 12:17:29.286805 25306 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.027s	sys 0.027s
W20260709 12:17:29.259861 25299 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.013s	sys 0.014s
W20260709 12:17:29.267282 24216 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.667s (SENT)
I20260709 12:17:29.270169 24095 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:29.279585 24243 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:29.379572 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:29.440191 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 172957us
W20260709 12:17:29.509716 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:29.511620 24216 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.697s (SENT)
I20260709 12:17:29.512295 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:29.445815 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.267436 25309 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:29.330399 25273 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:29.440131 25133 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:29.274390 24097 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:29.450075 25306 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.027s	sys 0.033s
I20260709 12:17:29.284920 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:29.486562 24176 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.327255 25325 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260709 12:17:29.376147 25303 ts_tablet_manager.cc:1929] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:29.317965 25135 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:29.439392 25299 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.015s	sys 0.017s
W20260709 12:17:29.445722 25235 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.004s	sys 0.025s
W20260709 12:17:29.503825 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.013s	sys 0.038s
W20260709 12:17:29.571007 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.014s	sys 0.038s
W20260709 12:17:29.571477 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 752096us
I20260709 12:17:29.265601 25260 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.221s
I20260709 12:17:29.387343 24092 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:29.328904 25307 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:29.557941 25273 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:29.562114 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55097.8us
I20260709 12:17:29.617508 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:29.494261 25223 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:17:29.493578 25285 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:17:29.539577 25204 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:29.578613 25133 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:29.630311 25133 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:29.586591 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.540280 25306 raft_consensus.cc:697] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:17:29.564669 25312 consensus_meta.cc:287] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.550s	user 0.014s	sys 0.000s
W20260709 12:17:29.600766 25326 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260709 12:17:29.601547 25324 log.cc:927] Time spent T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:17:29.601475 25240 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:29.602274 25319 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:17:29.604635 25321 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 12:17:29.610400 25297 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:29.661594 25297 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:29.576095 25235 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.005s	sys 0.026s
I20260709 12:17:29.571213 25303 log.cc:1199] T ee66a7413b024d4b8e542242a567c0cf P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/ee66a7413b024d4b8e542242a567c0cf
I20260709 12:17:29.664722 25303 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40964 (request call id 71) took 1592 ms. Trace:
I20260709 12:17:29.665120 25303 rpcz_store.cc:276] 0709 12:17:28.091264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.121454 (+ 30190us) service_pool.cc:224] Handling call
0709 12:17:28.290618 (+169164us) ts_tablet_manager.cc:1151] Deleting tablet ee66a7413b024d4b8e542242a567c0cf
0709 12:17:28.298908 (+  8290us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:17:28.914058 (+615150us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:29.364413 (+450355us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:29.664598 (+300185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67177,"tablet-delete.queue_time_us":53531,"thread_start_us":37067,"threads_started":1}
I20260709 12:17:29.667285 25240 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:29.673413 25260 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:29.673985 25260 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:29.647414 25306 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:29.653139 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:29.718410 24168 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:29.667861 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1110) took 1989 ms. Trace:
I20260709 12:17:29.622790 25333 raft_consensus.cc:3055] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:29.642114 25133 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:29.656066 24241 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:29.639962 25288 raft_consensus.cc:3055] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:29.727291 25288 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:29.731088 25309 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:29.670373 25240 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:29.721098 24243 rpcz_store.cc:276] 0709 12:17:27.678408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.579022 (+900614us) service_pool.cc:224] Handling call
0709 12:17:29.257360 (+678338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:29.533670 (+276310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:29.667543 (+133873us) spinlock_profiling.cc:243] Waited 669 ms on lock 0x7b54000b5ed0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:29.667777 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1539494656}
I20260709 12:17:29.577294 25336 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.650080 25312 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:29.687952 25273 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:29.733642 25333 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:29.754261 24806 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:17:29.742741 25231 consensus_meta.cc:287] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.662s	user 0.006s	sys 0.006s
I20260709 12:17:29.736300 25260 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:29.739645 25133 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.750880 25312 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:29.746269 25336 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:29.756218 25333 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:29.765064 25234 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:29.765333 25333 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.765642 25234 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:29.770103 25234 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:29.733942 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet ee66a7413b024d4b8e542242a567c0cf (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:29.771453 25234 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:29.771486 23985 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49949.7us
I20260709 12:17:29.772986 25307 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:29.773808 25243 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:29.773142 23998 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 2 to 1, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 1 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:29.774803 25260 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.766477 25336 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:29.776558 25295 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.739s	user 0.006s	sys 0.008s
I20260709 12:17:29.777807 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 96) took 2375 ms. Trace:
I20260709 12:17:29.787590 23997 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 2 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:29.778281 23996 rpcz_store.cc:276] 0709 12:17:27.401983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.402161 (+   178us) service_pool.cc:224] Handling call
0709 12:17:27.417592 (+ 15431us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:17:29.777729 (+2360137us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:28.372118 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:28.435570 (+ 63452us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:28.441650 (+  6080us) write_op.cc:435] Acquired schema lock
0709 12:17:28.443683 (+  2033us) tablet.cc:662] Decoding operations
0709 12:17:28.520733 (+ 77050us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:28.527393 (+  6660us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:28.527450 (+    57us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:28.528176 (+   726us) tablet.cc:701] Row locks acquired
0709 12:17:28.528236 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:17:28.528521 (+   285us) write_op.cc:270] Start()
0709 12:17:28.528686 (+   165us) write_op.cc:276] Timestamp: P: 1783599448528411 usec, L: 0
0709 12:17:28.528733 (+    47us) op_driver.cc:348] REPLICATION: starting
0709 12:17:28.530117 (+  1384us) log.cc:844] Serialized 884 byte log entry
0709 12:17:29.224392 (+694275us) op_driver.cc:464] REPLICATION: finished
0709 12:17:29.717696 (+493304us) write_op.cc:301] APPLY: starting
0709 12:17:29.735374 (+ 17678us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:29.743119 (+  7745us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:29.743293 (+   174us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:29.743765 (+   472us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:29.743947 (+   182us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:29.743991 (+    44us) write_op.cc:312] APPLY: finished
0709 12:17:29.744206 (+   215us) log.cc:844] Serialized 28 byte log entry
0709 12:17:29.745067 (+   861us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:29.745172 (+   105us) write_op.cc:454] Released schema lock
0709 12:17:29.745216 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:29.746191 (+   975us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:29.746229 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":279256,"reported_tablets":3,"spinlock_wait_cycles":29529472,"child_traces":[["op",{"apply.queue_time_us":424278,"apply.run_cpu_time_us":2430,"apply.run_wall_time_us":97158,"num_ops":2,"prepare.queue_time_us":94481,"prepare.run_cpu_time_us":5451,"prepare.run_wall_time_us":166666,"replication_time_us":695426,"thread_start_us":365674,"threads_started":2}]]}
I20260709 12:17:29.816964 24093 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:29.818930 24097 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:29.825562 23997 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 2 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:29.842832 24214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.031s	sys 0.034s
W20260709 12:17:29.843293 24214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.031s	sys 0.034s
W20260709 12:17:29.844570 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 219332us
W20260709 12:17:29.842206 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 264834us
I20260709 12:17:29.851984 24214 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:29.859133 24176 raft_consensus.cc:1240] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:29.862572 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.863124 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.864415 24176 raft_consensus.cc:2393] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:17:29.864876 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.866107 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:29.867479 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 166900us
I20260709 12:17:29.868628 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:29.869216 24216 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.600s (SENT)
I20260709 12:17:29.869475 24175 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:29.869824 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:29.873364 24169 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:29.866932 24168 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:29.866397 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.876416 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:29.876647 24173 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:29.877111 24168 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:29.878278 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:29.870630 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:29.874723 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:29.877139 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:29.881072 24169 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.881007 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:29.823472 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 435879us
I20260709 12:17:29.926580 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.926854 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.926692 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.952055 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.941138 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.964653 24169 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:29.989357 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:29.990803 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.940109 24171 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:29.851058 25275 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.910962 25204 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:29.997807 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 128597us
I20260709 12:17:29.990399 24175 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:29.996945 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.929983 25340 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:29.933308 25240 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:30.000043 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:17:30.001174 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 122968us
I20260709 12:17:30.001813 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.002336 24214 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:30.005589 24242 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:30.007122 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:29.996649 25291 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.011524 24243 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:30.012867 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:30.013000 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:30.013634 24250 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:30.013731 24241 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.013857 24246 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.016332 24246 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.016183 25297 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.018044 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:30.018114 25288 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.019824 25288 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:29.992738 25283 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:29.965562 25314 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:17:30.032450 25134 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:30.034384 25134 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:29.981171 25135 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:30.035636 25134 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.037312 24812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 200) took 1133 ms. Trace:
I20260709 12:17:30.037668 24812 rpcz_store.cc:276] 0709 12:17:28.901543 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:28.901677 (+   134us) service_pool.cc:224] Handling call
0709 12:17:30.034325 (+1132648us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001b35d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:30.034469 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2487490944}
I20260709 12:17:30.035005 25306 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.032763 25315 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:30.001241 25275 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.039841 25315 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:29.938850 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:29.963289 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:30.124884 24241 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:30.039736 25135 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:30.165944 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.133635 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.034s	sys 0.033s
W20260709 12:17:30.166944 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.038s	sys 0.035s
W20260709 12:17:30.167567 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.167860 24216 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.939s (SENT)
W20260709 12:17:30.130760 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.168885 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:30.169410 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.136515 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:17:30.168375 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.170881 24175 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.153533 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:30.148538 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 143794us
I20260709 12:17:30.179507 25204 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:30.179854 25299 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:30.038792 25240 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.149956 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:30.039681 25306 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.031561 25297 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.183585 25266 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.184898 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:30.184635 25266 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.186033 25235 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:30.186518 25306 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:30.186918 25235 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.198261 24214 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:30.189646 25315 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:30.040567 25252 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.109043 24167 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:30.201503 25354 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:30.202621 25354 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.203540 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:30.205415 25252 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:30.205938 25354 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:30.207672 25240 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:30.194322 25275 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.208880 25325 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:30.207523 25252 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.209821 25223 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.209681 25240 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.204659 24167 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:30.212491 24172 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:30.213326 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:30.033560 25283 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.217160 25266 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.182113 25204 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.009684 25291 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.198541 25235 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:30.188395 25314 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:30.105196 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 487543us
I20260709 12:17:30.218636 25283 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.128984 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:30.178622 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:17:30.126130 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 96730.6us
W20260709 12:17:30.125837 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 90458.3us
I20260709 12:17:30.125388 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:30.215588 25133 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:30.097111 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.110235 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:30.227043 24097 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.227558 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:30.224134 25133 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:30.229912 25334 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.230552 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:30.230865 25334 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.210777 24242 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.230928 24096 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.231839 24100 raft_consensus.cc:2393] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:30.232976 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.210784 25223 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.238262 24094 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:30.241130 24100 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.242142 25223 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.242420 24099 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:30.043143 25134 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.243624 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.245101 24095 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.247381 24172 raft_consensus.cc:3055] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:30.248373 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.249255 24101 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:30.248401 25291 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.252552 25270 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.252631 24067 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.253500 25270 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.254653 25223 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:30.229965 25133 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:30.255369 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 57384.5us
I20260709 12:17:30.247910 24172 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:30.230639 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:30.262974 24214 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:30.263469 24097 raft_consensus.cc:2376] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2. Re-sending same reply.
I20260709 12:17:30.236791 25334 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.268496 24214 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:30.254966 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.278513 24096 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.206749 25354 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:30.291695 25270 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:30.303125 24171 raft_consensus.cc:2410] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
W20260709 12:17:30.303308 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.255355 25223 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:30.319083 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.319392 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.320956 24176 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:30.322077 25283 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.322232 25314 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:30.323160 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54862.9us
I20260709 12:17:30.233208 25306 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.091s
I20260709 12:17:30.325685 25355 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.327817 25291 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.054191 25340 raft_consensus.cc:697] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:30.352542 24812 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:30.333086 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.332662 24172 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:30.378432 23998 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.009s	sys 0.036s
W20260709 12:17:30.379068 23998 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.010s	sys 0.036s
I20260709 12:17:30.378760 24172 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.335038 25295 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:30.335875 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 166747us
I20260709 12:17:30.353788 24167 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:30.380769 24097 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:30.354528 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.381140 24141 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:30.359695 24175 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:30.385555 25134 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:30.386183 25134 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.386621 25134 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.388422 24097 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:30.382896 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.331954 25223 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.389346 24779 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:30.392604 25310 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:30.392972 25310 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.392900 25309 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:30.393589 25310 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.389323 25317 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:30.396855 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:30.397133 25340 consensus_queue.cc:237] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.399214 25309 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:30.399966 25309 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.400480 25309 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.399307 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:30.403205 24175 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:30.328271 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.398586 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:30.406042 24173 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:30.333094 25285 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.414203 25235 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:30.414346 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.415107 25301 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:30.415692 25301 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:30.416123 25134 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.416867 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:30.417040 25311 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.417837 25295 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:30.417622 25311 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.418263 25295 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.418347 24171 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.418800 25295 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.417644 24176 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:17:30.421051 25260 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.008s
I20260709 12:17:30.413384 25355 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:30.423502 25355 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.416882 25301 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:30.427546 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 172733us
I20260709 12:17:30.428689 24067 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.429741 25334 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:30.430567 24067 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.446944 24171 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.443691 25134 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.453984 24170 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:30.465293 24174 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:30.409919 25283 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:30.412318 25291 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:30.472574 25332 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:30.485286 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.494946 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.440238 25295 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.491818 25334 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:30.502139 24097 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:30.504861 25331 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.505594 25362 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:30.510456 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 127827us
I20260709 12:17:30.510886 25362 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.512639 25283 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.514664 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.510504 25331 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.519191 25331 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.462708 25317 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:17:30.524185 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.515518 25362 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:30.523838 25291 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:30.535650 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 105153us
I20260709 12:17:30.537173 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.541520 24100 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:30.542482 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.542870 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.543246 24100 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:30.544106 24095 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:30.544315 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 59667.2us
I20260709 12:17:30.545612 24781 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:30.497588 25285 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.548552 25306 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:30.549641 25285 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.550107 24099 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:30.550130 25314 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:30.551365 25314 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:30.551462 25311 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:30.551826 25314 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:30.552148 25288 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.532s	user 0.014s	sys 0.006s
W20260709 12:17:30.554049 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.539978 25133 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.557750 24168 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:30.560453 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.536191 25332 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.561415 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:30.562170 24815 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:30.572324 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.572659 25133 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:30.574265 24100 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:30.572741 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 405183us
W20260709 12:17:30.585270 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.486456 25310 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.591918 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:30.592549 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:30.596835 25235 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:30.603116 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.599737 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.570598 25309 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.617455 25133 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:30.618144 25133 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:30.619700 25133 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.577482 25311 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:17:30.610077 25288 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:30.646644 24216 leader_election.cc:336] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.024s (SENT)
I20260709 12:17:30.654140 24812 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:30.650105 24214 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:17:30.663995 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 143628us
I20260709 12:17:30.648612 25288 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:30.699316 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 84640.3us
W20260709 12:17:30.696075 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 46124.7us
I20260709 12:17:30.644546 24809 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:30.714751 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 68175.3us
I20260709 12:17:30.720600 25362 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:30.721295 25362 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.721056 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet 7b5b70d71470484d8fc5f942623adb98 with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:59342
I20260709 12:17:30.721832 25362 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.724224 24243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "c090031f610346ed82285cd847bca6d6"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:17:30.725420 24243 raft_consensus.cc:606] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Received request to transfer leadership to TS c090031f610346ed82285cd847bca6d6
I20260709 12:17:30.725942 24243 raft_consensus.cc:614] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:30.727356 25266 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:30.702363 25288 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:30.729497 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.735138 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 154933us
W20260709 12:17:30.735514 25363 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.137s	user 0.000s	sys 0.002s
I20260709 12:17:30.735738 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:30.736294 24067 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.736637 24246 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.738511 25297 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:30.728139 25266 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.712108 24806 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:30.753917 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:30.688670 25235 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.719303 25332 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:30.724247 24242 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:30.708053 25301 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:17:30.782933 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:30.783618 25309 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:30.784482 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:30.785219 24242 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.756879 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:30.787186 25295 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.787472 24241 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:30.788484 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.790314 24095 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:30.755463 25240 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.791742 25240 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.768379 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:30.769325 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:30.770522 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:30.772663 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:30.775305 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:30.777356 25357 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:30.778100 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:30.781239 25310 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:30.793370 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:30.812904 24140 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.814826 24100 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 2.
I20260709 12:17:30.823922 25133 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:30.827913 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:30.844378 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 90577.6us
I20260709 12:17:30.845201 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:30.848272 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.832940 24067 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:30.850059 25134 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:30.850515 25134 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:30.850864 25134 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.851042 25133 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:30.833663 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:30.853292 24250 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:30.862684 24247 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:30.864935 25357 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:30.865794 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:30.866488 24099 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.845726 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:30.894134 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 84499.4us
W20260709 12:17:30.892014 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46467.4us
I20260709 12:17:30.936410 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:30.930886 24249 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:30.856305 25223 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:30.978582 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:30.979852 25332 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:30.999516 25135 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:30.999668 25332 raft_consensus.cc:697] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:31.001315 25223 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:30.894665 24779 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:17:31.006294 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 137991us
W20260709 12:17:30.986424 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.007454 25240 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:31.008457 25301 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:31.008950 25301 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:31.009397 25301 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:30.966745 25334 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:30.987703 25235 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:30.995532 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 161960us
W20260709 12:17:31.011765 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50038.3us
I20260709 12:17:31.013585 25362 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.014045 25296 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:31.016230 25362 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:30.998117 25357 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:30.973918 25379 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:17:31.036080 24101 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:30.860543 25297 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 12:17:31.043008 25134 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:31.037003 25283 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.026s	sys 0.012s
W20260709 12:17:31.055655 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.061623 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 212651us
I20260709 12:17:31.076077 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:31.087913 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:31.091274 25134 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:31.042194 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:31.094974 24099 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:31.090690 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:31.090690 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:31.095571 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 207989us
I20260709 12:17:31.099414 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:31.050104 25270 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:31.084848 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72342.6us
I20260709 12:17:31.081643 24246 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
W20260709 12:17:31.105405 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.075309 24098 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:31.080600 25283 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.027s	sys 0.013s
I20260709 12:17:31.074594 25260 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:31.126014 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.083886 25223 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.133666 24099 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.000972 25332 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:31.140313 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.133116 25314 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.578s	user 0.008s	sys 0.008s
W20260709 12:17:31.149050 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 137381us
W20260709 12:17:31.152469 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 401761us
I20260709 12:17:31.145141 24807 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:31.155741 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.174226 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:31.151360 24241 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:31.132231 25260 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.127425 25273 consensus_queue.cc:1059] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:17:31.183701 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:31.180568 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:17:31.204383 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.181000 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1232) took 1306 ms. Trace:
I20260709 12:17:31.206625 24173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:51222
W20260709 12:17:31.204330 24216 leader_election.cc:336] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.133s (SENT)
I20260709 12:17:31.154496 25314 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.141184 25356 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.066s
I20260709 12:17:31.208824 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:31.164577 25223 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.218848 24176 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.207540 24173 raft_consensus.cc:606] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:31.188058 25240 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.206228 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:31.233928 25261 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:17:31.234148 25384 tablet_replica.cc:333] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
W20260709 12:17:31.235610 25382 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:17:31.172283 25288 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.205564 24170 rpcz_store.cc:276] 0709 12:17:29.897701 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.184398 (+286697us) service_pool.cc:224] Handling call
0709 12:17:31.180794 (+996396us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b54002adad4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:31.180925 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542985600}
W20260709 12:17:31.239988 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53088.4us
I20260709 12:17:31.247203 25240 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.252908 25240 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:31.258792 24242 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:31.259619 25354 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:31.261082 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.234493 25359 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.115s
W20260709 12:17:31.265224 24809 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.003s
I20260709 12:17:31.265656 24809 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:31.267931 25223 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:31.272038 25260 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:31.273922 25314 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:31.274797 25266 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:31.275441 24094 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:31.276335 25288 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:31.241011 24098 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.287940 24098 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:31.289915 24170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:51222
I20260709 12:17:31.290759 24170 raft_consensus.cc:606] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:31.263087 25235 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:31.297895 25398 consensus_queue.cc:1059] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:31.298497 24140 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.299798 25398 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:31.296058 24170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:51222
I20260709 12:17:31.302623 24170 raft_consensus.cc:606] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:31.305831 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 206487us
I20260709 12:17:31.306422 24141 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:31.306902 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:17:31.307332 24216 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.161s (SENT) [suppressed 84 similar messages]
I20260709 12:17:31.330128 25391 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:31.333051 25295 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:31.333400 25391 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.333832 25295 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:31.335707 25391 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.335919 25295 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.319346 25398 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:31.324491 25297 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.340211 25397 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.340615 25384 raft_consensus.cc:2243] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:17:31.340888 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:31.341394 24170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:51222
I20260709 12:17:31.340631 25392 raft_consensus.cc:3055] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.355407 25392 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:31.355495 24170 raft_consensus.cc:606] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:31.343456 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:31.344455 25359 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.345104 25270 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:31.333868 25235 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:17:31.348141 25295 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.338220 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:31.327848 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:31.362025 25133 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:31.362226 24066 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:31.365196 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.371316 25133 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:31.325179 25285 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:17:31.360285 25359 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:17:31.352694 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54382.8us
I20260709 12:17:31.368403 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:31.351709 25297 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:31.370676 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 230483us
I20260709 12:17:31.373790 24176 raft_consensus.cc:2410] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 3 because replica has last-logged OpId of term: 1 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:17:31.373661 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:31.363515 25270 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:31.358887 25398 raft_consensus.cc:697] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:31.373027 25273 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:31.410137 25133 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.416085 24099 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:31.413939 24216 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.925s (SENT)
I20260709 12:17:31.417578 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:31.420342 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:31.383363 25288 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:31.413659 25235 consensus_queue.cc:1243] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:17:31.425374 25285 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.425439 25365 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:31.425793 24067 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.426507 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:31.356774 25392 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.427318 24095 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.428221 25359 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.429637 25359 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.429356 25273 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.422489 25384 raft_consensus.cc:2272] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:17:31.433820 24096 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:31.434278 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.436333 25134 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:31.436623 24216 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.938s (SENT)
I20260709 12:17:31.437198 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:31.438831 25291 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:31.440107 25314 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:31.441116 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:31.441766 24173 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.442746 25291 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.443518 25291 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.446527 25291 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:31.447642 25398 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.383013 25397 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.453117 24096 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:31.406803 25270 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.441622 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:31.456353 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:31.457051 24806 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.457981 25297 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:31.458717 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.460493 25295 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:31.410198 25334 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:31.426093 25285 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.462464 25266 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:31.419282 24809 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:31.464138 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:31.434340 24097 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.467684 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:31.468444 24101 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:31.487612 24173 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:31.489348 24249 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:31.467785 24175 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.492913 24175 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:17:31.494477 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 68785.9us
I20260709 12:17:31.491910 24214 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:31.432152 25273 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:31.487141 25288 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:31.531500 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:31.490484 25334 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:31.498808 25384 ts_tablet_manager.cc:1916] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:17:31.501451 25365 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:31.536237 24245 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:31.541507 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:31.541464 24067 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.570281 25204 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:31.570763 24214 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:17:31.571314 25301 consensus_meta.cc:287] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.561s	user 0.013s	sys 0.005s
I20260709 12:17:31.571903 25204 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:31.490717 25354 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.048s
I20260709 12:17:31.567400 24175 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:31.599933 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.607843 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:31.542054 24781 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:31.603996 25355 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:31.624425 24092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.034s	sys 0.041s
I20260709 12:17:31.601078 25295 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:31.625156 24175 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.634439 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 54) took 1114 ms. Trace:
I20260709 12:17:31.634559 25397 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:31.571920 25301 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:31.647774 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 142993us
I20260709 12:17:31.600946 25283 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:17:31.651829 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:31.653496 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.632712 25295 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:31.624033 25334 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.646888 25375 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:31.628521 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 96075.6us
I20260709 12:17:31.619760 25365 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:17:31.671801 24245 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:31.651502 25355 raft_consensus.cc:697] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:31.684168 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.653288 25362 consensus_queue.cc:1059] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
W20260709 12:17:31.694459 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:31.673720 25295 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.627897 25288 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:31.658468 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 220898us
I20260709 12:17:31.690886 24808 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:31.701193 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:31.700569 25397 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:31.705243 24245 raft_consensus.cc:1813] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Handling vote request from an unknown peer 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:31.705442 24175 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:31.706840 24245 raft_consensus.cc:2393] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:31.693037 25375 raft_consensus.cc:697] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:17:31.723740 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49238.9us
W20260709 12:17:31.715618 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 281427us
I20260709 12:17:31.681298 25391 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.707731 25397 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:31.727653 25397 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.728070 25235 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.728860 25235 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.735383 24249 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:31.737375 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:31.742429 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:31.728111 25407 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:17:31.745146 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.739303 25285 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:31.751062 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.726397 25291 consensus_queue.cc:1059] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:17:31.789063 24067 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.762516 25273 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:31.783228 25398 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:31.809479 24245 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.810902 25134 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:31.772432 25402 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:31.794482 25301 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:31.799715 25285 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.827867 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:31.823961 25134 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.806519 25409 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:31.838369 24245 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:31.801575 25362 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:17:31.841789 24249 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:31.822949 25402 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:31.776502 25355 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.855860 25235 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:31.859685 25204 raft_consensus.cc:3055] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.860302 25204 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:31.861460 25204 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.859434 24067 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:31.867758 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:31.872525 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 74037.4us
I20260709 12:17:31.838689 25291 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:31.822183 25398 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.884173 25317 consensus_queue.cc:1059] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:31.819181 25375 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:31.886040 25317 raft_consensus.cc:3055] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:31.886140 25133 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:31.889235 25134 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:31.954041 25134 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:31.954900 25134 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:31.941991 25359 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.512s	user 0.022s	sys 0.002s
I20260709 12:17:31.864814 25402 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:31.971843 25415 log.cc:927] Time spent T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:17:31.964393 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 105146us
I20260709 12:17:31.974442 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:31.892035 25408 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:31.958287 25317 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:31.958156 25391 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:31.635017 24092 rpcz_store.cc:276] 0709 12:17:30.520292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.525142 (+  4850us) service_pool.cc:224] Handling call
0709 12:17:30.525550 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:30.525952 (+   402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:30.525982 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:30.526498 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:17:30.596877 (+ 70379us) spinlock_profiling.cc:243] Waited 8.43 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c024710ac 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b
0709 12:17:30.669656 (+ 72779us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:30.856669 (+187013us) log.cc:844] Serialized 14 byte log entry
0709 12:17:31.305504 (+448835us) spinlock_profiling.cc:243] Waited 9.61 ms on lock 0x7b18003cbb60. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02408c0a 00007f4c0bb48219 00007f4c0944f58f 00007f4c0248e571 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd
0709 12:17:31.630761 (+325257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.630875 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:31.630935 (+    60us) raft_consensus.cc:1685] finished
0709 12:17:31.630949 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:31.634329 (+  3380us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92082,"prepare.queue_time_us":425953,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":89294,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":22459,"spinlock_wait_cycles":41538432,"thread_start_us":965681,"threads_started":3,"wal-append.queue_time_us":191875}
I20260709 12:17:31.986462 25133 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:31.966472 25418 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:31.980520 25134 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:31.983136 25365 raft_consensus.cc:3055] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.989699 25365 raft_consensus.cc:740] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:31.980962 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:31.974849 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:31.847889 25409 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:31.990955 25310 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:17:31.997578 25409 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.002839 25134 consensus_queue.cc:1059] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:17:31.991607 24806 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.534s	user 0.010s	sys 0.014s
I20260709 12:17:32.024501 25356 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:31.998112 25235 raft_consensus.cc:993] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:17:31.992538 25291 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:31.998735 24097 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.034410 25295 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.031409 25317 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:32.036386 25317 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:32.030150 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 92974.5us
I20260709 12:17:32.020185 25391 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:32.014151 24806 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
W20260709 12:17:32.043495 25270 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.587s	user 0.013s	sys 0.004s
I20260709 12:17:32.051432 25270 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:32.030030 25356 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:32.040844 25235 raft_consensus.cc:1081] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:17:31.998611 25418 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.059491 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:32.052848 24098 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:32.071431 25133 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:32.044253 25391 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:32.074023 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:32.075853 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 95082.6us
I20260709 12:17:32.077208 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:32.073801 25133 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.084048 25133 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.073181 25397 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.086771 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:32.088429 25133 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:32.088909 25133 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:32.075461 25391 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.089929 25133 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.104547 25270 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:32.105058 25397 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.106820 25356 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.109895 25356 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.111611 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:32.112547 24245 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:32.082543 25334 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:32.114267 25283 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.114830 25283 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:32.115931 25283 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.114686 25334 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:32.119596 25334 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:32.060568 25359 consensus_queue.cc:1059] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:17:31.858670 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:32.129179 23998 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 189) took 4523 ms. Trace:
I20260709 12:17:32.156095 25291 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:17:32.157248 25362 raft_consensus.cc:3055] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.173863 25362 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:32.174856 25362 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.176223 25362 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.182786 25285 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:32.153942 25134 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:32.157719 25429 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.184039 25429 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.157892 25433 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:32.187790 25433 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.167387 25204 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.187018 25429 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.173285 24097 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:32.173465 24248 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.325519 25433 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:32.327302 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 248540us
I20260709 12:17:32.328641 24067 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:32.216389 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:32.337967 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.335317 24176 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:32.160746 23998 rpcz_store.cc:276] 0709 12:17:27.605865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.605994 (+   129us) service_pool.cc:224] Handling call
0709 12:17:32.129002 (+4523008us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:30.527364 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:30.528244 (+   880us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:30.528299 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:17:30.528332 (+    33us) tablet.cc:662] Decoding operations
0709 12:17:30.528869 (+   537us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:30.528965 (+    96us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:30.529001 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:17:30.529372 (+   371us) tablet.cc:701] Row locks acquired
0709 12:17:30.529430 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:17:30.538913 (+  9483us) write_op.cc:270] Start()
0709 12:17:30.577225 (+ 38312us) write_op.cc:276] Timestamp: P: 1783599450529594 usec, L: 0
0709 12:17:30.598921 (+ 21696us) op_driver.cc:348] REPLICATION: starting
0709 12:17:30.724987 (+126066us) log.cc:844] Serialized 535 byte log entry
0709 12:17:31.148434 (+423447us) op_driver.cc:464] REPLICATION: finished
0709 12:17:31.652906 (+504472us) write_op.cc:301] APPLY: starting
0709 12:17:31.659067 (+  6161us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:31.671144 (+ 12077us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:31.676854 (+  5710us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:31.677341 (+   487us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:31.677683 (+   342us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:17:31.677772 (+    89us) write_op.cc:312] APPLY: finished
0709 12:17:31.678181 (+   409us) log.cc:844] Serialized 22 byte log entry
0709 12:17:31.678482 (+   301us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:31.678603 (+   121us) write_op.cc:454] Released schema lock
0709 12:17:31.678684 (+    81us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:31.708563 (+ 29879us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:31.709878 (+  1315us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":49256,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":464152,"apply.run_cpu_time_us":3335,"apply.run_wall_time_us":62269,"num_ops":1,"prepare.queue_time_us":706520,"prepare.run_cpu_time_us":5208,"prepare.run_wall_time_us":198213,"replication_time_us":523850,"thread_start_us":872155,"threads_started":2}]]}
I20260709 12:17:32.340975 25266 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:32.341598 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.344290 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:32.345362 25433 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:32.345917 25433 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:32.346356 25433 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.346891 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:32.347780 24093 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.347986 25355 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:32.348767 25355 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.349254 25429 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:32.351786 25355 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:32.219370 25384 ts_tablet_manager.cc:1929] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:17:32.365217 25384 log.cc:1199] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/7b5b70d71470484d8fc5f942623adb98
I20260709 12:17:32.366976 25384 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:59342 (request call id 72) took 1748 ms. Trace:
W20260709 12:17:32.338068 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 279008us
I20260709 12:17:32.389333 25429 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:32.389703 25273 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:32.391148 25429 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:32.391559 25429 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:32.391901 25418 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.392463 25273 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:32.392699 25429 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.393872 25418 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.394351 25418 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:32.394472 25354 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:32.395771 25418 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.243216 25134 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.358043 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.398336 25134 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.359812 24097 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.335883 25392 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.334685 25283 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.364503 25391 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.447793 25134 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.223779 25291 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.336377 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:32.369344 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:32.456858 24248 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:32.372603 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:32.376353 24245 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:17:32.353720 25402 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.379415 24141 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:32.379901 25299 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:32.462280 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60868.4us
W20260709 12:17:32.420205 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:32.465233 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 61968.8us
I20260709 12:17:32.462459 24247 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:32.383172 25356 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:32.394140 25429 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.443380 25133 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.481549 24250 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:32.482388 24141 raft_consensus.cc:2686] T 7b5b70d71470484d8fc5f942623adb98 P 5d0f174a97494d0cbf08ae81ec4c807a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:17:32.495119 24094 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:32.490507 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 107666us
I20260709 12:17:32.468170 24241 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:32.496843 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.500362 24247 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:17:32.481405 25135 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:17:32.502519 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:17:32.493244 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 113947us
I20260709 12:17:32.493578 24096 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.492700 25133 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:32.517225 24216 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.098s (SENT)
I20260709 12:17:32.521025 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:32.481173 25291 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.528018 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:32.520910 25133 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:32.553331 24097 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.496173 25356 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:32.505651 25409 raft_consensus.cc:3055] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:32.555390 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64002.3us
I20260709 12:17:32.557384 24067 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:32.558476 24249 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:32.559237 25223 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:32.560058 25416 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.785s	user 0.002s	sys 0.009s
I20260709 12:17:32.560137 25409 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:32.561556 25354 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:32.520633 25334 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:32.517030 25260 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:32.566191 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.562497 24067 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:32.569404 25223 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.569949 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:32.567235 25133 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.583317 24249 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:32.387641 25384 rpcz_store.cc:276] 0709 12:17:30.707377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:30.720603 (+ 13226us) service_pool.cc:224] Handling call
0709 12:17:31.156335 (+435732us) ts_tablet_manager.cc:1151] Deleting tablet 7b5b70d71470484d8fc5f942623adb98
0709 12:17:31.172541 (+ 16206us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:17:32.117659 (+945118us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:32.219117 (+101458us) tablet_metadata.cc:665] Metadata flushed
0709 12:17:32.366848 (+147731us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72117,"tablet-delete.queue_time_us":421248,"thread_start_us":171877,"threads_started":1}
I20260709 12:17:32.585197 25260 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.597579 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:32.614708 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 101232us
I20260709 12:17:32.616992 24101 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:32.619841 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:32.620887 25448 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:17:32.621289 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.623272 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:32.624100 24249 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:32.624191 25409 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.625159 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:32.625631 25409 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.622800 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:32.623564 25447 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:17:32.627612 24097 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:32.628379 25133 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.643780 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:32.645850 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 83477.5us
I20260709 12:17:32.649400 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.650494 24097 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
W20260709 12:17:32.655234 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.659480 25402 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.660205 24101 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:32.661149 24808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 212) took 1175 ms. Trace:
I20260709 12:17:32.661815 24101 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:32.662919 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.663817 24101 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:32.664803 25273 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.664824 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.665463 25273 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.666198 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.667309 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.667722 24244 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.668025 25433 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:32.668418 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1141) took 1218 ms. Trace:
I20260709 12:17:32.668870 24244 rpcz_store.cc:276] 0709 12:17:31.449867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.450053 (+   186us) service_pool.cc:224] Handling call
0709 12:17:32.667282 (+1217229us) spinlock_profiling.cc:243] Waited 17.5 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:32.667517 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.668122 (+   605us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.668336 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40310144}
W20260709 12:17:32.660296 25437 log.cc:927] Time spent T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:17:32.675786 24250 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:32.668408 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:32.678215 24216 leader_election.cc:336] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.118s (SENT)
I20260709 12:17:32.678879 24101 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:32.680558 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.686758 24216 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:32.688535 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1248) took 1264 ms. Trace:
I20260709 12:17:32.689124 24099 rpcz_store.cc:276] 0709 12:17:31.423868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.484335 (+ 60467us) service_pool.cc:224] Handling call
0709 12:17:31.484887 (+   552us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:31.485274 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:31.485309 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:31.496838 (+ 11529us) log.cc:844] Serialized 26 byte log entry
0709 12:17:31.706437 (+209599us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:31.707952 (+  1515us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:31.709529 (+  1577us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:32.559365 (+849836us) spinlock_profiling.cc:243] Waited 8.19 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:32.679464 (+120099us) raft_consensus.cc:1685] finished
0709 12:17:32.679488 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:32.688454 (+  8966us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10131,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":23043,"spinlock_wait_cycles":18825600,"thread_start_us":162255,"threads_started":1,"wal-append.queue_time_us":243526}
I20260709 12:17:32.690973 25260 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:32.691205 25427 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.644s	user 0.000s	sys 0.013s
I20260709 12:17:32.679913 25391 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:32.693046 25362 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.516s	user 0.009s	sys 0.003s
I20260709 12:17:32.701306 25204 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:32.702178 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:32.679303 25433 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:32.711540 24099 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:32.661577 24808 rpcz_store.cc:276] 0709 12:17:31.485947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.494513 (+  8566us) service_pool.cc:224] Handling call
0709 12:17:31.573071 (+ 78558us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:31.707037 (+133966us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.660822 (+953785us) spinlock_profiling.cc:243] Waited 95.3 ms on lock 0x7b54005e0e54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:32.661053 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":219192704}
I20260709 12:17:32.715670 25291 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:32.715902 25273 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.717201 24099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37604
I20260709 12:17:32.718011 24099 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:32.718456 24099 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:32.731046 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:32.730801 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50745us
W20260709 12:17:32.734232 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 86240.4us
W20260709 12:17:32.735234 24216 leader_election.cc:336] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.221s (SENT)
I20260709 12:17:32.735756 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:32.736580 24172 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:17:32.737234 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.739622 25398 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.741017 24100 raft_consensus.cc:3055] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:32.741425 24100 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:32.742249 24100 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:32.759953 24097 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:32.769233 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:32.769156 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:32.769490 25359 raft_consensus.cc:3055] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.752410 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:32.762260 24242 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:32.763767 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet ee66a7413b024d4b8e542242a567c0cf with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:40964
I20260709 12:17:32.772504 25356 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:32.772698 25359 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:32.775595 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:32.776404 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:32.777971 25445 log.cc:927] Time spent T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:17:32.776398 25315 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:17:32.778848 25435 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:17:32.753188 25204 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:17:32.783931 25439 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:17:32.788985 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.794538 24780 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:32.797575 24100 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:32.797876 24097 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:32.803300 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.803417 25413 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:32.718565 25365 consensus_queue.cc:260] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.790449 25362 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:17:32.809273 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1139) took 1360 ms. Trace:
I20260709 12:17:32.823477 24243 rpcz_store.cc:276] 0709 12:17:31.448631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.448809 (+   178us) service_pool.cc:224] Handling call
0709 12:17:32.775400 (+1326591us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:32.809199 (+ 33799us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44595584}
I20260709 12:17:32.824126 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:32.803671 25359 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.825125 25332 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:32.825438 25359 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:32.823568 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 71287.8us
I20260709 12:17:32.815873 23997 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 205) took 3440 ms. Trace:
I20260709 12:17:32.818116 24092 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.820109 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.797154 25223 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:32.796922 25429 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.823592 25299 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:32.816687 25375 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:32.833118 25295 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.833065 25296 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:32.834837 24780 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:32.855167 25296 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:32.855998 25296 raft_consensus.cc:697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:32.857277 24099 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.857189 25296 consensus_queue.cc:237] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:32.814464 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 868) took 1408 ms. Trace:
I20260709 12:17:32.859230 24242 rpcz_store.cc:276] 0709 12:17:31.390513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.413912 (+ 23399us) service_pool.cc:224] Handling call
0709 12:17:32.701921 (+1288009us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:32.798762 (+ 96841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87714560}
I20260709 12:17:32.863420 24101 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.867725 25204 raft_consensus.cc:3055] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.868340 25204 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:32.869182 25362 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:32.869522 25204 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.874276 25204 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.882365 24096 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:32.880805 24099 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:32.827165 23997 rpcz_store.cc:276] 0709 12:17:29.375758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:29.375962 (+   204us) service_pool.cc:224] Handling call
0709 12:17:29.634395 (+258433us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:17:32.815627 (+3181232us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:30.725746 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:30.726455 (+   709us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:30.726520 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:17:30.726539 (+    19us) tablet.cc:662] Decoding operations
0709 12:17:30.727108 (+   569us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:30.727176 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:30.727206 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:30.727697 (+   491us) tablet.cc:701] Row locks acquired
0709 12:17:30.727720 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:17:30.727903 (+   183us) write_op.cc:270] Start()
0709 12:17:30.728071 (+   168us) write_op.cc:276] Timestamp: P: 1783599450727844 usec, L: 0
0709 12:17:30.728090 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:17:30.771649 (+ 43559us) log.cc:844] Serialized 928 byte log entry
0709 12:17:31.603599 (+831950us) op_driver.cc:464] REPLICATION: finished
0709 12:17:31.742608 (+139009us) write_op.cc:301] APPLY: starting
0709 12:17:31.745063 (+  2455us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:31.756956 (+ 11893us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:31.772554 (+ 15598us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:31.822063 (+ 49509us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:31.839936 (+ 17873us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:31.845801 (+  5865us) write_op.cc:312] APPLY: finished
0709 12:17:31.884844 (+ 39043us) log.cc:844] Serialized 28 byte log entry
0709 12:17:31.885067 (+   223us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:31.885167 (+   100us) write_op.cc:454] Released schema lock
0709 12:17:31.885223 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:31.885641 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:31.885674 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":243349,"reported_tablets":2,"spinlock_wait_cycles":108140800,"child_traces":[["op",{"apply.queue_time_us":120257,"apply.run_cpu_time_us":3556,"apply.run_wall_time_us":145379,"mutex_wait_us":12672,"num_ops":2,"prepare.queue_time_us":630980,"prepare.run_cpu_time_us":4445,"prepare.run_wall_time_us":49854,"replication_time_us":817425,"thread_start_us":218793,"threads_started":1}]]}
I20260709 12:17:32.891526 24808 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:17:32.892113 24808 pending_rounds.cc:85] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Aborting all ops after (but not including) 4
I20260709 12:17:32.892459 24808 pending_rounds.cc:107] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:17:32.892819 24808 raft_consensus.cc:2889] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:32.898284 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.899323 24092 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:32.900599 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:32.901386 25297 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:32.902218 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.902415 24092 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.903978 25410 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.078s
I20260709 12:17:32.876245 25418 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:32.854048 24093 raft_consensus.cc:1240] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:32.870714 25362 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:32.880430 25365 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:32.942273 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:32.945721 24214 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:32.957571 24096 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:32.854526 25429 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:32.975338 25446 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:32.976183 25446 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:32.941010 25362 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:32.944919 25291 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:33.003150 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:32.988415 25400 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.020s	sys 0.042s
I20260709 12:17:33.003568 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 62) took 1592 ms. Trace:
W20260709 12:17:33.015261 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.010596 24099 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:33.033530 25235 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:33.016496 25400 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.021s	sys 0.043s
I20260709 12:17:32.956851 25340 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 12:17:33.073526 24066 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:33.020076 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 175087us
I20260709 12:17:32.994837 25446 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:33.081039 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:33.091773 24173 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 1.
I20260709 12:17:33.092789 25410 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.083684 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:33.084520 24806 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:33.084596 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:33.094599 24176 raft_consensus.cc:2376] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2. Re-sending same reply.
I20260709 12:17:33.094749 24168 raft_consensus.cc:2376] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2. Re-sending same reply.
I20260709 12:17:33.082604 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:33.084954 25340 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:33.088914 24779 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:33.088061 25362 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:33.072847 25359 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:33.071650 25235 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:33.083717 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:33.093592 25410 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:33.097841 25413 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:33.098395 25331 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:33.020923 24172 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:33.096380 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:33.018963 25452 consensus_queue.cc:1059] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:17:33.020390 24098 rpcz_store.cc:276] 0709 12:17:31.411503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.415068 (+  3565us) service_pool.cc:224] Handling call
0709 12:17:31.441190 (+ 26122us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.077873 (+636683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.003256 (+925383us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b540011b054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:33.003489 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405756160}
I20260709 12:17:33.111737 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:33.115036 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:33.120095 25133 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:33.120731 25133 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:33.022092 25291 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:33.115324 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:33.105065 25446 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.118144 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:33.126682 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:33.124393 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:33.110026 25359 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.129825 25359 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.131162 24168 raft_consensus.cc:2376] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2. Re-sending same reply.
W20260709 12:17:33.127444 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:33.133569 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.140525 25235 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:33.121591 25297 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.119524 25413 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.123100 25375 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:33.122732 25331 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:33.148257 25133 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:33.146772 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:33.159408 24168 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:33.159931 24174 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:33.150487 25410 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:33.165748 25453 log.cc:927] Time spent T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:17:33.139984 25446 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:33.157086 24176 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:33.147562 25362 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:33.174927 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:33.176280 24174 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:17:33.183723 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.028s	sys 0.037s
W20260709 12:17:33.184266 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.028s	sys 0.037s
W20260709 12:17:33.189003 24248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.022s	sys 0.039s
W20260709 12:17:33.214087 24248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.025s	sys 0.039s
I20260709 12:17:33.175575 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:33.215281 24176 raft_consensus.cc:2376] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2. Re-sending same reply.
I20260709 12:17:33.218420 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 66) took 1092 ms. Trace:
I20260709 12:17:33.151238 25402 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:33.192435 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:33.213867 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:33.152138 25413 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:33.184624 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 670388us
I20260709 12:17:33.163546 25331 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.126243 25340 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:33.227584 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.245394 24168 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:33.246002 24174 raft_consensus.cc:2376] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2. Re-sending same reply.
W20260709 12:17:33.252815 24170 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.003s	sys 0.024s
W20260709 12:17:33.215191 25454 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:17:33.151945 25297 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:33.218881 24245 rpcz_store.cc:276] 0709 12:17:32.126180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.488662 (+362482us) service_pool.cc:224] Handling call
0709 12:17:32.499830 (+ 11168us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.514080 (+ 14250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.514115 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:32.520423 (+  6308us) log.cc:844] Serialized 26 byte log entry
0709 12:17:32.631027 (+110604us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:32.631068 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:32.631147 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:33.218146 (+586999us) raft_consensus.cc:1685] finished
0709 12:17:33.218167 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.218327 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47306,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":85767,"threads_started":1,"wal-append.queue_time_us":411846}
I20260709 12:17:33.217195 23996 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.209599 25375 raft_consensus.cc:697] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:17:33.288618 24170 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.003s	sys 0.025s
W20260709 12:17:33.462069 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:33.297395 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47664.2us
I20260709 12:17:33.599283 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:33.600174 24099 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:33.493566 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:33.602316 24175 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:33.297308 24173 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:33.603355 23996 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.363098 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:17:33.286226 25310 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.013s	sys 0.046s
I20260709 12:17:33.619786 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:33.620747 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:33.600627 25439 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:17:33.621670 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:33.632942 24168 raft_consensus.cc:2376] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2. Re-sending same reply.
I20260709 12:17:33.615823 23996 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:33.463788 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:33.634466 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:33.623651 24213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.002s	sys 0.013s
I20260709 12:17:33.624948 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:33.539542 25355 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.014s	sys 0.046s
W20260709 12:17:33.623402 24216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.011s	sys 0.004s
I20260709 12:17:33.637151 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:33.637565 24216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.011s	sys 0.004s
W20260709 12:17:33.638300 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 620352us
I20260709 12:17:33.627619 24173 raft_consensus.cc:2376] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2. Re-sending same reply.
W20260709 12:17:33.435317 25296 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.028s
W20260709 12:17:33.439109 25311 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.017s	sys 0.021s
W20260709 12:17:33.601464 25400 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.009s	sys 0.025s
W20260709 12:17:33.490727 25416 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:17:33.636092 24213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.002s	sys 0.013s
I20260709 12:17:33.622713 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:33.626693 25310 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.031s	sys 0.096s
I20260709 12:17:33.640602 23996 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:33.625093 24241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.050s	sys 0.095s
I20260709 12:17:33.643581 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:33.523277 25458 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.299007 25429 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:33.535346 25461 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:33.639878 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:33.619140 25456 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:33.680284 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.621040 24140 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:33.645757 25296 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.007s	sys 0.035s
I20260709 12:17:33.632997 25235 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:17:33.636705 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:33.685132 23996 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.713965 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 65) took 1588 ms. Trace:
I20260709 12:17:33.689802 24175 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:33.806146 24095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.030s	sys 0.020s
W20260709 12:17:33.820089 24095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.030s	sys 0.020s
W20260709 12:17:33.725629 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:33.819330 23996 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:33.820586 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:33.636751 25355 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.015s	sys 0.048s
I20260709 12:17:33.707480 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:33.812619 24097 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.023s	sys 0.028s
I20260709 12:17:33.823258 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1264) took 1004 ms. Trace:
W20260709 12:17:33.825116 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 204186us
I20260709 12:17:33.714113 24176 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:33.679211 25450 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.020s	sys 0.024s
W20260709 12:17:33.833775 24097 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.024s	sys 0.028s
W20260709 12:17:33.738574 24214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.017s	sys 0.039s
W20260709 12:17:33.681123 25311 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.027s	sys 0.041s
W20260709 12:17:33.684509 24241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.050s	sys 0.095s
I20260709 12:17:33.651688 25446 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:33.841583 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:33.725939 25418 consensus_meta.cc:287] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.817s	user 0.003s	sys 0.008s
I20260709 12:17:33.818735 24248 rpcz_store.cc:276] 0709 12:17:32.125889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.487754 (+361865us) service_pool.cc:224] Handling call
0709 12:17:32.496893 (+  9139us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.630132 (+133239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.630178 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:32.638036 (+  7858us) log.cc:844] Serialized 26 byte log entry
0709 12:17:33.214651 (+576615us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:33.214693 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.214783 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:33.713719 (+498936us) raft_consensus.cc:1685] finished
0709 12:17:33.713743 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.713899 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58989,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":129,"thread_start_us":685905,"threads_started":2,"wal-append.queue_time_us":926343}
W20260709 12:17:33.840930 25450 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.027s	sys 0.026s
I20260709 12:17:33.835393 25456 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:33.862123 24171 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:33.680843 25400 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.010s	sys 0.025s
I20260709 12:17:33.842677 24174 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:33.843573 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:33.798229 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 449686us
W20260709 12:17:33.788111 25359 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.004s
W20260709 12:17:33.714283 25457 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260709 12:17:33.690235 24167 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:33.835083 24140 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:33.821727 23996 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.860271 25461 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:33.715643 25451 raft_consensus.cc:3055] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:33.853699 24250 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:33.834411 24095 rpcz_store.cc:276] 0709 12:17:32.819270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.819429 (+   159us) service_pool.cc:224] Handling call
0709 12:17:32.819846 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.820102 (+   256us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:33.212322 (+392220us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.822846 (+610524us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:33.822916 (+    70us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:33.822974 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.823070 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.823197 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":716660,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":79,"raft.queue_time_us":1877,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8457,"thread_start_us":999491,"threads_started":2}
I20260709 12:17:33.711970 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:33.852644 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:33.891937 24247 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.728188 25429 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 12:17:33.857203 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:33.858158 24168 raft_consensus.cc:1240] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:33.858847 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:33.859678 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:33.897583 24249 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
W20260709 12:17:33.725567 25204 consensus_meta.cc:287] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.815s	user 0.006s	sys 0.005s
I20260709 12:17:33.803128 25297 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:33.876562 25413 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.581s	user 0.013s	sys 0.000s
I20260709 12:17:33.690416 25340 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:33.830238 25459 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:33.866539 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:33.908316 25413 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:33.838392 24214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.017s	sys 0.045s
I20260709 12:17:33.913725 25461 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:33.914069 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 968425us
I20260709 12:17:33.915174 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:33.886763 25451 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:33.839850 24093 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:33.880137 24140 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:33.878299 23996 catalog_manager.cc:5697] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.890103 24245 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:33.922885 24099 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:33.694635 25458 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:33.882485 25331 consensus_meta.cc:287] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.000s
I20260709 12:17:33.902037 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:33.930223 24250 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:33.764685 25291 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:33.877002 25456 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:33.731292 25375 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:33.875773 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:33.893103 25418 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:33.869124 24246 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:33.924057 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 44021.9us
I20260709 12:17:33.924851 25134 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:33.971290 25134 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:33.971918 25134 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:33.914831 25413 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:33.902807 24806 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:33.935927 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 72) took 1808 ms. Trace:
I20260709 12:17:33.926288 23996 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:34.007524 24245 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:34.013660 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:33.943554 25365 consensus_meta.cc:287] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.989s	user 0.011s	sys 0.005s
I20260709 12:17:33.931934 25475 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:34.020043 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.023635 23996 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 2 to 3, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 3 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:34.026240 23996 catalog_manager.cc:5697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:17:34.011732 24067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.022s	sys 0.022s
W20260709 12:17:34.075400 24067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.874s	user 0.022s	sys 0.022s
I20260709 12:17:34.048058 23996 catalog_manager.cc:5697] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:33.875341 25359 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:33.939699 25410 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
W20260709 12:17:34.096028 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.080734 25450 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:17:34.105713 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 87) took 1012 ms. Trace:
I20260709 12:17:34.106237 24169 rpcz_store.cc:276] 0709 12:17:32.907769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.908447 (+   678us) service_pool.cc:224] Handling call
0709 12:17:32.908820 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:32.909295 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.909328 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:32.922348 (+ 13020us) log.cc:844] Serialized 52 byte log entry
0709 12:17:33.445409 (+523061us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:33.894474 (+449065us) log.cc:844] Serialized 14 byte log entry
0709 12:17:33.919401 (+ 24927us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.919488 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:33.919540 (+    52us) raft_consensus.cc:1685] finished
0709 12:17:33.919557 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.919711 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":367415,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":33232,"raft.run_cpu_time_us":412,"raft.run_wall_time_us":25227,"thread_start_us":853239,"threads_started":2,"wal-append.queue_time_us":908872}
I20260709 12:17:34.108645 25451 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.110100 25451 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.075822 25461 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
W20260709 12:17:34.098417 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 74698.3us
I20260709 12:17:33.940083 25331 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:33.939955 25340 consensus_queue.cc:1059] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.152s
I20260709 12:17:33.961392 25291 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.130s
I20260709 12:17:34.128343 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:17:34.130905 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 1.01919e+06us
I20260709 12:17:33.961547 25470 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.160s
I20260709 12:17:34.135545 24250 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:34.127019 24242 raft_consensus.cc:2393] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:17:34.077968 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 69346.4us
I20260709 12:17:34.011543 25456 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
I20260709 12:17:34.023640 25235 consensus_queue.cc:1059] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
W20260709 12:17:34.144971 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.020s	sys 0.027s
I20260709 12:17:34.099464 25418 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:34.081807 25314 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:17:34.154085 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.020s	sys 0.028s
I20260709 12:17:34.149607 24216 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:34.149031 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:34.163936 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:34.164412 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 525312us
I20260709 12:17:34.163259 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:34.178105 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:34.183346 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:34.169243 25475 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:34.224330 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 71671.9us
W20260709 12:17:34.275673 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.218323 25134 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:34.278996 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.279969 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1266) took 1460 ms. Trace:
W20260709 12:17:34.259850 24096 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.023s	sys 0.044s
W20260709 12:17:34.286176 24096 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.024s	sys 0.044s
W20260709 12:17:34.293906 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.158478 25459 raft_consensus.cc:993] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
W20260709 12:17:34.188042 24809 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.098s	user 0.013s	sys 0.019s
I20260709 12:17:34.283404 24097 rpcz_store.cc:276] 0709 12:17:32.819989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.821255 (+  1266us) service_pool.cc:224] Handling call
0709 12:17:32.821595 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:32.821995 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:33.837762 (+1015767us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.279546 (+441784us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:34.279618 (+    72us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:34.279667 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.279765 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.279902 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2766,"prepare.queue_time_us":790278,"prepare.run_cpu_time_us":122,"prepare.run_wall_time_us":3084,"raft.queue_time_us":3794,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"thread_start_us":1398944,"threads_started":2}
I20260709 12:17:34.303117 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:34.304082 24097 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:34.305933 25133 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:34.179162 25297 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:34.306592 25133 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.263857 24093 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:34.231972 25365 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:34.195096 25418 raft_consensus.cc:993] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:17:34.316859 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:34.233632 25235 raft_consensus.cc:3055] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:34.325307 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.325542 25134 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:34.183539 25356 consensus_queue.cc:1059] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 12:17:34.270931 25458 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:34.226859 25340 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:34.301741 24809 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.212s	user 0.014s	sys 0.020s
I20260709 12:17:34.229089 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1274) took 1355 ms. Trace:
I20260709 12:17:34.347123 24092 rpcz_store.cc:276] 0709 12:17:32.867480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.008179 (+140699us) service_pool.cc:224] Handling call
0709 12:17:33.107978 (+ 99799us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.122614 (+ 14636us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:33.642162 (+519548us) log.cc:844] Serialized 14 byte log entry
0709 12:17:34.167277 (+525115us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:34.175007 (+  7730us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:34.179455 (+  4448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.191618 (+ 12163us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.222941 (+ 31323us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":584050,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":47,"raft.queue_time_us":120,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":7627,"thread_start_us":925548,"threads_started":2,"wal-append.queue_time_us":632957}
I20260709 12:17:34.349792 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:34.328537 25486 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:34.351310 25486 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:34.352118 25402 consensus_meta.cc:287] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.064s	user 0.012s	sys 0.004s
I20260709 12:17:34.352604 25402 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:34.334458 25362 consensus_meta.cc:287] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.120s	user 0.011s	sys 0.006s
I20260709 12:17:34.353549 25460 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:34.353978 25460 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:34.354049 25486 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:34.354255 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 80) took 1759 ms. Trace:
I20260709 12:17:34.355021 25460 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:34.354666 24170 rpcz_store.cc:276] 0709 12:17:32.595220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.615656 (+ 20436us) service_pool.cc:224] Handling call
0709 12:17:32.631314 (+ 15658us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.594131 (+962817us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.594164 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.613014 (+ 18850us) log.cc:844] Serialized 26 byte log entry
0709 12:17:34.168534 (+555520us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:34.168578 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.168767 (+   189us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.353973 (+185206us) raft_consensus.cc:1685] finished
0709 12:17:34.353996 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.354179 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":58107,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"thread_start_us":1452400,"threads_started":2,"wal-append.queue_time_us":698222}
I20260709 12:17:34.356564 25460 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.358321 25299 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:34.359261 24244 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:34.342595 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1254) took 1195 ms. Trace:
W20260709 12:17:34.360112 25482 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 12:17:34.329499 25133 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:34.329800 25235 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:34.324509 25365 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.341560 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:34.342674 25487 raft_consensus.cc:1081] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:17:34.343304 25331 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:34.376638 24100 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:34.335852 25359 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:34.378451 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:34.379163 24249 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:34.344713 25340 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:34.344883 24243 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:34.321084 25297 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:34.330616 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 277544us
I20260709 12:17:34.388514 25133 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.367616 24248 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:34.389091 25133 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.360837 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:34.358786 25299 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.372339 24250 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.360335 24167 rpcz_store.cc:276] 0709 12:17:33.145571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.158594 (+ 13023us) service_pool.cc:224] Handling call
0709 12:17:33.612841 (+454247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.875541 (+262700us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.318243 (+442702us) spinlock_profiling.cc:243] Waited 442 ms on lock 0x7b54003eb7d0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:34.337441 (+ 19198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1016470784}
I20260709 12:17:34.367699 25223 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:17:34.336539 25458 raft_consensus.cc:1081] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
W20260709 12:17:34.403154 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 237835us
I20260709 12:17:34.392146 24099 raft_consensus.cc:2393] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:34.404399 25133 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:34.387401 25340 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:34.405442 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 267426us
I20260709 12:17:34.394588 24140 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:34.409736 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:34.374063 25354 raft_consensus.cc:3055] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:34.410918 25354 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:17:34.398284 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.377375 25365 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.412206 25354 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.412207 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:34.414021 25354 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.415560 25355 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:34.392701 24066 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:34.401548 24247 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.004s
W20260709 12:17:34.403906 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 101723us
I20260709 12:17:34.418188 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:34.417273 24247 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:34.419533 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:34.421489 25355 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:34.422092 25355 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:34.423174 25355 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.301783 25475 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.386837 25402 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:34.453614 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49626.9us
I20260709 12:17:34.458263 25134 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:34.459389 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 67905.5us
W20260709 12:17:34.452927 25464 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:17:34.388696 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:34.389279 25297 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:34.011188 24241 rpcz_store.cc:276] 0709 12:17:32.127967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:32.504659 (+376692us) service_pool.cc:224] Handling call
0709 12:17:32.505080 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:32.956254 (+451174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:32.974977 (+ 18723us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.087136 (+112159us) log.cc:844] Serialized 26 byte log entry
0709 12:17:33.847253 (+760117us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:33.857468 (+ 10215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:33.857577 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:33.935602 (+ 78025us) raft_consensus.cc:1685] finished
0709 12:17:33.935627 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:33.935842 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":55660,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":1177174,"threads_started":2,"wal-append.queue_time_us":720159}
I20260709 12:17:34.463860 25134 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:34.464800 25133 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:34.400471 25299 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:34.395602 25331 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:34.468938 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52068.9us
I20260709 12:17:34.482208 25133 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:34.471875 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.473609 25134 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.477342 24094 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:34.467820 24250 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
W20260709 12:17:34.462368 25492 log.cc:927] Time spent T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:17:34.532449 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:34.533874 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 124219us
I20260709 12:17:34.534121 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:34.532119 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 114004us
I20260709 12:17:34.399596 25418 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:17:34.472373 25446 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:34.555953 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 90789.4us
I20260709 12:17:34.474944 25461 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:34.578540 24066 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:34.580036 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:34.589855 24097 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:34.468626 25495 raft_consensus.cc:2764] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:34.593304 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:34.594101 24095 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:34.469390 25283 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:34.620199 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:34.490747 25473 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.621809 25134 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.490600 25400 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.627401 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:34.467772 25402 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.635429 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:34.485386 24244 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:34.462632 25365 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:34.479079 25295 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.146s
I20260709 12:17:34.543171 24809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 219) took 1455 ms. Trace:
I20260709 12:17:34.587917 25461 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:34.598307 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46669.2us
I20260709 12:17:34.588373 25354 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.485879 25486 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:17:34.542223 25470 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.099s
I20260709 12:17:34.711539 25134 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:34.700338 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:34.741210 24095 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:34.843046 24101 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.480722 25235 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:34.636507 25458 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:34.638044 25413 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:34.688771 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:34.922022 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 888) took 1080 ms. Trace:
I20260709 12:17:34.922523 24248 rpcz_store.cc:276] 0709 12:17:33.841696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.858551 (+ 16855us) service_pool.cc:224] Handling call
0709 12:17:34.921732 (+1063181us) spinlock_profiling.cc:243] Waited 456 ms on lock 0x7b5400058f54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:34.921940 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1049294208}
I20260709 12:17:34.733615 25410 raft_consensus.cc:3055] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:34.836994 25461 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:34.549548 25331 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:34.912880 25491 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.542s	user 0.000s	sys 0.001s
W20260709 12:17:34.973659 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 400482us
W20260709 12:17:34.920951 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66743us
I20260709 12:17:34.913275 25134 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:34.697597 25391 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:34.708004 25418 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:34.637298 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 287625us
I20260709 12:17:34.641348 25400 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.598580 25446 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.639990 25283 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:34.972344 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 489390us
I20260709 12:17:34.982043 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:34.984831 25134 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.844511 25354 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:34.950878 25204 raft_consensus.cc:3055] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:35.002897 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:34.641750 25473 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:35.012452 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.017905 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:34.927102 25410 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:34.990190 25391 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.056385 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1275) took 2188 ms. Trace:
I20260709 12:17:35.058046 25391 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:35.056910 24096 rpcz_store.cc:276] 0709 12:17:32.867805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.007246 (+139441us) service_pool.cc:224] Handling call
0709 12:17:33.031227 (+ 23981us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:33.064105 (+ 32878us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:34.286687 (+1222582us) log.cc:844] Serialized 14 byte log entry
0709 12:17:35.055824 (+769137us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b180015a6c0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c05573060 00007f4c05585716 00007f4c05596287
0709 12:17:35.055948 (+   124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:35.056011 (+    63us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:35.056069 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.056151 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.056309 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44231,"prepare.queue_time_us":648073,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":239978,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":7514,"spinlock_wait_cycles":4636928,"thread_start_us":1703448,"threads_started":3}
I20260709 12:17:34.912954 25458 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:34.974255 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet 7b5b70d71470484d8fc5f942623adb98 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:17:34.921166 25362 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:35.065848 24170 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 12:17:35.020664 25134 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:35.067699 24170 pending_rounds.cc:85] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 3
I20260709 12:17:35.067943 25134 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:35.058699 25391 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:35.069423 24171 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:35.069535 25134 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:34.997671 25502 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:17:35.080506 23986 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 455848us
W20260709 12:17:35.082204 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64540.2us
W20260709 12:17:35.086259 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:34.992295 25418 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.068011 24170 pending_rounds.cc:107] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.4
I20260709 12:17:35.014811 25204 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:17:35.099224 25503 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.540s	user 0.000s	sys 0.001s
I20260709 12:17:35.109663 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:35.100523 25510 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
W20260709 12:17:35.104027 25497 log.cc:927] Time spent T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.543s	user 0.001s	sys 0.000s
I20260709 12:17:35.105527 25331 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:35.073637 25501 log.cc:927] Time spent T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.597s	user 0.002s	sys 0.000s
I20260709 12:17:35.070134 25486 raft_consensus.cc:2764] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:17:35.072989 25340 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.000s
I20260709 12:17:35.109131 24170 raft_consensus.cc:2917] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Aborting config change with OpId 1.4: Aborted: Op aborted by new leader
I20260709 12:17:35.140991 24170 raft_consensus.cc:2889] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:35.100888 25508 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:35.113596 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.144615 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.096685 25490 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.606s	user 0.002s	sys 0.000s
I20260709 12:17:34.989856 25515 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:35.091946 25470 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:35.071308 25511 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:35.145346 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:35.109776 25223 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:35.152696 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.007s	sys 0.002s
I20260709 12:17:35.120532 25362 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.145675 25500 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.449s	user 0.001s	sys 0.000s
W20260709 12:17:35.159487 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.007s	sys 0.003s
W20260709 12:17:35.164683 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 586233us
I20260709 12:17:35.158090 24216 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:35.174858 24066 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:35.091780 25502 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.179711 24066 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:35.151785 25402 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:35.144152 25508 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:35.210057 24214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.032s	sys 0.051s
W20260709 12:17:35.186144 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.215783 24214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.032s	sys 0.051s
W20260709 12:17:35.211998 24141 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.006s	sys 0.018s
I20260709 12:17:35.214828 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:17:35.216127 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 594702us
W20260709 12:17:35.216718 24141 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.006s	sys 0.018s
W20260709 12:17:35.217162 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 59196us
W20260709 12:17:35.217406 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 667816us
I20260709 12:17:35.164739 25504 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:35.175618 25365 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:35.185556 25356 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:35.179553 25223 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:35.225365 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:35.178108 25355 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.006s	sys 0.010s
I20260709 12:17:35.231364 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:35.232692 24066 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:35.213907 25495 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:35.151152 25340 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.234848 25522 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:35.269608 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59342 (request call id 71) took 7946 ms. Trace:
I20260709 12:17:35.175662 25362 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:34.769161 24809 rpcz_store.cc:276] 0709 12:17:33.088240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.088425 (+   185us) service_pool.cc:224] Handling call
0709 12:17:33.088822 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.089244 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.089278 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.089809 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:17:33.713764 (+623955us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c024710ac 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b
0709 12:17:34.377369 (+663605us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:34.385640 (+  8271us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.397486 (+ 11846us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:34.404913 (+  7427us) raft_consensus.cc:1685] finished
0709 12:17:34.404937 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:34.531719 (+126782us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1309,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":9024768,"thread_start_us":1277074,"threads_started":1,"wal-append.queue_time_us":1229263}
I20260709 12:17:35.285456 25522 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:35.236554 25355 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.006s	sys 0.010s
I20260709 12:17:35.278316 24101 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
W20260709 12:17:35.298715 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.156929 25511 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.155898 25204 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.155598 25458 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.218130 25508 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:35.221230 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 215189us
I20260709 12:17:35.151489 25410 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.230167 25295 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:35.158152 25515 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.318217 24096 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:35.237820 25365 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:35.306000 25526 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:35.306622 25518 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:35.239549 25331 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:17:35.234884 25400 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:35.270279 24170 rpcz_store.cc:276] 0709 12:17:27.277731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:27.307988 (+ 30257us) service_pool.cc:224] Handling call
0709 12:17:27.336524 (+ 28536us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b54003280a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054f8520 00007f4c05581b42 00007f4c05580800 00007f4c055799fa 00007f4c0a5414c9 00007f4c03abdc54 00007f4c03abdbe2 00007f4c03abdb11 00007f4c03abda8c 00007f4c03abcd42
0709 12:17:27.409857 (+ 73333us) spinlock_profiling.cc:243] Waited 2.82 ms on lock 0x7b54003280a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054f064d 00007f4c054d3fe9 00007f4c054d3f3e 00007f4c05559888 00007f4c0557675c 00007f4c0557776a 00007f4c0557691b 00007f4c0558203c 00007f4c055816b3 00007f4c055799fa
0709 12:17:27.411780 (+  1923us) log.cc:844] Serialized 501 byte log entry
0709 12:17:27.684966 (+273186us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b180005be40. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:17:27.873031 (+188065us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b54003280a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054f4062 00007f4c054d4eaa 00007f4c054dbd53 00007f4c054dbcd9 00007f4c054dbc69 00007f4c054dbc31 00007f4c054dadfd 0000000000388634 0000000000388479 00007f4c0248e475
0709 12:17:35.217262 (+7344231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36,"raft.queue_time_us":266,"raft.run_cpu_time_us":10999,"raft.run_wall_time_us":345623,"spinlock_wait_cycles":133785088,"thread_start_us":115147,"threads_started":1,"wal-append.queue_time_us":215712,"wal-append.run_cpu_time_us":3022,"wal-append.run_wall_time_us":1116937}
I20260709 12:17:35.337745 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:35.307359 25458 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:35.311538 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:35.312924 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:35.340250 24248 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:35.225634 25520 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:35.241711 25486 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:17:35.313410 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 96569.7us
I20260709 12:17:35.237991 25516 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.239708 25504 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:17:35.325811 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 105872us
I20260709 12:17:35.280763 25495 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:35.280951 25402 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:35.331112 24171 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:35.334146 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:35.518469 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:35.308537 24095 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:35.311218 25509 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:17:35.359786 25522 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:35.352605 25512 log.cc:927] Time spent T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.227s	user 0.000s	sys 0.001s
I20260709 12:17:35.523386 25296 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:35.523870 25515 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:35.338940 25355 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 12:17:35.332505 25295 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:35.329617 25204 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:35.362598 25340 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:35.336822 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:35.340672 25451 consensus_meta.cc:287] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.229s	user 0.012s	sys 0.006s
I20260709 12:17:35.337132 25410 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:35.467834 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:35.544330 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.468444 24248 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
W20260709 12:17:35.486013 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 148366us
W20260709 12:17:35.378552 25299 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.836s	user 0.007s	sys 0.006s
I20260709 12:17:35.369647 25525 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.338896 25473 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:35.411399 25486 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:35.345305 25520 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:35.414144 25418 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:35.530601 25524 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 12:17:35.483215 25518 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:35.539932 25533 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:17:35.540710 25494 log.cc:927] Time spent T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.154s	user 0.008s	sys 0.006s
I20260709 12:17:35.529481 25402 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:35.568603 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.413710 25223 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.541929 25400 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:35.340637 25526 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.580364 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:35.545389 24241 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
W20260709 12:17:35.551559 25461 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.567s	user 0.012s	sys 0.000s
I20260709 12:17:35.534192 25356 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.043s
I20260709 12:17:35.550551 25511 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:35.550699 25486 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:35.591486 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:35.588223 25418 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.553140 25520 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:35.512513 25516 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.588047 25451 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:17:35.551146 25299 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.612607 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:35.666221 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1285) took 1191 ms. Trace:
I20260709 12:17:35.617802 25525 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.663159 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:35.595530 25502 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:35.662073 25499 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.278s	user 0.003s	sys 0.005s
I20260709 12:17:35.666694 24099 rpcz_store.cc:276] 0709 12:17:34.475353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.476650 (+  1297us) service_pool.cc:224] Handling call
0709 12:17:34.542781 (+ 66131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.634361 (+ 91580us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:34.634432 (+    71us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:34.699130 (+ 64698us) log.cc:844] Serialized 26 byte log entry
0709 12:17:34.992856 (+293726us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:34.992908 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.992996 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:35.665911 (+672915us) raft_consensus.cc:1685] finished
0709 12:17:35.665947 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.666143 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":309462,"raft.run_cpu_time_us":576,"raft.run_wall_time_us":90482,"thread_start_us":223367,"threads_started":2,"wal-append.queue_time_us":351767}
I20260709 12:17:35.599838 24097 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:35.715636 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:35.633646 24171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "c090031f610346ed82285cd847bca6d6"
 from {username='slave'} at 127.0.0.1:51222
W20260709 12:17:35.777442 25547 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:17:35.806721 25526 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:35.645591 25515 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.663478 25297 consensus_meta.cc:287] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.178s	user 0.016s	sys 0.000s
I20260709 12:17:35.684396 25451 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:35.684113 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.812150 24171 raft_consensus.cc:606] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Received request to transfer leadership to TS c090031f610346ed82285cd847bca6d6
I20260709 12:17:35.829232 24171 raft_consensus.cc:614] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:35.650254 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:35.813618 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:35.633857 25362 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:35.740888 25531 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.387s	user 0.000s	sys 0.001s
I20260709 12:17:35.784442 25429 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:35.843779 25549 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.844587 25549 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.661455 25545 raft_consensus.cc:3055] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:17:35.594708 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.617457 25542 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:35.829277 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.688138 25446 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:35.620045 24101 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:35.727420 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1224) took 2129 ms. Trace:
W20260709 12:17:35.773165 25529 log.cc:927] Time spent T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:17:35.832950 25555 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:35.726778 25525 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:35.837630 25516 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:35.637660 25495 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.617449 25518 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.831421 25515 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.816882 25299 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:35.639379 23986 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 12:17:35.635596 25418 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.830358 25297 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.829047 25451 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:17:35.824435 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 455188us
I20260709 12:17:35.653811 25537 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.205s
I20260709 12:17:35.850780 25553 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.653754 25544 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.653561 25541 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.778885 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 227083us
I20260709 12:17:35.617929 25546 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.619992 25461 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.830849 25502 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:35.843011 24092 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:35.648303 25295 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.764364 25402 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.894656 25133 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:35.686128 24815 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:35.860245 25545 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:17:35.910784 23986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 282913us
I20260709 12:17:35.613078 25533 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:35.891812 25498 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 1.312s	user 0.020s	sys 0.046s
I20260709 12:17:35.852286 25429 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.880119 25473 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:35.920347 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.891999 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:35.921586 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.925597 24245 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:35.923473 24171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1388d59244114d37a482e6205f04c237"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:51222
I20260709 12:17:35.924248 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:35.897624 25413 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:35.934347 25133 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.901916 25555 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.946403 25451 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.933683 25519 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:35.953038 24171 raft_consensus.cc:606] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:35.853282 25504 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.964506 24176 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:35.901778 25516 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:35.959765 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:35.957229 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1288) took 1480 ms. Trace:
I20260709 12:17:35.872611 24098 rpcz_store.cc:276] 0709 12:17:33.598247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:33.600974 (+  2727us) service_pool.cc:224] Handling call
0709 12:17:33.705599 (+104625us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:33.714454 (+  8855us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:33.714500 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:33.715351 (+   851us) log.cc:844] Serialized 26 byte log entry
0709 12:17:34.173813 (+458462us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:34.184117 (+ 10304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:34.190422 (+  6305us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:35.354090 (+1163668us) spinlock_profiling.cc:243] Waited 7.76 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:35.726948 (+372858us) raft_consensus.cc:1685] finished
0709 12:17:35.727018 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.727302 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17848704,"thread_start_us":446885,"threads_started":1,"wal-append.queue_time_us":583569}
I20260709 12:17:35.961436 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:35.963668 24171 raft_consensus.cc:614] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:35.991979 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:17:35.993901 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.993687 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:35.931911 25502 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.001820 25516 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.870817 25542 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.959017 25204 raft_consensus.cc:2764] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:35.996572 24094 rpcz_store.cc:276] 0709 12:17:34.476513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.484650 (+  8137us) service_pool.cc:224] Handling call
0709 12:17:34.485071 (+   421us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:34.544016 (+ 58945us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:34.544073 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:34.597549 (+ 53476us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.181461 (+583912us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:35.181513 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.181600 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:35.957003 (+775403us) raft_consensus.cc:1685] finished
0709 12:17:35.957027 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:35.957161 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3538,"raft.queue_time_us":106120,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":18439,"thread_start_us":337885,"threads_started":1,"wal-append.queue_time_us":616696}
I20260709 12:17:35.958707 25456 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:35.955245 25550 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.007205 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45451.6us
I20260709 12:17:35.942215 25486 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.955657 25526 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:36.023528 24176 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.030434 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:36.007872 25508 consensus_meta.cc:287] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.004s
I20260709 12:17:35.938788 25544 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:35.995078 25525 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:35.957140 25473 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.044775 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:36.045439 24174 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.007143 25451 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.047559 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:36.048162 24171 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:36.027235 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.932108 25546 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:36.048671 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:35.931660 25553 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:35.961324 25413 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.026674 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.037917 25456 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.140426 24171 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:35.934382 25541 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.033931 25362 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 12:17:36.034124 25450 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:36.159709 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.161463 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:36.051661 25550 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.091624 25525 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.096678 24176 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:36.047076 25526 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.046190 25508 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.038489 25519 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.265856 24171 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.271797 24174 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:36.275246 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:36.276466 24170 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:36.278728 25525 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.278927 25134 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:36.173202 25560 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:17:36.279560 24173 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:36.277499 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet ee66a7413b024d4b8e542242a567c0cf (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
W20260709 12:17:36.245725 25458 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.900s	user 0.015s	sys 0.000s
I20260709 12:17:36.046464 25520 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:36.173549 25558 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:17:36.213742 25460 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.171797 25549 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.180624 25473 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:36.288491 25506 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:36.288964 24172 raft_consensus.cc:2410] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:36.289130 25362 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.289268 25541 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.289826 25536 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.291543 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.292259 25400 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.297608 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:36.294706 24171 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
W20260709 12:17:36.344556 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:36.167466 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 77210.3us
I20260709 12:17:36.296064 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.316022 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 904) took 1005 ms. Trace:
I20260709 12:17:36.340971 24175 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:36.342650 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:36.345105 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.045537 25545 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.343477 25400 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:36.347916 24141 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.871s (SENT) [suppressed 15 similar messages]
I20260709 12:17:36.349896 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.350126 24171 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:36.352068 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:36.352334 24174 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:36.333529 25533 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:36.332314 25413 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:36.330564 25544 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:36.355080 25515 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:36.355998 25496 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.982s	user 0.024s	sys 0.034s
I20260709 12:17:36.348093 25362 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.356189 25526 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:36.297245 25470 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.140s	user 0.018s	sys 0.000s
I20260709 12:17:36.356478 24243 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:36.362937 25502 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.361318 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:36.361639 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:36.379323 24175 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.350836 24247 rpcz_store.cc:276] 0709 12:17:35.310728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.310879 (+   151us) service_pool.cc:224] Handling call
0709 12:17:35.311323 (+   444us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:35.540213 (+228890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.540256 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:35.576707 (+ 36451us) log.cc:844] Serialized 26 byte log entry
0709 12:17:35.859633 (+282926us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:35.859679 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:35.859779 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:36.315677 (+455898us) raft_consensus.cc:1685] finished
0709 12:17:36.315715 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.315918 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1180,"raft.queue_time_us":31870,"raft.run_cpu_time_us":7587,"raft.run_wall_time_us":138364,"thread_start_us":458529,"threads_started":2,"wal-append.queue_time_us":338746}
I20260709 12:17:36.380177 24140 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:36.330964 25555 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:36.340348 25486 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.346163 25460 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.368263 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:36.347517 25473 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:36.361007 25541 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.273343 25450 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.376147 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.346966 25536 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.377280 25520 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.343530 25506 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.377244 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 903) took 1067 ms. Trace:
I20260709 12:17:36.364451 25458 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:36.367103 25545 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.358630 24169 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:36.480517 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.481447 24250 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:36.387542 25459 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:36.388047 25515 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:36.487178 24094 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37604
I20260709 12:17:36.388866 25561 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:36.562268 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.406283 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.566532 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.569976 24094 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:36.571831 24094 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.426735 25359 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:36.431726 25475 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:36.392344 25539 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:36.435500 25235 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.375943 25456 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:36.442461 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:36.442876 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:36.448733 24815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 215) took 1916 ms. Trace:
I20260709 12:17:36.449934 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 97) took 1447 ms. Trace:
I20260709 12:17:36.451377 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:36.460927 25283 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:36.462162 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.464659 25429 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:36.465992 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.465894 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:36.469485 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.393153 24171 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.406876 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.573565 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:36.570766 24249 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:36.574561 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.392091 25544 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:36.580350 25550 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.432595 24244 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:36.479796 25541 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.613343 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:36.438163 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.403147 25553 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.618531 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:36.371495 25554 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.205s
I20260709 12:17:36.566671 25458 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.569316 25459 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:36.412607 25473 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.484010 25571 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:36.569924 25487 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:36.636554 24815 rpcz_store.cc:276] 0709 12:17:34.532125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.535486 (+  3361us) service_pool.cc:224] Handling call
0709 12:17:34.595178 (+ 59692us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:35.935230 (+1340052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.448355 (+513125us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540067e3d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:36.448635 (+   280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473555328}
W20260709 12:17:36.811199 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:36.829530 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.815335 24169 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.823122 25458 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.823441 24101 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:36.748991 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:36.682840 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:36.832648 24099 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:36.736589 24097 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:36.823824 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.785445 24175 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
W20260709 12:17:36.824966 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 206584us
I20260709 12:17:36.825543 25553 raft_consensus.cc:2764] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:36.404636 25470 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:36.766903 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.843775 24174 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:36.748665 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.845127 24171 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:36.845676 24250 raft_consensus.cc:2410] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:36.835548 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:36.824399 24809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 221) took 1014 ms. Trace:
I20260709 12:17:36.846642 24097 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:36.853003 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:36.850782 25519 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:36.855307 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:36.711787 25570 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260709 12:17:36.868703 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:36.859706 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.863631 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.867244 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.871196 24247 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:36.714748 25297 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.757663 25506 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:36.853163 25504 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.827713 25459 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:36.715804 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:36.852731 25295 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:36.625768 25539 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.877740 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:36.877550 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.672019 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.881238 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.883062 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.906971 24248 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:36.883340 24101 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:36.838639 25486 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:36.671620 24098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37604
I20260709 12:17:36.891081 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.915892 24250 raft_consensus.cc:2410] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:36.892167 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:36.917407 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:36.861159 25223 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.860165 25520 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:36.895073 25519 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:36.848106 25544 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.857227 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.935075 24175 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:36.826371 25569 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:36.901661 24247 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:36.854439 24242 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:36.905220 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:36.644028 25359 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.910288 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:36.479192 24243 rpcz_store.cc:276] 0709 12:17:35.310338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.312425 (+  2087us) service_pool.cc:224] Handling call
0709 12:17:36.355895 (+1043470us) spinlock_profiling.cc:243] Waited 24.6 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:36.356179 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.375179 (+ 19000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.377149 (+  1970us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":56683904}
I20260709 12:17:36.915648 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.886958 25541 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:36.931623 24098 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:17:36.898914 25331 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:36.927157 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:36.928324 24169 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:36.876209 24249 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:36.981545 24174 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.932005 24067 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:36.899160 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:36.899020 25400 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:36.644372 25561 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:36.936883 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:36.914472 24094 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.977504 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 908) took 1623 ms. Trace:
W20260709 12:17:36.988998 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57101.5us
I20260709 12:17:36.936331 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.859030 25571 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.952217 24099 raft_consensus.cc:2393] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:36.954706 25460 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:36.956408 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.975036 24248 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 1.
I20260709 12:17:36.975251 24095 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:36.925640 25297 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:36.957289 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:37.003906 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 826) took 1014 ms. Trace:
I20260709 12:17:36.960279 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:36.889081 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 900) took 1577 ms. Trace:
W20260709 12:17:36.949134 25505 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.014s	sys 0.022s
I20260709 12:17:36.900228 25504 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.978130 24214 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:36.851984 25487 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:36.984447 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:36.936911 25362 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:36.909760 25295 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.046494 25506 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:37.047145 25506 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.047605 25506 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.048280 25295 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:36.989928 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:37.007125 24244 rpcz_store.cc:276] 0709 12:17:35.299827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.317786 (+ 17959us) service_pool.cc:224] Handling call
0709 12:17:36.432042 (+1114256us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:36.432328 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:36.839667 (+407339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.877305 (+ 37638us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17065216}
I20260709 12:17:36.994912 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:36.924465 25486 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.990631 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.060179 24249 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:36.851830 24809 rpcz_store.cc:276] 0709 12:17:35.809556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.815197 (+  5641us) service_pool.cc:224] Handling call
0709 12:17:36.451191 (+635994us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:36.824320 (+373129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3070336}
I20260709 12:17:36.933081 25520 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.000615 24094 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:37.001200 24175 raft_consensus.cc:2410] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:36.984246 24098 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:36.831104 24167 rpcz_store.cc:276] 0709 12:17:35.002891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.052428 (+ 49537us) service_pool.cc:224] Handling call
0709 12:17:35.112495 (+ 60067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:35.241235 (+128740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:35.273688 (+ 32453us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:35.287933 (+ 14245us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:35.297650 (+  9717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.449568 (+1151918us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b54002ae9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:36.449645 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:36.449845 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":254750080}
I20260709 12:17:37.072930 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:37.073590 24175 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:37.074847 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:37.075452 24094 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:37.076393 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:36.985910 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:37.006294 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:36.982565 25575 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:36.931341 25223 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:36.992043 25495 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:37.004339 24173 rpcz_store.cc:276] 0709 12:17:35.989735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.956910 (+967175us) service_pool.cc:224] Handling call
0709 12:17:37.003816 (+ 46906us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.038622 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:36.954366 25569 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.041142 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:37.041205 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 63158.1us
I20260709 12:17:37.043453 24169 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:37.095840 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:37.096493 24169 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:37.055864 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 61167.5us
I20260709 12:17:37.097394 24067 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:37.058174 24250 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:37.098783 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.099375 24250 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:37.100104 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:37.100486 24250 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:37.094417 24214 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:37.108336 24139 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44066 dropped due to backpressure: service queue is full with 50 items
I20260709 12:17:37.109923 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:37.110350 24175 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:37.063760 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.111135 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 823) took 1122 ms. Trace:
I20260709 12:17:37.111536 24249 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:37.112468 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:36.986065 25331 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.005861 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.028736 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:36.994913 24242 rpcz_store.cc:276] 0709 12:17:35.337055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.344751 (+  7696us) service_pool.cc:224] Handling call
0709 12:17:36.469302 (+1124551us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:36.960485 (+491183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37679872}
I20260709 12:17:37.062784 25295 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.082958 25470 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:37.088513 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:37.072746 25556 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:37.075254 25410 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 1.526s	user 0.009s	sys 0.009s
I20260709 12:17:37.110569 24173 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:37.092023 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:37.133821 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:37.093954 25539 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:37.118558 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:37.080587 25473 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:37.080526 25362 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.121966 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.083190 25568 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:37.123273 24101 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:37.130033 24092 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:17:37.107584 25451 consensus_meta.cc:287] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.016s	user 0.015s	sys 0.001s
I20260709 12:17:37.131138 24173 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:37.113947 24095 raft_consensus.cc:2410] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:37.091542 25495 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:37.111559 24175 rpcz_store.cc:276] 0709 12:17:35.988817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.072591 (+1083774us) service_pool.cc:224] Handling call
0709 12:17:37.111041 (+ 38450us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.134639 24094 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:37.114580 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:37.164371 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49883.7us
W20260709 12:17:37.135118 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.164397 25544 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:37.096345 25575 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:37.093108 24807 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:37.121923 25475 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:37.209151 25475 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.209571 25475 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.210332 25571 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:37.211146 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.211887 24241 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:37.212954 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.214102 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:37.214679 24241 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:37.146544 24247 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:37.215775 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.215986 25331 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:37.119640 25561 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.216398 24247 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:37.217329 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.217885 24247 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:37.131963 25519 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:17:37.219262 25519 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:37.219693 25519 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:37.058174 24174 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:37.222002 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 820) took 1234 ms. Trace:
I20260709 12:17:37.222337 24174 rpcz_store.cc:276] 0709 12:17:35.987849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.920897 (+933048us) service_pool.cc:224] Handling call
0709 12:17:37.221932 (+301035us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.158972 24250 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:37.158958 24169 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:37.223577 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 837) took 1059 ms. Trace:
I20260709 12:17:37.223928 24169 rpcz_store.cc:276] 0709 12:17:36.164215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.095538 (+931323us) service_pool.cc:224] Handling call
0709 12:17:37.223505 (+127967us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.145386 25542 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:37.171824 24214 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:37.225245 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 53516.1us
I20260709 12:17:37.167958 24173 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.108654 24139 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:44066 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1277)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1291)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51222 (request call id 7)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 822)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 835)
Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59342 (request call id 73)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 841)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 843)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 106)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 848)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 108)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1279)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1280)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1282)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 113)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1284)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1285)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1293)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1297)
I20260709 12:17:37.226009 25451 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.195948 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 811) took 1233 ms. Trace:
I20260709 12:17:37.145802 25554 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.227538 24168 rpcz_store.cc:276] 0709 12:17:35.962099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.962314 (+   215us) service_pool.cc:224] Handling call
0709 12:17:35.962705 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.195298 (+1232593us) spinlock_profiling.cc:243] Waited 42.1 ms on lock 0x7b1800159220. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c05573060 00007f4c05573bfb 00007f4c0557e64b
0709 12:17:37.195489 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:37.195522 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:37.195575 (+    53us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:37.195609 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.195694 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.195849 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":127959,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":51831,"spinlock_wait_cycles":96793856,"thread_start_us":130037,"threads_started":1}
I20260709 12:17:37.226603 25451 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.196887 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:37.228788 25554 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.225339 24250 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:37.197990 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:37.150662 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:37.198628 25569 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:37.226032 24173 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:37.240331 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 171232us
I20260709 12:17:37.136351 25470 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.228729 25504 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:37.167224 25495 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.200026 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 833) took 1206 ms. Trace:
I20260709 12:17:37.201159 25359 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:37.243222 24066 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:37.200500 25473 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:37.137013 25556 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.218689 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:37.238586 25545 consensus_meta.cc:287] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.659s	user 0.007s	sys 0.005s
I20260709 12:17:37.268847 24173 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:37.259583 24808 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:37.159446 25362 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.249106 25569 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:37.274372 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:37.276415 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48890.1us
I20260709 12:17:37.277086 25331 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:37.278159 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.160185 25568 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.237524 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:37.276013 25297 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:37.443503 24141 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.839s (SENT)
I20260709 12:17:37.318739 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.445789 24141 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:37.446403 24249 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:37.393354 25487 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:37.310101 25577 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:17:37.447407 25331 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.447926 25331 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.392088 25475 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.274786 25473 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.449880 25297 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.450979 25475 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:37.446925 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1167) took 1037 ms. Trace:
W20260709 12:17:37.311031 24176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 829) took 1320 ms (client timeout 1508 ms). Trace:
I20260709 12:17:37.452798 24249 rpcz_store.cc:276] 0709 12:17:36.409833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.127097 (+717264us) service_pool.cc:224] Handling call
0709 12:17:37.318544 (+191447us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456e9c 00007f4c02456a5b 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:37.446843 (+128299us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9438080}
I20260709 12:17:37.313221 25133 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:37.271278 24167 rpcz_store.cc:276] 0709 12:17:35.994184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.078176 (+1083992us) service_pool.cc:224] Handling call
0709 12:17:37.191136 (+112960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.454069 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 834) took 1459 ms. Trace:
I20260709 12:17:37.321739 25354 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:37.326229 25567 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.332s	user 0.003s	sys 0.000s
I20260709 12:17:37.328739 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 809) took 1369 ms. Trace:
I20260709 12:17:37.454581 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:37.449035 25569 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.455442 24167 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:37.451997 25473 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.449967 24095 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:37.280406 24809 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:37.454528 24173 rpcz_store.cc:276] 0709 12:17:35.994568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.109635 (+1115067us) service_pool.cc:224] Handling call
0709 12:17:37.453994 (+344359us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.463984 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:37.273058 25504 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:37.458181 25133 consensus_queue.cc:1059] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:17:37.422133 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 145560us
I20260709 12:17:37.466730 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:37.459719 24170 rpcz_store.cc:276] 0709 12:17:35.959081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.959272 (+   191us) service_pool.cc:224] Handling call
0709 12:17:37.328530 (+1369258us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400210554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:37.328667 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":541255552}
W20260709 12:17:37.451804 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.461514 25505 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:37.462533 24250 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:37.475780 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 107) took 1110 ms. Trace:
I20260709 12:17:37.315603 25584 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.140s
I20260709 12:17:37.468173 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:37.479269 24173 rpcz_store.cc:276] 0709 12:17:36.355064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.463638 (+1108574us) service_pool.cc:224] Handling call
0709 12:17:37.465042 (+  1404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.480175 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:37.480677 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:37.480894 24170 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.481489 24173 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:37.483827 24066 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:37.468622 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.454470 24249 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:37.452948 24176 rpcz_store.cc:269] 0709 12:17:35.990718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.991686 (+   968us) service_pool.cc:224] Handling call
0709 12:17:37.310666 (+1318980us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b5400255dd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:37.310880 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50868096}
I20260709 12:17:37.486531 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:37.487331 24176 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:37.281255 25486 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:37.319337 25508 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:37.291435 25359 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.482645 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:37.501051 24173 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:37.385854 24806 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:37.469051 25354 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:37.498234 24170 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:37.504323 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:37.505637 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:37.528134 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1277) took 1120 ms. Trace:
I20260709 12:17:37.528599 24173 rpcz_store.cc:276] 0709 12:17:36.407396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.505036 (+1097640us) service_pool.cc:224] Handling call
0709 12:17:37.528045 (+ 23009us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.529819 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:37.495497 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1186) took 1074 ms. Trace:
I20260709 12:17:37.530545 24249 rpcz_store.cc:276] 0709 12:17:36.421064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.453875 (+1032811us) service_pool.cc:224] Handling call
0709 12:17:37.454266 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.495185 (+ 40919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.495422 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.523533 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:37.436738 25520 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:37.475210 25504 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:37.536173 24176 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:37.536283 25504 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:37.312745 25506 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.543344 24173 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:37.548372 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:37.542532 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:37.552692 24170 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:37.553683 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:37.554462 24176 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:37.555682 24176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:51222
I20260709 12:17:37.556572 24176 raft_consensus.cc:606] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:37.557597 24176 raft_consensus.cc:614] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:37.556586 24170 raft_consensus.cc:2410] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:37.524195 25223 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:37.558364 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 74632.4us
I20260709 12:17:37.584229 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51222 (request call id 7) took 1392 ms. Trace:
I20260709 12:17:37.590823 24812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 150) took 1359 ms. Trace:
I20260709 12:17:37.558421 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1174) took 1145 ms. Trace:
I20260709 12:17:37.585685 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:37.586417 25506 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:37.587998 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:37.589943 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:37.547387 25568 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:37.552177 25451 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:37.526593 25359 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:37.615935 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.632869 24246 raft_consensus.cc:2410] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:37.540014 25516 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:37.593457 24176 rpcz_store.cc:276] 0709 12:17:36.192268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.555504 (+1363236us) service_pool.cc:224] Handling call
0709 12:17:37.584140 (+ 28636us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:37.619892 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:37.445683 25575 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.541667 25354 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.596459 24812 rpcz_store.cc:276] 0709 12:17:36.261179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.269472 (+  8293us) service_pool.cc:224] Handling call
0709 12:17:36.277366 (+  7894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.277759 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.277795 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.278311 (+   516us) log.cc:844] Serialized 26 byte log entry
0709 12:17:36.715598 (+437287us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:36.715648 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:36.715727 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:37.325622 (+609895us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:37.556381 (+230759us) raft_consensus.cc:1685] finished
0709 12:17:37.556407 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.590739 (+ 34332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1841,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":5384,"spinlock_wait_cycles":18671488,"thread_start_us":436794,"threads_started":1,"wal-append.queue_time_us":645858}
I20260709 12:17:37.615634 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:37.616340 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.674013 24176 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:37.636996 24095 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:38.488205 25133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.853s	user 0.021s	sys 0.052s
W20260709 12:17:38.278314 25459 consensus_meta.cc:287] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.369s	user 0.013s	sys 0.003s
I20260709 12:17:37.672919 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:37.734710 25359 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:37.625761 25569 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:37.867120 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.641012 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:17:37.704883 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.061031 24249 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.019s	sys 0.016s
W20260709 12:17:37.870415 24245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 905) took 2559 ms (client timeout 3178 ms). Trace:
I20260709 12:17:37.621697 25223 raft_consensus.cc:3055] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:17:37.878681 25591 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.596s	user 0.002s	sys 0.000s
I20260709 12:17:37.757265 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:37.920389 25362 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:37.674075 25594 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:37.945611 24092 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.773s	user 0.011s	sys 0.001s
W20260709 12:17:37.675295 25458 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.810s	user 0.014s	sys 0.000s
I20260709 12:17:38.797384 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 835) took 2802 ms. Trace:
W20260709 12:17:38.798642 25133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.025s	sys 0.054s
I20260709 12:17:38.816598 25594 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:38.799173 25459 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:38.810281 24245 rpcz_store.cc:269] 0709 12:17:35.311119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.318083 (+  6964us) service_pool.cc:224] Handling call
0709 12:17:37.870102 (+2552019us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54003d7554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:37.870264 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":934984448}
W20260709 12:17:38.503609 25295 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.374s	user 0.016s	sys 0.000s
I20260709 12:17:37.639377 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:38.816931 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:37.673797 25418 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:38.018271 24241 consensus_meta.cc:287] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.759s	user 0.011s	sys 0.000s
I20260709 12:17:38.851627 25458 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:37.629299 25402 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:38.855371 25402 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:38.855612 24171 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:38.855939 25402 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:38.857434 25458 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:38.857746 25459 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:38.816973 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:38.827214 25519 consensus_meta.cc:287] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.607s	user 0.016s	sys 0.002s
W20260709 12:17:38.801563 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:38.797058 25520 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.249s	user 0.027s	sys 0.064s
I20260709 12:17:38.859264 25555 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:38.859367 25519 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:38.859807 25520 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.027s	sys 0.065s
I20260709 12:17:38.840556 25594 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.861650 25519 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:38.829394 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:38.835054 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:38.835716 24176 rpcz_store.cc:276] 0709 12:17:35.994868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.636567 (+1641699us) service_pool.cc:224] Handling call
0709 12:17:37.673579 (+ 37012us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.797013 (+1123434us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.797298 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:38.834615 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 396806us
I20260709 12:17:38.831806 25354 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:38.839286 24216 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.516s (SENT)
I20260709 12:17:38.850554 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.852406 25295 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:38.854063 24807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 218) took 1305 ms. Trace:
I20260709 12:17:38.854664 24241 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:38.858482 24167 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:38.859773 25555 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:38.810629 25223 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:38.804363 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1283) took 2232 ms. Trace:
I20260709 12:17:38.865092 24807 rpcz_store.cc:276] 0709 12:17:37.548789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.552922 (+  4133us) service_pool.cc:224] Handling call
0709 12:17:38.853955 (+1301033us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.870805 24173 rpcz_store.cc:276] 0709 12:17:36.572545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.552346 (+979801us) service_pool.cc:224] Handling call
0709 12:17:38.804278 (+1251932us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:38.870127 24241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 922) took 1700 ms (client timeout 2191 ms). Trace:
I20260709 12:17:38.863358 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:38.872615 24242 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:38.872208 25555 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:38.873108 24173 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:38.873726 25555 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:38.864378 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:38.875967 25354 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:38.872071 24241 rpcz_store.cc:269] 0709 12:17:37.169704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.213843 (+ 44139us) service_pool.cc:224] Handling call
0709 12:17:38.868503 (+1654660us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.879901 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.880649 24241 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:38.881574 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1200) took 1148 ms. Trace:
I20260709 12:17:38.881954 24241 rpcz_store.cc:276] 0709 12:17:37.733349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.879567 (+1146218us) service_pool.cc:224] Handling call
0709 12:17:38.881508 (+  1941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.883205 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.884291 24241 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:38.884371 25402 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:38.884974 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1196) took 1211 ms. Trace:
I20260709 12:17:38.885409 24241 rpcz_store.cc:276] 0709 12:17:37.673357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.882723 (+1209366us) service_pool.cc:224] Handling call
0709 12:17:38.884889 (+  2166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.886502 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.887697 25402 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:38.889505 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59342 (request call id 73) took 2883 ms. Trace:
I20260709 12:17:38.889676 25571 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:38.890168 25571 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:38.866164 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1202) took 1132 ms. Trace:
I20260709 12:17:38.890714 24245 rpcz_store.cc:276] 0709 12:17:37.734081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.850109 (+1116028us) service_pool.cc:224] Handling call
0709 12:17:38.866065 (+ 15956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.891729 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:38.892143 25473 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.414s	user 0.013s	sys 0.000s
I20260709 12:17:38.892418 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1189) took 1357 ms. Trace:
I20260709 12:17:38.892807 24245 rpcz_store.cc:276] 0709 12:17:37.534796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.891458 (+1356662us) service_pool.cc:224] Handling call
0709 12:17:38.892360 (+   902us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.892738 25473 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:38.893764 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.894461 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1192) took 1340 ms. Trace:
I20260709 12:17:38.894770 24245 rpcz_store.cc:276] 0709 12:17:37.553942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.893539 (+1339597us) service_pool.cc:224] Handling call
0709 12:17:38.894406 (+   867us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.895619 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.895479 25571 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:38.896296 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1194) took 1261 ms. Trace:
I20260709 12:17:38.868355 24815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 223) took 1218 ms. Trace:
I20260709 12:17:38.896803 25571 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:38.809557 24249 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.276s	user 0.019s	sys 0.033s
I20260709 12:17:38.889935 24176 rpcz_store.cc:276] 0709 12:17:36.006418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.867183 (+2860765us) service_pool.cc:224] Handling call
0709 12:17:38.889408 (+ 22225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.898000 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 74) took 2476 ms. Trace:
I20260709 12:17:38.898937 24176 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:38.897156 24815 rpcz_store.cc:276] 0709 12:17:37.649970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.650194 (+   224us) service_pool.cc:224] Handling call
0709 12:17:38.868279 (+1218085us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26880}
W20260709 12:17:38.899662 24175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 847) took 2573 ms (client timeout 2175 ms). Trace:
W20260709 12:17:38.900095 24175 rpcz_store.cc:269] 0709 12:17:36.339523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.899441 (+2559918us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:38.899563 (+   122us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:38.901017 25495 consensus_meta.cc:287] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.622s	user 0.010s	sys 0.004s
I20260709 12:17:38.901415 25495 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:38.872231 25331 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.424s	user 0.012s	sys 0.003s
W20260709 12:17:38.903450 25504 consensus_meta.cc:287] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.366s	user 0.007s	sys 0.008s
W20260709 12:17:38.814549 24096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1258) took 1885 ms (client timeout 2157 ms). Trace:
W20260709 12:17:38.904547 24096 rpcz_store.cc:269] 0709 12:17:36.929326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.641389 (+712063us) service_pool.cc:224] Handling call
0709 12:17:38.814461 (+1173072us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.899145 24249 rpcz_store.cc:276] 0709 12:17:36.421399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.531919 (+1110520us) service_pool.cc:224] Handling call
0709 12:17:37.532415 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.532698 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:37.533128 (+   430us) log.cc:844] Serialized 14 byte log entry
0709 12:17:38.897611 (+1364483us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:38.897676 (+    65us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:38.897730 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.897810 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.897934 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5425,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":49,"raft.queue_time_us":2600,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":1364067,"threads_started":1,"wal-append.queue_time_us":1278107}
I20260709 12:17:38.896608 24245 rpcz_store.cc:276] 0709 12:17:37.634559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.895372 (+1260813us) service_pool.cc:224] Handling call
0709 12:17:38.896244 (+   872us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.907207 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.907935 24245 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:38.908358 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1187) took 1374 ms. Trace:
I20260709 12:17:38.908249 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.905697 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:38.908803 24245 rpcz_store.cc:276] 0709 12:17:37.534077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.906934 (+1372857us) service_pool.cc:224] Handling call
0709 12:17:38.908279 (+  1345us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:38.909498 24096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1318) took 1681 ms (client timeout 1929 ms). Trace:
I20260709 12:17:38.899698 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 843) took 2733 ms. Trace:
I20260709 12:17:38.909725 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.910109 24176 rpcz_store.cc:276] 0709 12:17:36.166206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.898229 (+2732023us) service_pool.cc:224] Handling call
0709 12:17:38.898561 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.899454 (+   893us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.899647 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.903594 25331 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:38.825429 24141 connection.cc:256] RPC call timeout handler was delayed by -1.2948995429999286s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
W20260709 12:17:39.216804 24141 connection.cc:256] RPC call timeout handler was delayed by -1.2849995429999126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260709 12:17:39.217299 24141 connection.cc:256] RPC call timeout handler was delayed by -1.2705338619998656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 12:17:38.914034 24096 rpcz_store.cc:269] 0709 12:17:37.228390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.905406 (+1677016us) service_pool.cc:224] Handling call
0709 12:17:38.909436 (+  4030us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:39.219188 24096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1315) took 1991 ms (client timeout 1936 ms). Trace:
W20260709 12:17:39.219457 24096 rpcz_store.cc:269] 0709 12:17:37.227506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.218921 (+1991415us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:39.219127 (+   206us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:39.220017 24096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1260) took 2219 ms (client timeout 2173 ms). Trace:
W20260709 12:17:39.220211 24096 rpcz_store.cc:269] 0709 12:17:37.000786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.219889 (+2219103us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:39.219956 (+    67us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:39.220743 24096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1317) took 1992 ms (client timeout 1969 ms). Trace:
W20260709 12:17:39.220947 24096 rpcz_store.cc:269] 0709 12:17:37.228096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.220642 (+1992546us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:39.220707 (+    65us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:39.221625 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:39.222245 24096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1311) took 2182 ms (client timeout 2182 ms). Trace:
W20260709 12:17:39.222455 24096 rpcz_store.cc:269] 0709 12:17:37.039916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.221285 (+2181369us) service_pool.cc:224] Handling call
0709 12:17:39.222202 (+   917us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.911923 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 105) took 2564 ms. Trace:
I20260709 12:17:38.943499 25611 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:38.950227 25594 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:39.225589 24176 rpcz_store.cc:276] 0709 12:17:36.347266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.911245 (+2563979us) service_pool.cc:224] Handling call
0709 12:17:38.911499 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.911678 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:38.911703 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:38.911744 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:38.911765 (+    21us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.911802 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:38.911877 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:39.225898 25611 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:38.956168 25609 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:38.957182 24100 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:39.227208 25609 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:39.227699 25609 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:39.227758 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1240) took 2738 ms. Trace:
I20260709 12:17:38.994501 25615 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:39.228690 25611 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:38.501927 24064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.166s	user 0.001s	sys 0.009s
W20260709 12:17:39.229535 24064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.893s	user 0.007s	sys 0.017s
I20260709 12:17:39.229013 25615 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:39.231630 25615 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:38.010413 24098 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.927s	user 0.013s	sys 0.000s
I20260709 12:17:39.232564 24098 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:39.228318 24100 rpcz_store.cc:276] 0709 12:17:36.489557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.490010 (+   453us) service_pool.cc:224] Handling call
0709 12:17:38.956822 (+2466812us) spinlock_profiling.cc:243] Waited 15 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:38.957031 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:39.227447 (+270416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.227690 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34589568}
I20260709 12:17:39.234457 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:39.234936 24098 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:39.235565 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:37604 (request call id 1235) took 2750 ms. Trace:
I20260709 12:17:39.235947 24098 rpcz_store.cc:276] 0709 12:17:36.485443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.565963 (+ 80520us) service_pool.cc:224] Handling call
0709 12:17:39.235468 (+2669505us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:39.237134 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:37.636524 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:17:38.798182 24095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1302) took 1809 ms (client timeout 1976 ms). Trace:
W20260709 12:17:39.140504 24172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 816) took 3175 ms (client timeout 1504 ms). Trace:
W20260709 12:17:39.237408 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:39.238310 25594 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:39.236575 24100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1255) took 2308 ms (client timeout 2637 ms). Trace:
W20260709 12:17:39.127592 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.912454 25223 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:38.950567 25359 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:39.171964 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:37.112838 24140 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 840)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 847)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1290)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 845)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1287)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 107)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 849)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 850)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1294)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1296)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1288)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 851)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 844)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1277)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1298)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1289)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1283)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1291)
Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:51222 (request call id 7)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 822)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 835)
Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:59342 (request call id 73)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 841)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 843)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 104)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 105)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 106)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 848)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 108)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 109)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 110)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1273)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1274)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1279)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1280)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1281)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1282)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 111)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 112)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 113)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1284)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1285)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1286)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1292)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1293)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1295)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1297)
W20260709 12:17:39.239239 24141 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 2.118s (SENT)
I20260709 12:17:40.280929 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:39.343356 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:39.324616 24167 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 844) took 3158 ms (client timeout 3178 ms). Trace:
W20260709 12:17:40.284600 24167 rpcz_store.cc:269] 0709 12:17:36.166467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.524559 (+1358092us) service_pool.cc:224] Handling call
0709 12:17:39.324347 (+1799788us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b5400199e54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:39.324531 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124267392}
I20260709 12:17:40.285931 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.286538 24167 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
W20260709 12:17:39.350580 24169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 840) took 3185 ms (client timeout 2157 ms). Trace:
W20260709 12:17:39.193015 24168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1290) took 2275 ms (client timeout 1654 ms). Trace:
I20260709 12:17:40.273270 25359 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:40.288935 24168 rpcz_store.cc:269] 0709 12:17:36.917172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.192747 (+2275575us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:39.192909 (+   162us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:39.253634 24170 raft_consensus.cc:1217] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.4->[2.5-2.5]   Dedup: 2.5->[]
I20260709 12:17:40.291527 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.291613 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:39.239120 24172 rpcz_store.cc:269] 0709 12:17:35.964725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.987363 (+ 22638us) service_pool.cc:224] Handling call
0709 12:17:39.140168 (+3152805us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540019ad54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:39.140391 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":400519040}
W20260709 12:17:39.364952 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:38.818953 24092 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
W20260709 12:17:40.358075 22908 debug-util.cc:398] Leaking SignalData structure 0x7b080000fc40 after lost signal to thread 24216
W20260709 12:17:40.358803 22908 kernel_stack_watchdog.cc:198] Thread 24216 stuck at /apache/dev/git/kudu/src/kudu/rpc/outbound_call.cc:307 for 337ms:
Kernel stack:
(could not read kernel stack)
User stack:
<Timed out: thread did not respond: maybe it is blocking signals>
W20260709 12:17:39.239948 24095 rpcz_store.cc:269] 0709 12:17:36.988506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.553215 (+564709us) service_pool.cc:224] Handling call
0709 12:17:38.798070 (+1244855us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:40.363901 24095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1257) took 3434 ms (client timeout 3307 ms). Trace:
W20260709 12:17:40.364418 24095 rpcz_store.cc:269] 0709 12:17:36.928920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.363382 (+3434462us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:40.363553 (+   171us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:40.366227 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:39.237999 24098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1304) took 2246 ms (client timeout 2600 ms). Trace:
I20260709 12:17:40.377782 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1321) took 1129 ms. Trace:
W20260709 12:17:40.378031 24098 rpcz_store.cc:269] 0709 12:17:36.993454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.236789 (+2243335us) service_pool.cc:224] Handling call
0709 12:17:39.237939 (+  1150us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.378378 24095 rpcz_store.cc:276] 0709 12:17:39.244340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.365568 (+1121228us) service_pool.cc:224] Handling call
0709 12:17:40.373857 (+  8289us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.379730 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.381148 24098 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:39.239424 24100 rpcz_store.cc:269] 0709 12:17:36.928178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.234103 (+2305925us) service_pool.cc:224] Handling call
0709 12:17:39.236396 (+  2293us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:40.383524 24140 connection.cc:256] RPC call timeout handler was delayed by -2.9877404220001154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
W20260709 12:17:40.384019 24140 connection.cc:256] RPC call timeout handler was delayed by -2.8509404220001215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17220000000000002s for a response
W20260709 12:17:40.384336 24140 connection.cc:256] RPC call timeout handler was delayed by -2.7690404220002165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 12:17:40.384660 24140 connection.cc:256] RPC call timeout handler was delayed by -2.708740422000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
W20260709 12:17:39.239051 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 1.6025e+06us
W20260709 12:17:39.195997 24067 connection.cc:256] RPC call timeout handler was delayed by -2.0075508479999371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23530000000000004s for a response
W20260709 12:17:39.173192 24094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1259) took 2195 ms (client timeout 2182 ms). Trace:
W20260709 12:17:40.391605 24094 rpcz_store.cc:269] 0709 12:17:36.977988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.172913 (+2194925us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:39.173081 (+   168us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:40.393035 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.394170 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1331) took 1146 ms. Trace:
I20260709 12:17:39.223141 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:40.397152 24096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1313) took 3356 ms (client timeout 2477 ms). Trace:
W20260709 12:17:40.397599 24096 rpcz_store.cc:269] 0709 12:17:37.040495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.222830 (+2182335us) service_pool.cc:224] Handling call
0709 12:17:40.396868 (+1174038us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:39.332176 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:39.159683 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:39.299916 24101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1251) took 2378 ms (client timeout 2425 ms). Trace:
I20260709 12:17:40.332551 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:40.288134 24169 rpcz_store.cc:269] 0709 12:17:36.165249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.350305 (+3185056us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:39.350477 (+   172us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:40.292131 24170 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:38.873742 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 841) took 2708 ms. Trace:
W20260709 12:17:40.333667 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 1.09418e+06us
W20260709 12:17:39.271432 24174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 845) took 3035 ms (client timeout 2353 ms). Trace:
I20260709 12:17:39.256127 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 104) took 2909 ms. Trace:
I20260709 12:17:39.238381 24176 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:17:39.342494 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.242229 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:39.341019 24171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 842) took 3175 ms (client timeout 1869 ms). Trace:
I20260709 12:17:40.292352 24168 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:39.086972 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:40.250385 24197 debug-util.cc:398] Leaking SignalData structure 0x7b0800166a20 after lost signal to thread 22906
W20260709 12:17:38.915200 24216 leader_election.cc:336] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.748s (SENT)
I20260709 12:17:38.919770 24241 raft_consensus.cc:2368] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:39.039880 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:38.910403 24245 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:37.620138 24247 rpcz_store.cc:276] 0709 12:17:36.413372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.298709 (+885337us) service_pool.cc:224] Handling call
0709 12:17:37.448886 (+150177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.449123 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:37.452126 (+  3003us) log.cc:844] Serialized 14 byte log entry
0709 12:17:37.557993 (+105867us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:37.558072 (+    79us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:37.558123 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.558205 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:37.558336 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2416,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":210,"raft.run_cpu_time_us":10219,"raft.run_wall_time_us":53684,"thread_start_us":105326,"threads_started":1}
I20260709 12:17:39.086020 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:40.398957 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:40.442569 24248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1179) took 4023 ms (client timeout 2151 ms). Trace:
I20260709 12:17:38.912575 24249 raft_consensus.cc:2410] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:40.394539 24094 rpcz_store.cc:276] 0709 12:17:39.247417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.392587 (+1145170us) service_pool.cc:224] Handling call
0709 12:17:40.394080 (+  1493us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:39.001741 24806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 213) took 4521 ms (client timeout 1949 ms). Trace:
I20260709 12:17:38.982853 24809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 154) took 1875 ms. Trace:
W20260709 12:17:38.943079 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 108139us
I20260709 12:17:39.080870 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.404587 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:40.450771 24167 raft_consensus.cc:2376] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:40.452316 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.453455 24167 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:39.086611 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:39.089020 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.247742 25223 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:38.915645 25354 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:40.426275 24241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1203) took 2691 ms (client timeout 1670 ms). Trace:
W20260709 12:17:40.475759 24241 rpcz_store.cc:269] 0709 12:17:37.734432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.886186 (+1151754us) service_pool.cc:224] Handling call
0709 12:17:40.425892 (+1539706us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.476338 25354 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:40.423164 24197 debug-util.cc:398] Leaking SignalData structure 0x7b0800167140 after lost signal to thread 24033
W20260709 12:17:40.477461 24241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1205) took 2486 ms (client timeout 1871 ms). Trace:
I20260709 12:17:40.477211 25354 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:40.478009 24241 rpcz_store.cc:269] 0709 12:17:37.991395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.477215 (+2485820us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:40.477390 (+   175us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:39.341050 25356 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:40.482203 25356 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.290606 25359 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:40.482843 24809 rpcz_store.cc:276] 0709 12:17:37.130234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.136014 (+  5780us) service_pool.cc:224] Handling call
0709 12:17:37.235078 (+ 99064us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:37.463215 (+228137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.982480 (+1519265us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b54005d7fd0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:38.982731 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64388864}
I20260709 12:17:38.994939 25450 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:39.137627 25470 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:38.903913 25504 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.490290 24246 raft_consensus.cc:2368] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:39.293282 25518 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:40.494024 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:40.494839 25518 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:40.495122 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1333) took 1247 ms. Trace:
I20260709 12:17:40.495518 25518 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.495713 24094 rpcz_store.cc:276] 0709 12:17:39.247940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.468442 (+1220502us) service_pool.cc:224] Handling call
0709 12:17:40.495038 (+ 26596us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:38.969871 25546 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:39.084417 25554 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:39.020844 25564 log.cc:927] Time spent T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 2.748s	user 0.014s	sys 0.023s
W20260709 12:17:38.930748 25582 log.cc:927] Time spent T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.506s	user 0.019s	sys 0.007s
W20260709 12:17:39.135234 25583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.217s	user 0.010s	sys 0.005s
I20260709 12:17:39.239245 25594 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:40.519029 25594 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:39.243247 25609 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:40.525478 25609 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:38.907325 25473 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:39.000751 25461 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:40.531834 25518 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:38.922504 25331 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:38.914634 25362 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.535612 25362 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.538127 25362 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:38.962489 25536 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:40.540555 25518 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:40.541505 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:39.020782 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1185) took 2600 ms. Trace:
I20260709 12:17:40.545859 24242 rpcz_store.cc:276] 0709 12:17:36.420707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.395570 (+974863us) service_pool.cc:224] Handling call
0709 12:17:38.868036 (+1472466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.873095 (+  5059us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.020435 (+147340us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54003abe50. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:39.020675 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3232441728}
I20260709 12:17:38.923437 25495 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:39.257370 25413 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.549806 25413 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.549909 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:39.084074 25556 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:40.340095 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.552803 24172 raft_consensus.cc:2410] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:40.553576 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.553843 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.291952 25625 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.554966 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.555404 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.555694 25625 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:40.258868 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.349834 25626 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.565830 25626 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.570153 25626 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:40.373781 24092 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1256) took 3428 ms (client timeout 1607 ms). Trace:
W20260709 12:17:40.571133 24092 rpcz_store.cc:269] 0709 12:17:36.928533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.979895 (+ 51362us) service_pool.cc:224] Handling call
0709 12:17:40.356757 (+3376862us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.573066 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:40.574265 24092 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.575606 25495 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.576148 25495 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.578518 25495 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:40.384366 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.579643 24100 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:40.580366 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1328) took 1333 ms. Trace:
W20260709 12:17:39.240317 24065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.829s	user 0.008s	sys 0.014s
I20260709 12:17:40.381673 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1330) took 1134 ms. Trace:
I20260709 12:17:40.583753 24098 rpcz_store.cc:276] 0709 12:17:39.247023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.379121 (+1132098us) service_pool.cc:224] Handling call
0709 12:17:40.381584 (+  2463us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:40.584995 24065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.173s	user 0.008s	sys 0.017s
I20260709 12:17:40.585376 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.586635 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1334) took 1338 ms. Trace:
I20260709 12:17:40.587111 24098 rpcz_store.cc:276] 0709 12:17:39.248256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.584864 (+1336608us) service_pool.cc:224] Handling call
0709 12:17:40.586538 (+  1674us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:40.389218 24140 connection.cc:256] RPC call timeout handler was delayed by -2.6727404220000608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 12:17:40.587877 24140 connection.cc:256] RPC call timeout handler was delayed by -2.5156839119999859s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
I20260709 12:17:40.388458 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:40.588194 25413 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:40.589011 25583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.671s	user 0.010s	sys 0.008s
W20260709 12:17:40.588964 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 200980us
I20260709 12:17:40.379747 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:40.443112 24248 rpcz_store.cc:269] 0709 12:17:36.418714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.999086 (+580372us) service_pool.cc:224] Handling call
0709 12:17:39.085819 (+2086733us) spinlock_profiling.cc:243] Waited 7.28 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:40.442311 (+1356492us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16752384}
I20260709 12:17:40.402287 24099 raft_consensus.cc:2393] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:40.446832 24806 rpcz_store.cc:269] 0709 12:17:34.479885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:34.534339 (+ 54454us) service_pool.cc:224] Handling call
0709 12:17:36.894406 (+2360067us) spinlock_profiling.cc:243] Waited 49.1 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:39.001416 (+2107010us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b540070e9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:39.001610 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":806722176}
W20260709 12:17:40.403224 24101 rpcz_store.cc:269] 0709 12:17:36.921147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.921329 (+   182us) service_pool.cc:224] Handling call
0709 12:17:39.299566 (+2378237us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540037ee54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:39.299771 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":303385984}
I20260709 12:17:40.406808 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 822) took 4418 ms. Trace:
I20260709 12:17:40.438220 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 106) took 4063 ms. Trace:
I20260709 12:17:40.400695 24097 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:40.454622 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:40.445648 24249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1204) took 2710 ms (client timeout 1810 ms). Trace:
I20260709 12:17:40.422268 24244 raft_consensus.cc:2368] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:39.112358 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1172) took 2699 ms. Trace:
W20260709 12:17:40.431903 24247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1197) took 2758 ms (client timeout 2157 ms). Trace:
W20260709 12:17:40.429286 24245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1191) took 2893 ms (client timeout 2075 ms). Trace:
W20260709 12:17:40.464267 24811 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 220) took 2865 ms (client timeout 2182 ms). Trace:
I20260709 12:17:40.413287 24175 rpcz_store.cc:276] 0709 12:17:36.346941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.900755 (+2553814us) service_pool.cc:224] Handling call
0709 12:17:38.901071 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.901285 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:39.245590 (+344305us) log.cc:844] Serialized 14 byte log entry
0709 12:17:39.255694 (+ 10104us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:39.255756 (+    62us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:39.255810 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.255909 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:39.256048 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":60085,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":2731,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":353472,"threads_started":2,"wal-append.queue_time_us":10062,"wal-append.run_cpu_time_us":1261,"wal-append.run_wall_time_us":1001484}
I20260709 12:17:40.439486 25621 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:40.420406 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.408903 24173 rpcz_store.cc:276] 0709 12:17:36.165558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.872357 (+2706799us) service_pool.cc:224] Handling call
0709 12:17:38.872759 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:38.873480 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:38.873685 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.411409 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:40.475016 24808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 229) took 2917 ms (client timeout 3200 ms). Trace:
I20260709 12:17:40.427862 24243 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:40.405640 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:17:40.412426 24174 rpcz_store.cc:269] 0709 12:17:36.236055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.271135 (+3035080us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:39.271335 (+   200us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:40.479390 24197 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8aa0 after lost signal to thread 24125
W20260709 12:17:40.479969 24241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1201) took 2746 ms (client timeout 2173 ms). Trace:
W20260709 12:17:40.475776 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.419073 24171 rpcz_store.cc:269] 0709 12:17:36.165886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.859383 (+693497us) service_pool.cc:224] Handling call
0709 12:17:39.340729 (+2481346us) spinlock_profiling.cc:243] Waited 1.99 s on lock 0x7b540019b754. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:39.340924 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4567087360}
W20260709 12:17:40.492583 24246 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1190) took 2957 ms (client timeout 1908 ms). Trace:
I20260709 12:17:40.493162 25356 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:40.497483 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:40.498548 25504 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:40.512519 25354 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:40.513707 25470 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.515373 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 87) took 3645 ms. Trace:
I20260709 12:17:40.516415 25450 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.533535 24096 raft_consensus.cc:2393] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:40.544839 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.293538 25624 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:40.588275 24140 connection.cc:256] RPC call timeout handler was delayed by -2.4153404220000994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
W20260709 12:17:40.640677 24140 connection.cc:256] RPC call timeout handler was delayed by -2.4018404220000775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22210000000000002s for a response
W20260709 12:17:40.641249 24140 connection.cc:256] RPC call timeout handler was delayed by -2.2744839120000506s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:17:40.641726 24140 connection.cc:256] RPC call timeout handler was delayed by -2.2447839120000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1908s for a response
I20260709 12:17:40.554659 24172 raft_consensus.cc:2376] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3. Re-sending same reply.
I20260709 12:17:40.559386 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.560552 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:40.561614 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.423498 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:40.580672 25625 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:40.580751 24100 rpcz_store.cc:276] 0709 12:17:39.246460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.383767 (+1137307us) service_pool.cc:224] Handling call
0709 12:17:40.580264 (+196497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.665591 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:40.470709 24813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 222) took 2880 ms (client timeout 2637 ms). Trace:
I20260709 12:17:40.666234 25450 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.679637 24250 rpcz_store.cc:276] 0709 12:17:36.412834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.230444 (+817610us) service_pool.cc:224] Handling call
0709 12:17:37.230836 (+   392us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:37.478433 (+247597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:39.111950 (+1633517us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b540008c5d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:39.112247 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":532190592}
W20260709 12:17:40.681270 24250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1208) took 2688 ms (client timeout 1938 ms). Trace:
W20260709 12:17:40.681898 24250 rpcz_store.cc:269] 0709 12:17:37.992653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.681032 (+2688379us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:40.681188 (+   156us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:40.682996 24250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1193) took 3128 ms (client timeout 2425 ms). Trace:
W20260709 12:17:40.689240 24250 rpcz_store.cc:269] 0709 12:17:37.554371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.682767 (+3128396us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:40.682922 (+   155us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:40.641016 24245 rpcz_store.cc:269] 0709 12:17:37.535506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.909533 (+1374027us) service_pool.cc:224] Handling call
0709 12:17:40.429015 (+1519482us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:40.639271 24197 debug-util.cc:398] Leaking SignalData structure 0x7b080035f060 after lost signal to thread 24126
I20260709 12:17:40.641659 24170 rpcz_store.cc:276] 0709 12:17:35.988500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.584477 (+1595977us) service_pool.cc:224] Handling call
0709 12:17:39.253242 (+1668765us) spinlock_profiling.cc:243] Waited 6.5 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:39.253492 (+   250us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.406108 (+1152616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.406531 (+   423us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14942464}
W20260709 12:17:40.690619 24245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1198) took 3016 ms (client timeout 2637 ms). Trace:
W20260709 12:17:40.691037 24245 rpcz_store.cc:269] 0709 12:17:37.674045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.690398 (+3016353us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:40.690544 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:40.691370 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.692405 24170 raft_consensus.cc:2368] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3.
I20260709 12:17:40.692214 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:40.693293 24245 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:40.693346 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:17:40.693912 24245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1195) took 3021 ms (client timeout 3307 ms). Trace:
I20260709 12:17:40.694295 24170 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:17:40.639931 24246 rpcz_store.cc:269] 0709 12:17:37.535174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.664320 (+129146us) service_pool.cc:224] Handling call
0709 12:17:40.492218 (+2827898us) spinlock_profiling.cc:243] Waited 1.69 s on lock 0x7b54000c6554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:40.492489 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3886961024}
I20260709 12:17:40.668219 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:40.695534 24167 raft_consensus.cc:2376] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:40.590855 24066 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:40.539381 25594 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:40.654871 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 151272us
I20260709 12:17:40.697540 25594 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:40.697964 25594 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.698357 25594 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.652966 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.701184 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1335) took 1452 ms. Trace:
I20260709 12:17:40.640043 24176 rpcz_store.cc:276] 0709 12:17:36.351361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:39.226947 (+2875586us) service_pool.cc:224] Handling call
0709 12:17:39.238000 (+ 11053us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.414562 (+1176562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.414883 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:40.656683 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 245535us
I20260709 12:17:40.701874 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1332) took 1454 ms. Trace:
I20260709 12:17:40.702268 24096 rpcz_store.cc:276] 0709 12:17:39.247675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.398504 (+1150829us) service_pool.cc:224] Handling call
0709 12:17:40.701659 (+303155us) spinlock_profiling.cc:243] Waited 90.9 ms on lock 0x7b54001f4fd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:40.701792 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209001216}
I20260709 12:17:40.702822 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:40.703117 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 112509us
I20260709 12:17:40.704820 25625 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:40.705358 25625 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.705857 25625 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:40.594391 24242 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1206) took 2602 ms (client timeout 1930 ms). Trace:
W20260709 12:17:40.707170 24242 rpcz_store.cc:269] 0709 12:17:37.991943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.594067 (+2602124us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:40.594295 (+   228us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:40.708376 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:40.709483 24175 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:40.709883 25626 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:40.710398 25626 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.710501 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.654861 25495 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:40.721778 25495 raft_consensus.cc:697] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:40.723289 25495 consensus_queue.cc:237] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.724514 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:40.663728 24168 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:40.663956 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:40.664310 24094 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.664716 25470 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:40.667261 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:40.667697 24095 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:40.728252 24095 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1320) took 1484 ms (client timeout 1729 ms). Trace:
W20260709 12:17:40.728644 24095 rpcz_store.cc:269] 0709 12:17:39.244052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.379278 (+1135226us) service_pool.cc:224] Handling call
0709 12:17:40.728181 (+348903us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":33664}
W20260709 12:17:40.668200 24244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1175) took 4251 ms (client timeout 2221 ms). Trace:
I20260709 12:17:40.668521 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:40.666826 24813 rpcz_store.cc:269] 0709 12:17:37.590133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.636256 (+ 46123us) service_pool.cc:224] Handling call
0709 12:17:39.088732 (+1452476us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:40.470410 (+1381678us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38036224}
W20260709 12:17:40.670305 24248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1207) took 2678 ms (client timeout 1930 ms). Trace:
I20260709 12:17:40.670749 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:40.666581 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 1.7513e+06us
W20260709 12:17:40.729962 24244 rpcz_store.cc:269] 0709 12:17:36.417260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.050542 (+633282us) service_pool.cc:224] Handling call
0709 12:17:39.086795 (+2036253us) spinlock_profiling.cc:243] Waited 8.21 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:40.668072 (+1581277us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":18873600}
W20260709 12:17:40.642226 24140 connection.cc:256] RPC call timeout handler was delayed by -2.2114839119999488s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
I20260709 12:17:40.666615 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:40.640400 24241 rpcz_store.cc:269] 0709 12:17:37.733748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.478790 (+2745042us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:40.478972 (+   182us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:40.674469 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.674851 24807 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:40.641494 24811 rpcz_store.cc:269] 0709 12:17:37.585250 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.620646 (+ 35396us) service_pool.cc:224] Handling call
0709 12:17:39.080674 (+1460028us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:40.450731 (+1370057us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41839488}
W20260709 12:17:40.679270 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.641631 24808 rpcz_store.cc:269] 0709 12:17:37.557837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:37.563995 (+  6158us) service_pool.cc:224] Handling call
0709 12:17:39.086483 (+1522488us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:40.474763 (+1388280us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507008}
W20260709 12:17:40.655263 24099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1254) took 3727 ms (client timeout 1875 ms). Trace:
I20260709 12:17:40.683703 25621 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:40.684876 25356 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:40.686281 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.687204 24169 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.687914 25450 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:40.649641 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:40.688100 24097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1249) took 3819 ms (client timeout 1908 ms). Trace:
W20260709 12:17:40.640599 24247 rpcz_store.cc:269] 0709 12:17:37.673740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.431528 (+2757788us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:40.431695 (+   167us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:40.648113 24093 rpcz_store.cc:276] 0709 12:17:36.869750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.887405 (+ 17655us) service_pool.cc:224] Handling call
0709 12:17:36.887952 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:36.888281 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:36.888330 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:36.925909 (+ 37579us) log.cc:844] Serialized 26 byte log entry
0709 12:17:37.145895 (+219986us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:37.145947 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:37.148474 (+  2527us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:38.928916 (+1780442us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:40.514656 (+1585740us) raft_consensus.cc:1685] finished
0709 12:17:40.514695 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.515075 (+   380us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13043584,"thread_start_us":149613,"threads_started":1,"wal-append.queue_time_us":302921}
W20260709 12:17:40.640470 24249 rpcz_store.cc:269] 0709 12:17:37.734971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:38.908014 (+1173043us) service_pool.cc:224] Handling call
0709 12:17:40.445423 (+1537409us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.760645 24247 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:17:40.761526 24249 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.761906 24173 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:40.762217 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 910) took 3682 ms. Trace:
I20260709 12:17:40.761417 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 80) took 4317 ms. Trace:
I20260709 12:17:40.762714 24249 rpcz_store.cc:276] 0709 12:17:37.079864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.760719 (+3680855us) service_pool.cc:224] Handling call
0709 12:17:40.761109 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.761935 (+   826us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.762135 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.763422 24173 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:40.763622 24174 raft_consensus.cc:2376] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:40.764120 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 108) took 4408 ms. Trace:
I20260709 12:17:40.764523 24173 rpcz_store.cc:276] 0709 12:17:36.357332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.762737 (+4405405us) service_pool.cc:224] Handling call
0709 12:17:40.763157 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.763874 (+   717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.764039 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.765725 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 911) took 3685 ms. Trace:
I20260709 12:17:40.766217 24249 rpcz_store.cc:276] 0709 12:17:37.080045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.764604 (+3684559us) service_pool.cc:224] Handling call
0709 12:17:40.764977 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.765418 (+   441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.765446 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.765490 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:40.765519 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.765573 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.765674 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.767328 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 109) took 4402 ms. Trace:
I20260709 12:17:40.767786 24174 rpcz_store.cc:276] 0709 12:17:36.365066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.764351 (+4399285us) service_pool.cc:224] Handling call
0709 12:17:40.764946 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.765368 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.766674 (+  1306us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.766882 (+   208us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:40.766957 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.767085 (+   128us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.767230 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.769305 24249 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.769972 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 916) took 3654 ms. Trace:
I20260709 12:17:40.770344 24249 rpcz_store.cc:276] 0709 12:17:37.115240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.768284 (+3653044us) service_pool.cc:224] Handling call
0709 12:17:40.768780 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.769729 (+   949us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.769926 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:40.771978 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.772168 24249 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:40.772936 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 918) took 3643 ms. Trace:
I20260709 12:17:40.773325 24249 rpcz_store.cc:276] 0709 12:17:37.130079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.771610 (+3641531us) service_pool.cc:224] Handling call
0709 12:17:40.772000 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.772689 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.772888 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.774003 25470 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:40.711386 25556 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:40.777511 24214 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:40.778395 25556 raft_consensus.cc:3055] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:40.657724 24812 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:17:40.758531 24097 rpcz_store.cc:269] 0709 12:17:36.868469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.871862 (+  3393us) service_pool.cc:224] Handling call
0709 12:17:39.331974 (+2460112us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:40.672234 (+1340260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16215296}
I20260709 12:17:40.714493 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:40.780143 24176 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:40.781816 24176 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.782352 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1273) took 4380 ms. Trace:
I20260709 12:17:40.706573 24141 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:40.701622 24101 rpcz_store.cc:276] 0709 12:17:39.248541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.639877 (+1391336us) service_pool.cc:224] Handling call
0709 12:17:40.701112 (+ 61235us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.715194 25609 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:40.710940 25626 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:40.694311 24245 rpcz_store.cc:269] 0709 12:17:37.672861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.691758 (+3018897us) service_pool.cc:224] Handling call
0709 12:17:40.693825 (+  2067us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:40.663126 24243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1181) took 4243 ms (client timeout 2140 ms). Trace:
I20260709 12:17:40.731245 24098 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:40.738576 24140 connection.cc:256] RPC call timeout handler was delayed by -2.2051839119999386s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
I20260709 12:17:40.730751 24172 raft_consensus.cc:2376] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:40.741415 24171 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:17:40.739672 24248 rpcz_store.cc:269] 0709 12:17:37.992310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.670053 (+2677743us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:40.670211 (+   158us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:40.734444 24170 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:40.704133 24066 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:40.782753 24168 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:40.762832 24247 rpcz_store.cc:276] 0709 12:17:36.443605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.758800 (+4315195us) service_pool.cc:224] Handling call
0709 12:17:40.760102 (+  1302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.761072 (+   970us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.761324 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.797624 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1274) took 4392 ms. Trace:
I20260709 12:17:40.797837 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.798264 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:40.799024 24140 connection.cc:256] RPC call timeout handler was delayed by -2.1822404220001772s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2465s for a response
I20260709 12:17:40.799190 24247 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
W20260709 12:17:40.799464 24140 connection.cc:256] RPC call timeout handler was delayed by -2.1745839120001165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
W20260709 12:17:40.799837 24140 connection.cc:256] RPC call timeout handler was delayed by -2.020683912000095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2157s for a response
I20260709 12:17:40.799912 25413 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:17:40.800215 24140 connection.cc:256] RPC call timeout handler was delayed by -2.0062839120000717s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 12:17:40.800508 25413 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:40.796036 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.801261 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:40.802156 24248 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:40.801862 25413 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.802248 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.803085 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:40.803478 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 99555.8us
W20260709 12:17:40.791095 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 136697us
I20260709 12:17:40.805912 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:40.742859 24099 rpcz_store.cc:269] 0709 12:17:36.927854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.996559 (+ 68705us) service_pool.cc:224] Handling call
0709 12:17:39.159410 (+2162851us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:40.652512 (+1493102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42542336}
I20260709 12:17:40.807293 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:40.807725 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:40.808228 24067 connection.cc:256] RPC call timeout handler was delayed by -1.8731649050000669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
I20260709 12:17:40.808534 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:40.756968 25621 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:40.778864 25556 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:40.792881 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.810447 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:40.761230 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.780066 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.811573 24098 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:40.811676 24093 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:40.812268 25450 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:40.787849 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.812983 25624 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:40.813985 24171 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:40.814707 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1280) took 4401 ms. Trace:
I20260709 12:17:40.815073 24171 rpcz_store.cc:276] 0709 12:17:36.413219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.798817 (+4385598us) service_pool.cc:224] Handling call
0709 12:17:40.813768 (+ 14951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.814442 (+   674us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.814652 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.798197 24172 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:40.782694 24176 rpcz_store.cc:276] 0709 12:17:36.402552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.780975 (+4378423us) service_pool.cc:224] Handling call
0709 12:17:40.781370 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.782127 (+   757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.782299 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.817775 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1279) took 4404 ms. Trace:
I20260709 12:17:40.818136 24172 rpcz_store.cc:276] 0709 12:17:36.412906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.797450 (+4384544us) service_pool.cc:224] Handling call
0709 12:17:40.797935 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.817508 (+ 19573us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.817691 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.819060 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 111) took 4401 ms. Trace:
I20260709 12:17:40.819443 24176 rpcz_store.cc:276] 0709 12:17:36.418076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.817840 (+4399764us) service_pool.cc:224] Handling call
0709 12:17:40.818257 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.818684 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.818710 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.818779 (+    69us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:40.818811 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.818862 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.818973 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.798143 24168 rpcz_store.cc:276] 0709 12:17:36.405144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.781935 (+4376791us) service_pool.cc:224] Handling call
0709 12:17:40.782344 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.797292 (+ 14948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.797534 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.804922 24170 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:40.821002 24101 raft_consensus.cc:2393] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:40.794656 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.821267 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1281) took 4407 ms. Trace:
I20260709 12:17:40.752238 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:40.811829 24097 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
W20260709 12:17:40.692282 24197 debug-util.cc:398] Leaking SignalData structure 0x7b080021a560 after lost signal to thread 24200
I20260709 12:17:40.812461 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:40.813988 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 107576us
I20260709 12:17:40.821771 24170 rpcz_store.cc:276] 0709 12:17:36.413549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.804303 (+4390754us) service_pool.cc:224] Handling call
0709 12:17:40.804649 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.820994 (+ 16345us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.821193 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.822384 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1327) took 1576 ms. Trace:
I20260709 12:17:40.833341 24097 rpcz_store.cc:276] 0709 12:17:39.246190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.779667 (+1533477us) service_pool.cc:224] Handling call
0709 12:17:40.822238 (+ 42571us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:40.800596 24140 connection.cc:256] RPC call timeout handler was delayed by -1.9981839120000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
I20260709 12:17:40.803819 24248 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
W20260709 12:17:40.834383 24140 connection.cc:256] RPC call timeout handler was delayed by -1.7794839120001598s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2425s for a response
W20260709 12:17:40.834745 24140 connection.cc:256] RPC call timeout handler was delayed by -1.5886839120000786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2637s for a response
I20260709 12:17:40.809204 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.803823 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.823176 24096 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:40.752975 24167 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:40.812511 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1323) took 1567 ms. Trace:
I20260709 12:17:40.751089 25625 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.795843 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:40.755136 23998 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:40.775527 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 919) took 3643 ms. Trace:
I20260709 12:17:40.800454 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:40.783413 24241 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:17:40.778728 24214 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:40.812816 25450 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:40.843289 24249 rpcz_store.cc:276] 0709 12:17:37.132598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.774585 (+3641987us) service_pool.cc:224] Handling call
0709 12:17:40.774967 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.775200 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.775230 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.775275 (+    45us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:40.775310 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.775366 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.775461 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.852442 24100 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:40.859421 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:40.861590 24245 raft_consensus.cc:2368] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:40.863559 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:40.865154 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.866122 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:40.867038 24248 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:40.868067 25625 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:40.869179 24812 raft_consensus.cc:2410] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:40.869563 24170 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 3. Ops: []
I20260709 12:17:40.870262 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1285) took 4070 ms. Trace:
I20260709 12:17:40.870627 24170 rpcz_store.cc:276] 0709 12:17:36.800199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.844261 (+4044062us) service_pool.cc:224] Handling call
0709 12:17:40.869320 (+ 25059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.869967 (+   647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.870174 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.810405 25556 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.872318 24169 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:40.868221 24248 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:40.876179 24098 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:40.840518 24167 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:40.883908 24099 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:40.885869 24094 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:40.883399 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:40.887228 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1199) took 3146 ms. Trace:
W20260709 12:17:40.812760 24243 rpcz_store.cc:269] 0709 12:17:36.419370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:36.991750 (+572380us) service_pool.cc:224] Handling call
0709 12:17:39.039715 (+2047965us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:40.656442 (+1616727us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9889152}
I20260709 12:17:40.892156 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 97) took 9459 ms. Trace:
I20260709 12:17:40.892251 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:40.887663 24248 rpcz_store.cc:276] 0709 12:17:37.732860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.867614 (+3134754us) service_pool.cc:224] Handling call
0709 12:17:40.868003 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.878634 (+ 10631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.878878 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.894270 25624 consensus_queue.cc:1059] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:40.895959 25556 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:40.896236 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.895644 23998 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 2 to 3, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 3 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:17:40.897055 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.897727 23998 catalog_manager.cc:5697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:17:40.860478 25450 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.892704 23996 rpcz_store.cc:276] 0709 12:17:31.433130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:31.444618 (+ 11488us) service_pool.cc:224] Handling call
0709 12:17:32.394026 (+949408us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:17:40.891881 (+8497855us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:35.013573 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:35.221923 (+208350us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:35.225307 (+  3384us) write_op.cc:435] Acquired schema lock
0709 12:17:35.228835 (+  3528us) tablet.cc:662] Decoding operations
0709 12:17:35.368500 (+139665us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:35.389452 (+ 20952us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:35.415591 (+ 26139us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:17:35.541513 (+125922us) tablet.cc:701] Row locks acquired
0709 12:17:35.541549 (+    36us) write_op.cc:260] PREPARE: finished
0709 12:17:35.541755 (+   206us) write_op.cc:270] Start()
0709 12:17:35.545179 (+  3424us) write_op.cc:276] Timestamp: P: 1783599455541702 usec, L: 0
0709 12:17:35.545213 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:17:35.651200 (+105987us) log.cc:844] Serialized 4749 byte log entry
0709 12:17:36.979633 (+1328433us) op_driver.cc:464] REPLICATION: finished
0709 12:17:37.284539 (+304906us) write_op.cc:301] APPLY: starting
0709 12:17:37.331754 (+ 47215us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:37.463133 (+131379us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:37.487145 (+ 24012us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:37.916451 (+429306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:37.916846 (+   395us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 12:17:37.916921 (+    75us) write_op.cc:312] APPLY: finished
0709 12:17:37.917431 (+   510us) log.cc:844] Serialized 88 byte log entry
0709 12:17:39.134518 (+1217087us) spinlock_profiling.cc:243] Waited 46.9 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c024710ac 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b
0709 12:17:40.589981 (+1455463us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:40.590505 (+   524us) write_op.cc:454] Released schema lock
0709 12:17:40.590632 (+   127us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:40.591398 (+   766us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:40.591436 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":366473,"reported_tablets":13,"spinlock_wait_cycles":127688064,"child_traces":[["op",{"apply.queue_time_us":291399,"apply.run_cpu_time_us":24744,"apply.run_wall_time_us":3310707,"num_ops":12,"prepare.queue_time_us":666351,"prepare.run_cpu_time_us":14514,"prepare.run_wall_time_us":838223,"raft.queue_time_us":548380,"raft.run_cpu_time_us":52430,"raft.run_wall_time_us":245575,"replication_time_us":1387884,"spinlock_wait_cycles":107891072,"thread_start_us":3473473,"threads_started":5,"wal-append.queue_time_us":1405629,"wal-append.run_cpu_time_us":21565,"wal-append.run_wall_time_us":2998831}]]}
W20260709 12:17:40.900574 24216 connection.cc:256] RPC call timeout handler was delayed by -1.6959123650001402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3328s for a response
W20260709 12:17:40.887924 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 109276us
I20260709 12:17:40.902464 24176 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:40.886684 24094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1324) took 1641 ms (client timeout 2082 ms). Trace:
I20260709 12:17:40.841730 24093 rpcz_store.cc:276] 0709 12:17:39.244881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.760813 (+1515932us) service_pool.cc:224] Handling call
0709 12:17:40.812445 (+ 51632us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.896129 25461 raft_consensus.cc:3055] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:40.912199 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 113) took 4443 ms. Trace:
I20260709 12:17:40.906663 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:40.907889 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1284) took 4129 ms. Trace:
I20260709 12:17:40.900892 24807 raft_consensus.cc:2410] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:40.905804 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:40.911444 24094 rpcz_store.cc:269] 0709 12:17:39.245130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.497030 (+1251900us) service_pool.cc:224] Handling call
0709 12:17:40.886600 (+389570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.914693 24169 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:17:40.916844 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:40.917861 24168 rpcz_store.cc:276] 0709 12:17:36.468623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.834671 (+4366048us) service_pool.cc:224] Handling call
0709 12:17:40.876095 (+ 41424us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.911788 (+ 35693us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.911818 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:40.911865 (+    47us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:40.911969 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.912034 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.912139 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.918493 24176 rpcz_store.cc:276] 0709 12:17:36.775136 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.839216 (+4064080us) service_pool.cc:224] Handling call
0709 12:17:40.888249 (+ 49033us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.904438 (+ 16189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.904664 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.920771 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1293) took 3987 ms. Trace:
I20260709 12:17:40.920046 24175 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:40.905902 25470 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:40.923929 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 68834.5us
I20260709 12:17:40.924957 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:40.925352 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 79) took 4502 ms. Trace:
I20260709 12:17:40.925830 24241 rpcz_store.cc:276] 0709 12:17:36.443200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.746905 (+4303705us) service_pool.cc:224] Handling call
0709 12:17:40.747432 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.858754 (+111322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.925032 (+ 66278us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b54003598d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:40.925261 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81755392}
I20260709 12:17:40.926335 25546 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:40.921171 24169 rpcz_store.cc:276] 0709 12:17:36.933297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.887863 (+3954566us) service_pool.cc:224] Handling call
0709 12:17:40.909352 (+ 21489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.920461 (+ 11109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.920712 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.923566 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 848) took 4569 ms. Trace:
I20260709 12:17:40.928121 24175 rpcz_store.cc:276] 0709 12:17:36.351733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.834937 (+4483204us) service_pool.cc:224] Handling call
0709 12:17:40.876291 (+ 41354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.921291 (+ 45000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.921492 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.914225 25625 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:40.928176 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.938812 24214 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:40.940267 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.937777 23998 catalog_manager.cc:5697] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 2 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:17:40.926786 25546 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:40.943241 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:40.917624 25461 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:40.927496 25356 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:40.954150 24094 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.959753 24169 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:40.960572 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1297) took 3984 ms. Trace:
I20260709 12:17:40.960952 24169 rpcz_store.cc:276] 0709 12:17:36.980586 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.936606 (+3956020us) service_pool.cc:224] Handling call
0709 12:17:40.959482 (+ 22876us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.960269 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.960512 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.961439 24141 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:40.948139 25546 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:40.965363 24176 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:40.957779 24197 debug-util.cc:398] Leaking SignalData structure 0x7b08002f5160 after lost signal to thread 24274
I20260709 12:17:40.966825 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1295) took 4013 ms. Trace:
I20260709 12:17:40.971935 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.972358 24176 rpcz_store.cc:276] 0709 12:17:36.953237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.927642 (+3974405us) service_pool.cc:224] Handling call
0709 12:17:40.950681 (+ 23039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.966308 (+ 15627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.966720 (+   412us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.955945 25504 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:40.977001 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 75) took 4555 ms. Trace:
I20260709 12:17:40.977433 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.944612 25626 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:40.963665 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:40.981298 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:40.983888 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:17:40.988749 24216 connection.cc:256] RPC call timeout handler was delayed by -1.2945180600002004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 12:17:40.989403 24216 connection.cc:256] RPC call timeout handler was delayed by -1.2945180600002004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16620000000000001s for a response
W20260709 12:17:41.004407 24216 connection.cc:256] RPC call timeout handler was delayed by -1.2576180600001408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1703s for a response
W20260709 12:17:41.005070 24216 connection.cc:256] RPC call timeout handler was delayed by -1.2369180600001073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 12:17:41.005472 24216 connection.cc:256] RPC call timeout handler was delayed by -1.2342180600001029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17290000000000003s for a response
W20260709 12:17:41.005870 24216 connection.cc:256] RPC call timeout handler was delayed by -1.1514180600001964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
W20260709 12:17:41.006258 24216 connection.cc:256] RPC call timeout handler was delayed by -1.0542180600000393s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 12:17:41.006637 24216 connection.cc:256] RPC call timeout handler was delayed by -1.0479180600000291s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
I20260709 12:17:40.964437 23998 catalog_manager.cc:5697] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 2 to 3, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 3 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:40.979146 24246 rpcz_store.cc:276] 0709 12:17:36.421719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.695385 (+4273666us) service_pool.cc:224] Handling call
0709 12:17:40.695919 (+   534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.696488 (+   569us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.696517 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.697298 (+   781us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.757223 (+ 59925us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:40.910907 (+153684us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.911174 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.911253 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:40.976717 (+ 65464us) raft_consensus.cc:1685] finished
0709 12:17:40.976737 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:40.976903 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":108805,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":282,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":255,"thread_start_us":123325,"threads_started":2,"wal-append.queue_time_us":172613}
I20260709 12:17:40.959760 25356 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:41.022493 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:41.018152 24095 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:41.024711 25631 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:41.025154 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 43972.7us
I20260709 12:17:41.025271 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1299) took 4037 ms. Trace:
I20260709 12:17:41.025393 25631 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:41.025925 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 66409us
I20260709 12:17:41.026544 24214 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:41.027366 25504 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.027905 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1300) took 4040 ms. Trace:
I20260709 12:17:41.031159 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1297) took 4036 ms. Trace:
I20260709 12:17:41.031692 24095 rpcz_store.cc:276] 0709 12:17:36.986892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.954126 (+3967234us) service_pool.cc:224] Handling call
0709 12:17:41.015271 (+ 61145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.023268 (+  7997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.023597 (+   329us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:40.979591 25594 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.029981 24100 rpcz_store.cc:276] 0709 12:17:36.987925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.990267 (+4002342us) service_pool.cc:224] Handling call
0709 12:17:41.027309 (+ 37042us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.027574 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.027602 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.027645 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:41.027676 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.027727 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.027841 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.033532 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 116) took 3577 ms. Trace:
I20260709 12:17:41.033921 24168 rpcz_store.cc:276] 0709 12:17:37.456001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.940346 (+3484345us) service_pool.cc:224] Handling call
0709 12:17:40.958293 (+ 17947us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.029130 (+ 70837us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.029175 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.033234 (+  4059us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:41.033287 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.033355 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.033468 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:41.035954 24067 connection.cc:256] RPC call timeout handler was delayed by -1.2650508479998734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3178s for a response
I20260709 12:17:41.037190 24096 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:41.038070 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1298) took 4050 ms. Trace:
I20260709 12:17:41.038498 24096 rpcz_store.cc:276] 0709 12:17:36.987298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.950423 (+3963125us) service_pool.cc:224] Handling call
0709 12:17:40.990368 (+ 39945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.037747 (+ 47379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.037998 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.025889 24097 rpcz_store.cc:276] 0709 12:17:36.987603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.982820 (+3995217us) service_pool.cc:224] Handling call
0709 12:17:40.995365 (+ 12545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.024849 (+ 29484us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.024879 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.024952 (+    73us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:41.024983 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.025056 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.025187 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.041648 24097 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:41.044906 24067 connection.cc:256] RPC call timeout handler was delayed by -1.2270117630000641s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
I20260709 12:17:41.048357 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1301) took 4055 ms. Trace:
I20260709 12:17:41.034222 23998 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 3, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 3 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:17:41.054807 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 93593us
I20260709 12:17:41.053861 24097 rpcz_store.cc:276] 0709 12:17:36.988225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.040979 (+4052754us) service_pool.cc:224] Handling call
0709 12:17:41.041438 (+   459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.043705 (+  2267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.043882 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.058673 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:41.060595 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:41.059981 23998 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:41.062556 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:41.053606 24214 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:41.064248 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:41.066740 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1306) took 4062 ms. Trace:
I20260709 12:17:41.067411 25495 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:41.067759 24097 rpcz_store.cc:276] 0709 12:17:37.004566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.065437 (+4060871us) service_pool.cc:224] Handling call
0709 12:17:41.065948 (+   511us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.066239 (+   291us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.066286 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.066369 (+    83us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:41.066412 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.066486 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.066648 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.071293 25625 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:41.072026 25625 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:41.050100 24067 connection.cc:256] RPC call timeout handler was delayed by -1.2009117630000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260709 12:17:41.077142 24101 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:41.083410 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:41.077481 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 50670.4us
I20260709 12:17:41.030228 25354 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:41.084916 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:41.035899 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 76) took 4613 ms. Trace:
I20260709 12:17:41.092671 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:41.098560 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1316) took 3870 ms. Trace:
I20260709 12:17:41.099255 24096 rpcz_store.cc:276] 0709 12:17:37.227787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.097299 (+3869512us) service_pool.cc:224] Handling call
0709 12:17:41.097793 (+   494us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.098167 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.098202 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.098256 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:41.098296 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.098359 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.098484 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.103317 24096 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:41.050798 25413 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.105099 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:41.003816 24167 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.107846 24097 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:41.110720 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:41.111774 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1307) took 4104 ms. Trace:
I20260709 12:17:41.112138 24097 rpcz_store.cc:276] 0709 12:17:37.007017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.071678 (+4064661us) service_pool.cc:224] Handling call
0709 12:17:41.092224 (+ 20546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.111520 (+ 19296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.111713 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.113942 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1325) took 1868 ms. Trace:
I20260709 12:17:41.114284 24097 rpcz_store.cc:276] 0709 12:17:39.245383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.112877 (+1867494us) service_pool.cc:224] Handling call
0709 12:17:41.113265 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.113483 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.113508 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.113568 (+    60us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:41.113596 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.113645 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.113889 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.114926 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1319) took 1882 ms. Trace:
I20260709 12:17:41.051085 24092 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:41.118075 24096 rpcz_store.cc:276] 0709 12:17:39.243619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.101167 (+1857548us) service_pool.cc:224] Handling call
0709 12:17:41.102224 (+  1057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.113218 (+ 10994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.114382 (+  1164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.122673 25359 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:41.123261 25359 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:41.125310 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.128921 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.129711 24245 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
W20260709 12:17:41.128315 25635 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.138s	user 0.001s	sys 0.001s
I20260709 12:17:41.107434 25641 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:41.123723 25359 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:41.132489 24197 debug-util.cc:398] Leaking SignalData structure 0x7b080036a080 after lost signal to thread 24839
I20260709 12:17:41.152261 24095 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:41.146878 25641 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:41.127314 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 78) took 4701 ms. Trace:
I20260709 12:17:41.165596 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:41.172390 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61770.1us
W20260709 12:17:41.132357 24092 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1329) took 1880 ms (client timeout 2178 ms). Trace:
W20260709 12:17:41.175199 25637 log.cc:927] Time spent T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:17:41.174644 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:41.179394 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.178627 25639 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:17:41.175590 25413 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:41.176904 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 77) took 4754 ms. Trace:
I20260709 12:17:41.189417 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:41.185094 25473 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:41.083521 25461 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.193773 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.154618 25362 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:41.193871 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 110) took 4814 ms. Trace:
I20260709 12:17:41.193583 25473 raft_consensus.cc:697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:41.187178 24250 rpcz_store.cc:276] 0709 12:17:36.422447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.711544 (+4289097us) service_pool.cc:224] Handling call
0709 12:17:40.712050 (+   506us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.715861 (+  3811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.715899 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.716566 (+   667us) log.cc:844] Serialized 26 byte log entry
0709 12:17:40.876673 (+160107us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:40.876716 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:40.876796 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.176585 (+299789us) raft_consensus.cc:1685] finished
0709 12:17:41.176612 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.176808 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2828,"raft.run_cpu_time_us":245,"raft.run_wall_time_us":246,"thread_start_us":159645,"threads_started":1,"wal-append.queue_time_us":224759}
I20260709 12:17:41.173480 25641 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.205780 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:41.229956 24100 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:41.197736 24173 rpcz_store.cc:276] 0709 12:17:36.371806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.765524 (+4393718us) service_pool.cc:224] Handling call
0709 12:17:40.765966 (+   442us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.766578 (+   612us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.766613 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.840179 (+ 73566us) log.cc:844] Serialized 26 byte log entry
0709 12:17:41.042826 (+202647us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:41.042872 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.042938 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.180716 (+137778us) raft_consensus.cc:1685] finished
0709 12:17:41.180742 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.185840 (+  5098us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":313,"thread_start_us":141944,"threads_started":1,"wal-append.queue_time_us":248046}
I20260709 12:17:41.234894 24094 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:41.202530 24167 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.196817 24243 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:41.209245 25631 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:41.182363 24092 rpcz_store.cc:269] 0709 12:17:39.246719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.572517 (+1325798us) service_pool.cc:224] Handling call
0709 12:17:41.124301 (+551784us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.237969 24247 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:41.238646 25461 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.209982 24093 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:41.197530 25362 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:41.202798 25354 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:41.243407 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54168.9us
I20260709 12:17:41.229944 25626 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:41.246207 24095 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:41.254552 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.264470 24836 debug-util.cc:398] Leaking SignalData structure 0x7b080005a720 after lost signal to thread 22906
W20260709 12:17:41.266304 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08000f94e0 after lost signal to thread 24033
W20260709 12:17:41.267390 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.268602 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:41.096066 24242 rpcz_store.cc:276] 0709 12:17:36.422074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.708086 (+4286012us) service_pool.cc:224] Handling call
0709 12:17:40.708586 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.709067 (+   481us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:40.862887 (+153820us) log.cc:844] Serialized 14 byte log entry
0709 12:17:40.989655 (+126768us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.003456 (+ 13801us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:41.015916 (+ 12460us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.024024 (+  8108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.033458 (+  9434us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":149070,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":2010,"raft.run_cpu_time_us":217,"raft.run_wall_time_us":21391,"thread_start_us":197038,"threads_started":2,"wal-append.queue_time_us":166298}
I20260709 12:17:41.255388 25362 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.282411 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1312) took 4242 ms. Trace:
I20260709 12:17:41.284668 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:41.294160 25621 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.297160 25621 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:41.299189 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.299618 25621 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:41.307374 24098 raft_consensus.cc:2410] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:41.310694 24096 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:41.311677 24101 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:41.290179 25356 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:41.317265 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1326) took 2071 ms. Trace:
I20260709 12:17:41.290705 25594 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:41.321099 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.327280 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:41.332016 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 856) took 1054 ms. Trace:
W20260709 12:17:41.333603 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 91142.2us
I20260709 12:17:41.294749 25473 consensus_queue.cc:237] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.337604 25536 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:41.332584 24176 rpcz_store.cc:276] 0709 12:17:40.277581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.973846 (+696265us) service_pool.cc:224] Handling call
0709 12:17:41.020187 (+ 46341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.327204 (+307017us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.327243 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.331675 (+  4432us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:41.331718 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.331809 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.331945 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":245268,"threads_started":1}
I20260709 12:17:41.322232 24097 rpcz_store.cc:276] 0709 12:17:39.245870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.115187 (+1869317us) service_pool.cc:224] Handling call
0709 12:17:41.115532 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.115786 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:41.202066 (+ 86280us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.314564 (+112498us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.316947 (+  2383us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:41.317000 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.317072 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.317195 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19243,"prepare.queue_time_us":136057,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":53,"raft.queue_time_us":106,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":105,"thread_start_us":143909,"threads_started":2}
I20260709 12:17:41.282913 24093 rpcz_store.cc:276] 0709 12:17:37.040210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.093153 (+4052943us) service_pool.cc:224] Handling call
0709 12:17:41.151260 (+ 58107us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.253343 (+102083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.282313 (+ 28970us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.316604 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.325440 24092 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:41.327630 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.375677 24812 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:41.380662 25554 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.037s
W20260709 12:17:41.383265 25647 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
W20260709 12:17:41.388290 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.377707 24067 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items [suppressed 80 similar messages]
I20260709 12:17:41.323844 25631 consensus_queue.cc:1059] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.052s
I20260709 12:17:41.390190 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:41.393247 24215 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:41.397614 24097 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:41.399608 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800354c60 after lost signal to thread 24125
I20260709 12:17:41.399310 25413 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:41.390146 25359 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:41.410176 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800354b60 after lost signal to thread 24126
I20260709 12:17:41.395282 25450 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.172214 24244 rpcz_store.cc:276] 0709 12:17:36.422787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.736768 (+4313981us) service_pool.cc:224] Handling call
0709 12:17:40.737312 (+   544us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.737752 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:40.919180 (+181428us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.087868 (+168688us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.093242 (+  5374us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:41.096476 (+  3234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.110339 (+ 13863us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.124303 (+ 13964us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":440,"prepare.queue_time_us":128043,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":42711,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":8597,"thread_start_us":238044,"threads_started":2,"wal-append.queue_time_us":254046}
I20260709 12:17:41.416692 25356 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:41.408375 25631 raft_consensus.cc:3055] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:41.423033 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.424067 25356 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:41.424563 25356 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.425009 25356 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.424873 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.425757 24243 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:41.426600 25631 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:41.427488 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:41.422602 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:41.439083 24247 raft_consensus.cc:2368] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4.
W20260709 12:17:41.444468 25648 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.253s	user 0.006s	sys 0.000s
I20260709 12:17:41.446063 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 920) took 4296 ms. Trace:
W20260709 12:17:41.422662 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08003548c0 after lost signal to thread 24200
I20260709 12:17:41.403957 25594 consensus_queue.cc:1059] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:17:41.450420 25470 consensus_meta.cc:287] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.526s	user 0.015s	sys 0.000s
I20260709 12:17:41.450908 25470 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:41.451889 25450 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:41.452253 25650 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.255s	user 0.000s	sys 0.002s
I20260709 12:17:41.459794 25362 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:41.462914 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:41.464363 25359 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:41.464850 25413 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:41.446463 24249 rpcz_store.cc:276] 0709 12:17:37.149405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.865094 (+3715689us) service_pool.cc:224] Handling call
0709 12:17:40.877105 (+ 12011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.904659 (+ 27554us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.904719 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.919104 (+ 14385us) log.cc:844] Serialized 26 byte log entry
0709 12:17:41.043202 (+124098us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:41.043248 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.043334 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.428729 (+385395us) spinlock_profiling.cc:243] Waited 6.48 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:41.445675 (+ 16946us) raft_consensus.cc:1685] finished
0709 12:17:41.445713 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.445959 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":199,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":10111,"spinlock_wait_cycles":14901120,"thread_start_us":93299,"threads_started":1,"wal-append.queue_time_us":249890}
I20260709 12:17:41.468652 24807 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:17:41.471509 24243 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:41.472070 25556 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.576s	user 0.014s	sys 0.003s
I20260709 12:17:41.472572 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:41.479156 24250 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:41.449369 24836 debug-util.cc:398] Leaking SignalData structure 0x7b080030c9c0 after lost signal to thread 24216
I20260709 12:17:41.488751 24807 pending_rounds.cc:85] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Aborting all ops after (but not including) 4
I20260709 12:17:41.506477 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:41.509527 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 75355.7us
I20260709 12:17:41.511035 24248 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:41.513247 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 452783us
W20260709 12:17:41.516772 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 123595us
I20260709 12:17:41.518158 24097 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:41.519567 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:41.529899 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:41.532433 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:41.502007 25354 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:41.504854 25504 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:41.458330 25625 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:41.504670 25470 raft_consensus.cc:3055] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:41.542908 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1282) took 5119 ms. Trace:
W20260709 12:17:41.535029 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 492482us
I20260709 12:17:41.515477 25359 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:41.554028 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 112727us
I20260709 12:17:41.515848 24807 pending_rounds.cc:107] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:17:41.555154 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:41.555992 24245 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.556876 25643 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:41.557719 25362 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:41.558492 25643 raft_consensus.cc:2764] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
W20260709 12:17:41.558741 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08002d8fc0 after lost signal to thread 24241
W20260709 12:17:41.559218 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800306780 after lost signal to thread 24242
W20260709 12:17:41.559530 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08003145e0 after lost signal to thread 24243
W20260709 12:17:41.559818 24836 debug-util.cc:398] Leaking SignalData structure 0x7b080031c160 after lost signal to thread 24244
W20260709 12:17:41.560078 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800320ae0 after lost signal to thread 24245
W20260709 12:17:41.560396 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800390940 after lost signal to thread 24247
W20260709 12:17:41.560644 24836 debug-util.cc:398] Leaking SignalData structure 0x7b080031c120 after lost signal to thread 24248
W20260709 12:17:41.560930 24836 debug-util.cc:398] Leaking SignalData structure 0x7b080031c040 after lost signal to thread 24249
W20260709 12:17:41.561270 24836 debug-util.cc:398] Leaking SignalData structure 0x7b080031bfa0 after lost signal to thread 24250
I20260709 12:17:41.561067 25621 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:41.562095 24836 debug-util.cc:398] Leaking SignalData structure 0x7b080032a340 after lost signal to thread 24274
W20260709 12:17:41.562618 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08002c2260 after lost signal to thread 24780
I20260709 12:17:41.543579 24171 rpcz_store.cc:276] 0709 12:17:36.477623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.815964 (+4338341us) service_pool.cc:224] Handling call
0709 12:17:40.816421 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:40.816794 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:40.816820 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:40.856354 (+ 39534us) log.cc:844] Serialized 26 byte log entry
0709 12:17:41.043542 (+187188us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:41.122038 (+ 78496us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.451407 (+329369us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:41.518751 (+ 67344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.518884 (+   133us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.518953 (+    69us) raft_consensus.cc:1685] finished
0709 12:17:41.533336 (+ 14383us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.533567 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":395929,"prepare.queue_time_us":66880,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":50,"spinlock_wait_cycles":6979840,"thread_start_us":212885,"threads_started":2,"wal-append.queue_time_us":224895}
I20260709 12:17:41.563516 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:41.564540 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 112) took 5097 ms. Trace:
I20260709 12:17:41.567847 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:41.544929 25470 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:41.572330 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.529955 25641 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:41.563926 24807 raft_consensus.cc:2889] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:41.580783 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.580004 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1286) took 4732 ms. Trace:
I20260709 12:17:41.563565 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:41.586246 25666 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:41.564944 24172 rpcz_store.cc:276] 0709 12:17:36.467239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.818939 (+4351700us) service_pool.cc:224] Handling call
0709 12:17:40.819329 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:40.819616 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:40.958827 (+139211us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.075628 (+116801us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b1800253a80. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b23a
0709 12:17:41.298153 (+222525us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b1800253a80. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:17:41.564155 (+266002us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.564234 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:41.564283 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.564352 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.564480 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":415350,"prepare.queue_time_us":162466,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":5546,"raft.queue_time_us":483363,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"spinlock_wait_cycles":6140032,"thread_start_us":189239,"threads_started":3,"wal-append.queue_time_us":39683}
I20260709 12:17:41.598410 24173 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:41.598814 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:41.599156 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 861) took 1320 ms. Trace:
W20260709 12:17:41.592816 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08003029e0 after lost signal to thread 24806
W20260709 12:17:41.600574 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08003338a0 after lost signal to thread 24808
W20260709 12:17:41.600853 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.600497 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44779.2us
W20260709 12:17:41.601130 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800333860 after lost signal to thread 24809
W20260709 12:17:41.601507 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800333900 after lost signal to thread 24811
W20260709 12:17:41.601801 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800348920 after lost signal to thread 24813
I20260709 12:17:41.575417 24167 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:41.608356 24246 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:41.599978 24169 rpcz_store.cc:276] 0709 12:17:40.278824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.123333 (+844509us) service_pool.cc:224] Handling call
0709 12:17:41.123885 (+   552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.581206 (+457321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.581230 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.587170 (+  5940us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:41.598343 (+ 11173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.598581 (+   238us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.599016 (+   435us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":392660,"raft.queue_time_us":433522,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":48316,"threads_started":1}
I20260709 12:17:41.583534 24174 rpcz_store.cc:276] 0709 12:17:36.847735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.843518 (+3995783us) service_pool.cc:224] Handling call
0709 12:17:40.903494 (+ 59976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:41.010506 (+107012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.010539 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:41.011225 (+   686us) log.cc:844] Serialized 26 byte log entry
0709 12:17:41.027817 (+ 16592us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:41.044455 (+ 16638us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.478434 (+433979us) spinlock_profiling.cc:243] Waited 914 us on lock 0x7b18003f1300. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02408c0a 00007f4c0bb48219 00007f4c02490a40 00007f4c0248b4e4 00007f4c0248b455 00007f4c05573060 00007f4c05585716 00007f4c05596287 00007f4c05596208
0709 12:17:41.570794 (+ 92360us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.570888 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.570933 (+    45us) raft_consensus.cc:1685] finished
0709 12:17:41.579651 (+  8718us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.579887 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60728,"prepare.queue_time_us":20570,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":5398,"raft.queue_time_us":1068213,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":26540,"spinlock_wait_cycles":2101632,"thread_start_us":149766,"threads_started":3,"wal-append.queue_time_us":81072}
I20260709 12:17:41.595921 25609 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:41.620939 24141 leader_election.cc:400] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:41.622498 25495 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:17:41.623721 25656 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:17:41.639912 25641 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:41.641960 24779 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.952s (SENT)
I20260709 12:17:41.642170 24249 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:41.643312 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.643955 24140 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.645557 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.603446 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:41.646661 24243 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.613255 25359 consensus_queue.cc:1059] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:17:41.617369 25546 consensus_meta.cc:287] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.613s	user 0.013s	sys 0.006s
I20260709 12:17:41.648139 25546 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:41.649230 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:41.650416 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.650631 25546 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:41.635001 25664 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:41.635438 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800382160 after lost signal to thread 24839
I20260709 12:17:41.636394 25594 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:41.637588 24244 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:41.637415 25669 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:41.607029 25666 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.644073 24249 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:41.629295 24214 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:41.628676 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 855) took 1339 ms. Trace:
I20260709 12:17:41.631369 25470 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.651773 25671 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:41.652410 24175 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:41.653548 25625 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:41.627007 24141 leader_election.cc:403] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:41.636417 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.677876 25672 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:41.679569 24245 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:41.695243 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1322) took 2444 ms. Trace:
W20260709 12:17:41.695221 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 66014.6us
I20260709 12:17:41.699045 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:41.702121 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:41.685505 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08003820c0 after lost signal to thread 24840
I20260709 12:17:41.705189 24247 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:17:41.706470 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 85236.5us
I20260709 12:17:41.707600 24249 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:41.701678 24099 rpcz_store.cc:276] 0709 12:17:39.244588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.109268 (+1864680us) service_pool.cc:224] Handling call
0709 12:17:41.238543 (+129275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.254327 (+ 15784us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:41.391861 (+137534us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.688484 (+296623us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:41.688660 (+   176us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:41.688766 (+   106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.688915 (+   149us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.689171 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":36193,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":12023,"thread_start_us":372526,"threads_started":2}
I20260709 12:17:41.713243 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 115) took 4267 ms. Trace:
I20260709 12:17:41.713617 24175 rpcz_store.cc:276] 0709 12:17:37.446202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.940146 (+3493944us) service_pool.cc:224] Handling call
0709 12:17:40.978455 (+ 38309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:41.697012 (+718557us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.713033 (+ 16021us) spinlock_profiling.cc:243] Waited 674 ms on lock 0x7b54003ea8d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:41.713176 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1549413120}
W20260709 12:17:41.710881 24067 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.504s (SENT)
W20260709 12:17:41.716144 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 114360us
W20260709 12:17:41.709084 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800381fe0 after lost signal to thread 25331
I20260709 12:17:41.717934 24780 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:41.719240 25661 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:17:41.731208 25661 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:41.731585 25661 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:41.732611 25661 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.734026 25661 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.718662 25668 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:41.720392 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.711319 25594 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:41.735245 25668 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:41.735391 25594 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:41.736565 25668 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:41.726255 24067 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.508s (SENT)
W20260709 12:17:41.737655 24779 leader_election.cc:336] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 2.329s (SENT)
I20260709 12:17:41.737845 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.738266 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:41.711146 25354 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:41.730321 25470 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.691483 24167 rpcz_store.cc:276] 0709 12:17:40.277310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.696406 (+419096us) service_pool.cc:224] Handling call
0709 12:17:41.616602 (+920196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:41.736516 25594 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:41.722631 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 135691us
W20260709 12:17:41.729348 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800381f60 after lost signal to thread 25354
W20260709 12:17:41.749982 24067 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.773s (SENT)
I20260709 12:17:41.753127 25354 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:41.753365 25362 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:41.757611 25362 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:41.758013 25362 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:41.746938 25669 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:41.759202 25362 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.760704 25362 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:41.761122 24141 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:17:41.761874 24141 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:41.755259 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800382080 after lost signal to thread 25362
W20260709 12:17:41.763901 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800381fc0 after lost signal to thread 25450
W20260709 12:17:41.764367 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08003820a0 after lost signal to thread 25461
W20260709 12:17:41.764780 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800382040 after lost signal to thread 25470
W20260709 12:17:41.765108 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800382140 after lost signal to thread 25473
W20260709 12:17:41.765451 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800382000 after lost signal to thread 25495
W20260709 12:17:41.765743 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800381fa0 after lost signal to thread 25504
W20260709 12:17:41.766080 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800381f00 after lost signal to thread 25536
W20260709 12:17:41.766413 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800381ee0 after lost signal to thread 25546
W20260709 12:17:41.766705 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800381ec0 after lost signal to thread 25554
I20260709 12:17:41.768496 25664 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.768648 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.769863 25671 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:41.770678 25671 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:41.770963 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.771935 25354 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:41.772970 24141 leader_election.cc:336] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:17:41.773586 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.743564 25356 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:41.741191 25672 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.769017 25664 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:41.789446 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.789933 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.789631 25631 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:41.790333 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.778133 25671 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:41.778416 25594 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.791050 25631 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.779453 24243 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:41.782691 25621 raft_consensus.cc:3055] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:41.795261 25621 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:41.795475 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 54946.8us
W20260709 12:17:41.796308 24067 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.803s (SENT)
W20260709 12:17:41.797518 24067 leader_election.cc:336] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.869s (SENT)
I20260709 12:17:41.796343 25621 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.782776 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:41.799109 24094 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:41.775681 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800381ea0 after lost signal to thread 25556
I20260709 12:17:41.783753 25473 raft_consensus.cc:3055] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:41.784289 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:41.785955 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:41.728847 25666 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:41.791217 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:41.808277 24099 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:41.810608 24067 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.931s (SENT)
W20260709 12:17:41.821233 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44579.9us
I20260709 12:17:41.826948 25689 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:41.827508 25689 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.827873 25689 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:41.831887 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 113975us
I20260709 12:17:41.832301 24066 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:41.816219 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800381e80 after lost signal to thread 25564
W20260709 12:17:41.838759 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.807003 25473 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 1 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:17:41.845908 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.846434 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.848706 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 195086us
I20260709 12:17:41.832492 25621 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.833472 25671 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:41.848594 24836 debug-util.cc:398] Leaking SignalData structure 0x7b080010ce40 after lost signal to thread 25582
I20260709 12:17:41.854152 24168 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:41.854493 25685 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:41.862730 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:41.834682 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 94703.7us
W20260709 12:17:41.864096 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53562.5us
I20260709 12:17:41.851394 25666 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:41.868131 25356 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:41.876165 24141 leader_election.cc:400] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:41.879755 24141 leader_election.cc:403] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:41.869184 25473 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.875669 24096 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:41.863111 24836 debug-util.cc:398] Leaking SignalData structure 0x7b0800388c40 after lost signal to thread 25583
I20260709 12:17:41.850327 25671 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:41.887266 24094 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
W20260709 12:17:41.888818 24067 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.931s (SENT)
I20260709 12:17:41.896219 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.878968 25666 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.897090 25666 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.898856 25470 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:41.894767 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1292) took 4969 ms. Trace:
I20260709 12:17:41.900902 24170 rpcz_store.cc:276] 0709 12:17:36.926004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.871560 (+3945556us) service_pool.cc:224] Handling call
0709 12:17:40.922750 (+ 51190us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:41.254640 (+331890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:41.254672 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:41.294470 (+ 39798us) log.cc:844] Serialized 26 byte log entry
0709 12:17:41.438610 (+144140us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:41.488431 (+ 49821us) log.cc:844] Serialized 14 byte log entry
0709 12:17:41.570597 (+ 82166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:41.570692 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:41.646497 (+ 75805us) spinlock_profiling.cc:243] Waited 5.98 ms on lock 0x7b4800111e58. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0a4a4aa1 00007f4c0a49bb37 00007f4c0a49b9ca 00007f4c0a59326f 00007f4c0a592f37 00007f4c0a5a755c 00007f4c0a5a7508 00007f4c0a5a7488 00007f4c0a5a7443 00007f4c0a5a66ec 00007f4c094d0a96
0709 12:17:41.651831 (+  5334us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b180036b7a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:17:41.892669 (+240838us) spinlock_profiling.cc:243] Waited 9.62 ms on lock 0x7b180036b7a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:17:41.894530 (+  1861us) raft_consensus.cc:1685] finished
0709 12:17:41.894554 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:41.894692 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81830,"prepare.queue_time_us":49058,"prepare.run_cpu_time_us":156,"prepare.run_wall_time_us":5562,"raft.queue_time_us":675413,"raft.run_cpu_time_us":3077,"raft.run_wall_time_us":67280,"spinlock_wait_cycles":48877184,"thread_start_us":423577,"threads_started":2,"wal-append.queue_time_us":184087}
W20260709 12:17:41.906003 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 55256.4us
I20260709 12:17:41.907481 24214 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:41.908988 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 94354.4us
W20260709 12:17:41.909582 24067 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.955s (SENT)
I20260709 12:17:41.910101 24067 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.912236 25473 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:41.912982 25680 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:41.913758 25680 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:41.909595 25625 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.911978 25684 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:41.904901 25671 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.920951 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:41.922199 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:41.923128 25546 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:41.923362 25679 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:41.923207 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.923774 25546 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:41.923900 25679 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:41.924418 25679 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.924906 25546 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:41.925720 25678 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:41.928268 25686 consensus_queue.cc:1059] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:41.928404 25554 consensus_queue.cc:1059] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:41.929173 25609 raft_consensus.cc:3055] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:41.929236 24140 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.929670 25609 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:41.931120 24066 leader_election.cc:400] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4.
I20260709 12:17:41.931465 24066 leader_election.cc:403] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:17:41.931388 25675 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:41.933154 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:17:41.923195 24141 leader_election.cc:336] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Remote error: Timed out: Call waited in the queue past client deadline
W20260709 12:17:41.933660 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:41.934336 24099 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
W20260709 12:17:41.939575 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 96591.1us
I20260709 12:17:41.938501 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:41.938627 24214 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:41.929621 25554 raft_consensus.cc:3055] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:41.949826 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:41.935274 25470 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:41.938917 25675 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:41.932865 25669 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:17:41.961304 25699 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:41.938442 25684 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4.
I20260709 12:17:41.930609 25609 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:41.950060 25668 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:41.953847 25641 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:41.952878 25554 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:41.959904 25675 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:41.965469 25495 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:41.966423 25470 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:41.982164 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:41.983958 25680 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:41.985148 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:41.986574 25651 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:41.988548 25651 consensus_queue.cc:1059] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:17:41.978843 25675 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:41.989372 25651 raft_consensus.cc:3055] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:41.989710 25678 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:41.990180 25678 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:41.990244 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:41.991246 25678 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:41.992640 25678 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.972344 25641 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:41.986506 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:41.981484 25495 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.002097 25556 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:42.002395 25495 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:41.974059 25689 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.007356 25609 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.008001 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.008898 24170 raft_consensus.cc:2393] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.008912 25689 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:41.976982 25668 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:42.016526 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.016944 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:42.017225 24169 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:42.002092 25470 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.027995 25664 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.030331 25664 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:42.016893 25554 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.032214 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.032482 25554 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.033061 24172 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:42.033951 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:41.989753 25651 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:42.035815 25651 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.036887 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.037202 25651 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.037904 24170 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.037674 25666 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.041394 25625 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:42.042224 24175 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:42.043462 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.044224 24169 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:42.046234 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.047078 25668 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.047720 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.048444 24176 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:42.030733 25672 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:42.000583 25641 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.052618 25679 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:42.055553 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.015118 24167 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:42.059863 24141 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Remote error: Timed out: Call waited in the queue past client deadline
I20260709 12:17:42.060386 24141 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.061787 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.062851 25673 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:42.063701 23998 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 206) took 1733 ms. Trace:
I20260709 12:17:42.042224 25671 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.077299 25671 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:42.064724 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.063586 25673 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:42.079612 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.080418 25673 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:42.081194 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.081853 24169 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.082044 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.083001 25673 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:42.084161 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.085114 24171 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.085166 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:42.073109 24167 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:42.086315 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.058854 25675 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.087471 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.069943 25495 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.062026 23997 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:42.078385 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:42.089464 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 145140us
I20260709 12:17:42.073522 23998 rpcz_store.cc:276] 0709 12:17:40.330455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:40.331096 (+   641us) service_pool.cc:224] Handling call
0709 12:17:42.063603 (+1732507us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:41.416935 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:41.427858 (+ 10923us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:41.427919 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:17:41.427943 (+    24us) tablet.cc:662] Decoding operations
0709 12:17:41.444104 (+ 16161us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:41.444222 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:41.444270 (+    48us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:17:41.445159 (+   889us) tablet.cc:701] Row locks acquired
0709 12:17:41.445243 (+    84us) write_op.cc:260] PREPARE: finished
0709 12:17:41.445481 (+   238us) write_op.cc:270] Start()
0709 12:17:41.445670 (+   189us) write_op.cc:276] Timestamp: P: 1783599461445413 usec, L: 0
0709 12:17:41.445714 (+    44us) op_driver.cc:348] REPLICATION: starting
0709 12:17:41.529223 (+ 83509us) log.cc:844] Serialized 2840 byte log entry
0709 12:17:41.852559 (+323336us) op_driver.cc:464] REPLICATION: finished
0709 12:17:41.980400 (+127841us) write_op.cc:301] APPLY: starting
0709 12:17:41.980516 (+   116us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:41.980796 (+   280us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:41.999409 (+ 18613us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:42.002604 (+  3195us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:42.002920 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:17:42.003010 (+    90us) write_op.cc:312] APPLY: finished
0709 12:17:42.003408 (+   398us) log.cc:844] Serialized 58 byte log entry
0709 12:17:42.005862 (+  2454us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:42.006019 (+   157us) write_op.cc:454] Released schema lock
0709 12:17:42.006073 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:42.006491 (+   418us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:42.006526 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":115678,"apply.run_cpu_time_us":4030,"apply.run_wall_time_us":26080,"num_ops":7,"prepare.queue_time_us":120891,"prepare.run_cpu_time_us":29580,"prepare.run_wall_time_us":330463,"raft.queue_time_us":85373,"raft.run_cpu_time_us":7568,"raft.run_wall_time_us":126109,"replication_time_us":396406,"thread_start_us":304696,"threads_started":4,"wal-append.queue_time_us":173223}]]}
I20260709 12:17:42.090839 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.100001 24176 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:42.106582 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 146369us
I20260709 12:17:42.107599 24173 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.114162 24169 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:42.116807 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.117931 24174 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:42.074447 25672 raft_consensus.cc:2764] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:42.119280 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.142516 24170 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:42.119436 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.143584 24172 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.145973 24167 raft_consensus.cc:2410] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:42.119462 24168 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:42.121421 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.122030 24171 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:42.122123 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.152904 25495 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:42.135906 24066 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:42.156282 25680 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:42.156842 25680 raft_consensus.cc:697] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:42.157349 24066 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:42.158697 25594 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:42.160439 24172 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:42.160584 25594 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:42.162143 25641 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.116142 25673 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:42.163838 25673 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.137627 24781 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:42.164260 25673 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.166898 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.167836 24243 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.168354 25675 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:42.170146 25679 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:42.163637 25701 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:42.171100 25609 consensus_queue.cc:1059] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:42.171573 25701 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:42.172952 25701 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.173399 23997 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 2 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:17:42.176961 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.140491 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.177912 24248 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:42.179607 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:42.181052 24141 leader_election.cc:400] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:42.141242 25651 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:42.182111 25651 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:42.182812 25651 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:42.183241 25651 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:42.183024 25687 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:42.183663 25651 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.184325 25687 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:42.184736 25687 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:42.185657 25687 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.135896 24176 raft_consensus.cc:1240] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:42.177191 25666 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:42.189369 24141 leader_election.cc:403] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:42.196141 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.196341 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.199715 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:17:42.202888 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 65359.4us
I20260709 12:17:42.196938 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.246553 24170 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:42.188671 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.246687 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:42.256911 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.262225 24175 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:42.264135 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.265035 24175 raft_consensus.cc:2376] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3. Re-sending same reply.
I20260709 12:17:42.205466 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.201989 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.266922 24174 raft_consensus.cc:2376] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3. Re-sending same reply.
I20260709 12:17:42.204452 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.268362 24176 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.270634 24172 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:42.271521 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 90605.1us
I20260709 12:17:42.189384 24811 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:42.280646 24168 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.283535 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.284459 24249 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:42.284508 24169 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:42.187404 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:42.212064 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:42.287591 25703 consensus_queue.cc:1059] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:42.288457 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.289322 24250 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:42.290270 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.203091 25697 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:42.288259 24808 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:42.224813 24244 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:42.196703 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.295531 24174 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
W20260709 12:17:42.308362 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.291667 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.292891 24094 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:42.186961 25687 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.212463 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.294437 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.311501 24172 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.202579 25609 raft_consensus.cc:3055] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:42.192215 25699 consensus_queue.cc:1059] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:17:42.157857 25680 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.298435 25641 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:42.279420 25679 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 2. Current term is 3.
I20260709 12:17:42.328332 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.329255 24249 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.299305 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.291311 24170 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:42.308362 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.202718 25664 consensus_queue.cc:1059] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260709 12:17:42.310585 24175 raft_consensus.cc:2410] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 3.
I20260709 12:17:42.199719 25651 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.305060 25697 raft_consensus.cc:697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:17:42.320127 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:42.347586 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.319355 24066 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:42.324477 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:42.349684 24094 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:42.331331 24250 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.333041 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.333518 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:42.337512 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.351668 24099 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:42.343268 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:42.352303 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.351778 24169 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:42.352802 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.338179 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:42.358134 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.359066 24175 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.313882 25609 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:42.373863 24174 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.364212 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.377398 24170 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:17:42.378794 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 59565.7us
W20260709 12:17:42.371579 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.311360 25554 consensus_queue.cc:1059] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:17:42.390976 24175 raft_consensus.cc:2410] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:42.321168 24243 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:42.335105 24242 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:42.389506 24176 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:42.396821 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.323342 25356 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
W20260709 12:17:42.396088 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.379225 25669 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:42.401103 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.403975 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.407703 24175 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:42.404452 24169 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:42.411499 24808 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:42.414810 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.415783 24243 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:42.415688 25609 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.417191 25609 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.418147 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.418886 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:42.426687 24216 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.581s (SENT)
I20260709 12:17:42.427393 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:42.445569 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.447683 24175 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.394279 25689 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:17:42.389923 25673 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.451261 24171 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:42.406713 25701 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:42.463050 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 44242us
I20260709 12:17:42.466128 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.471933 24169 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:42.481508 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.487164 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.491976 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.493057 24171 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.499089 24173 raft_consensus.cc:2368] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4.
I20260709 12:17:42.499223 24066 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:42.459945 25413 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:42.459972 25661 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:42.510598 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.514261 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.515481 24171 raft_consensus.cc:2393] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 2: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.489734 25495 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:42.511790 24066 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:42.497210 25666 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:42.504031 25684 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:42.526147 25684 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.526634 25684 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:42.532016 23986 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5d0f174a97494d0cbf08ae81ec4c807a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:42.535504 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:42.538195 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:42.539448 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:42.541128 25717 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:42.541584 25717 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:42.502305 25678 consensus_queue.cc:1059] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:17:42.500798 25621 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:17:42.548853 25594 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:42.549414 25594 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.549791 25594 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.550624 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:42.507638 25554 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:17:42.553583 25554 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:42.553938 25554 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:42.546742 25707 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:17:42.593186 24141 connection.cc:256] RPC call timeout handler was delayed by -3.3559028930001205s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 12:17:42.596519 24141 connection.cc:256] RPC call timeout handler was delayed by -3.2974028930000259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17200000000000001s for a response
I20260709 12:17:42.601670 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.603716 24171 raft_consensus.cc:2376] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3. Re-sending same reply.
I20260709 12:17:42.554231 25554 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.609675 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:42.610323 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:17:42.601992 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 76636.5us
I20260709 12:17:42.460835 25697 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.611549 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:42.619086 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:42.508309 25701 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:17:42.595046 25664 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:42.616938 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.632210 24176 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:42.608852 25706 log.cc:927] Time spent T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.098s	user 0.000s	sys 0.008s
I20260709 12:17:42.542500 25717 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.634764 24250 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:42.636322 24173 raft_consensus.cc:1240] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:42.639160 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.640010 24168 raft_consensus.cc:2376] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3. Re-sending same reply.
I20260709 12:17:42.640528 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.640938 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.641207 24167 raft_consensus.cc:2376] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3. Re-sending same reply.
I20260709 12:17:42.641758 24168 raft_consensus.cc:2410] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:42.641680 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.642164 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.643134 24167 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:42.643270 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.643896 24246 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.643798 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.644798 24174 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:42.646123 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.654474 24807 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:42.623348 25651 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:42.659276 25673 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:42.642740 24169 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:17:42.667672 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 197519us
I20260709 12:17:42.642712 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:42.626861 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 105304us
I20260709 12:17:42.675921 24066 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:42.679692 24249 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
W20260709 12:17:42.604979 24141 connection.cc:256] RPC call timeout handler was delayed by -3.09130289299992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 12:17:42.683665 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.631454 25664 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:42.684070 25701 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:17:42.686707 24100 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:42.623786 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:42.687510 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.635181 25669 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:17:42.691458 24172 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:42.694343 24174 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:42.694919 24216 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.654s (SENT)
I20260709 12:17:42.700248 24173 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:42.708128 24141 connection.cc:256] RPC call timeout handler was delayed by -2.9887028929999815s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20630000000000004s for a response
I20260709 12:17:42.708760 24171 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:42.708907 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:42.754086 24141 connection.cc:256] RPC call timeout handler was delayed by -2.977902892999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
I20260709 12:17:42.710592 24169 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:42.754606 24141 connection.cc:256] RPC call timeout handler was delayed by -2.8816028930000357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2182s for a response
W20260709 12:17:42.754904 24141 connection.cc:256] RPC call timeout handler was delayed by -2.8600028930000008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22060000000000002s for a response
W20260709 12:17:42.733150 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:42.755262 24141 connection.cc:256] RPC call timeout handler was delayed by -2.4721028930000557s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2637s for a response
I20260709 12:17:42.703303 25718 consensus_queue.cc:1059] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 12:17:42.759261 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50474.4us
W20260709 12:17:42.761281 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.705612 25684 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:42.731822 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.712808 25495 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:42.712594 24244 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:42.757458 24246 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:42.750809 24176 raft_consensus.cc:2376] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3. Re-sending same reply.
I20260709 12:17:42.763142 24216 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:42.747623 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:42.771541 24096 raft_consensus.cc:2410] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:42.745445 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:42.781183 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 99992.9us
I20260709 12:17:42.752305 24813 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:42.767575 25621 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:42.787266 25621 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:42.787801 25621 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.789988 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:42.790370 25711 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:17:42.790761 24247 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:42.791028 24216 leader_election.cc:336] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.767s (SENT)
I20260709 12:17:42.795086 25683 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:17:42.797286 25661 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:42.797595 24806 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:42.797902 25661 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.800263 25661 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:42.801004 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.806356 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.807964 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.808634 24241 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.812136 25686 raft_consensus.cc:3055] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:42.812309 25684 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:42.812633 25686 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:42.813758 25686 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.820501 24249 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:42.831099 24215 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:42.828341 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:42.835793 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:42.836594 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.775456 25687 raft_consensus.cc:2764] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:17:42.840412 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 68098.5us
I20260709 12:17:42.821875 25686 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.851758 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.856505 24249 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.851679 25661 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:42.860383 25661 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:42.861685 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:42.861497 25661 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.862062 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:42.863504 25594 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.865669 25594 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:42.841470 25717 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.832916 25621 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.870246 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:42.839385 24811 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:42.845856 25684 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:17:42.871371 24093 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:42.779783 25664 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.872009 25684 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:42.872468 25684 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:42.872522 24249 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:42.872975 25664 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:42.873733 25684 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.874605 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.876381 25621 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:42.877351 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.878580 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.878888 24246 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:42.881856 25554 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:42.840111 25683 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:42.892297 24247 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:42.897472 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:42.856439 25718 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:42.902323 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.903559 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:42.852938 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 244582us
I20260709 12:17:42.904393 24096 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
W20260709 12:17:42.907797 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.917682 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:42.911304 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.918635 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.914250 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:42.921169 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:42.921953 24098 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:42.903990 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.915442 24247 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:42.929492 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:42.933929 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.934722 24247 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.924141 25495 raft_consensus.cc:697] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:42.915334 25684 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.918741 24096 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:42.947727 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.954514 24172 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:42.948109 24174 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:42.955520 24247 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:42.949580 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.949780 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:42.952606 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 65796.7us
I20260709 12:17:42.952780 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.948853 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.958235 24098 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:42.958890 24170 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:17:42.959021 24173 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.959311 24170 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:42.954423 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.959664 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:42.928809 25718 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:42.962322 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.960400 24098 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:42.958231 24168 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:42.963413 24249 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:42.963315 24096 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:42.964033 24100 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:42.966599 24247 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:42.960734 24807 raft_consensus.cc:2393] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:42.901695 25683 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.972560 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:42.933058 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:42.974762 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.975832 24247 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:42.974911 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.976027 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.953327 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:42.976814 24172 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:42.970892 24170 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:42.979362 24093 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:42.979305 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.980131 24174 raft_consensus.cc:2376] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:42.981133 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.981854 24174 raft_consensus.cc:2368] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4.
I20260709 12:17:42.982131 25683 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:42.983412 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.983511 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:42.984198 24173 raft_consensus.cc:2376] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:42.984494 24246 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:42.985247 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.985970 24173 raft_consensus.cc:2368] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3.
I20260709 12:17:42.985922 24246 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:42.967242 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:42.988623 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:42.992097 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.993558 24173 raft_consensus.cc:2376] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:42.982630 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.994654 24174 raft_consensus.cc:2376] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3. Re-sending same reply.
I20260709 12:17:42.992851 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:42.995187 24098 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:42.995834 24167 raft_consensus.cc:2376] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:42.996784 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:42.997568 24172 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:42.998055 24247 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:42.961373 25504 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:42.966951 25609 consensus_meta.cc:287] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.549s	user 0.009s	sys 0.005s
I20260709 12:17:43.000187 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:43.003351 24249 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:43.003959 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.004583 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.005046 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.005051 24168 raft_consensus.cc:2376] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3. Re-sending same reply.
I20260709 12:17:43.006198 24172 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:43.007141 24808 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:43.006927 25504 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.009369 25504 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:43.015410 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.015692 24174 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
W20260709 12:17:43.018829 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 49315.6us
I20260709 12:17:43.002259 24092 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:43.025542 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.028906 24174 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:43.033180 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.034003 24174 raft_consensus.cc:2376] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
W20260709 12:17:43.035749 25726 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
W20260709 12:17:43.047473 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.051522 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.052399 24172 raft_consensus.cc:2376] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:43.040908 25473 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.054087 25473 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.056396 25473 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:43.057547 25554 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:43.018090 25718 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.063620 24141 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:43.042781 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.068475 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.068961 24098 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:43.069216 24173 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:43.071110 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.071131 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.072269 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.073060 24168 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:43.073375 24172 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:17:43.073732 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.035988 25495 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.071715 24167 raft_consensus.cc:2376] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3. Re-sending same reply.
I20260709 12:17:43.084053 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.093856 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:43.098698 25722 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.624s	user 0.000s	sys 0.006s
I20260709 12:17:43.082670 25685 raft_consensus.cc:3055] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:43.110358 24175 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:43.117013 24101 raft_consensus.cc:2393] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:43.114928 24173 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:43.067291 24241 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:43.120424 24094 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:43.123088 24246 raft_consensus.cc:1240] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:43.126377 24172 raft_consensus.cc:1240] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:43.127799 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.110927 25694 raft_consensus.cc:3055] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:43.110265 25504 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.116871 25685 raft_consensus.cc:740] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:17:43.148756 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 86048us
I20260709 12:17:43.151885 24094 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:43.154078 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:43.145179 25714 log.cc:927] Time spent T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.601s	user 0.004s	sys 0.000s
I20260709 12:17:43.155771 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:43.159628 24095 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:43.144395 25710 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.666s	user 0.003s	sys 0.003s
W20260709 12:17:42.884981 25678 consensus_queue.cc:1175] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:43.163407 24094 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:43.134896 24167 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.133630 25694 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:43.176607 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.177287 24167 raft_consensus.cc:2376] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3. Re-sending same reply.
I20260709 12:17:43.178269 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.131816 25689 consensus_queue.cc:1059] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:17:43.173403 24810 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:43.175664 24092 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:43.158576 25504 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.192631 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.135494 25685 consensus_queue.cc:260] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.188555 24167 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:43.214974 24246 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:43.189538 25470 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:17:43.188850 25661 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:17:43.189225 25473 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:17:43.190891 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:43.220120 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 949) took 1034 ms. Trace:
I20260709 12:17:43.199728 25742 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:43.230157 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:43.220754 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 70873.5us
I20260709 12:17:43.222433 24248 rpcz_store.cc:276] 0709 12:17:42.185679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.185933 (+   254us) service_pool.cc:224] Handling call
0709 12:17:42.186434 (+   501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:42.186970 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:42.187048 (+    78us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:42.187783 (+   735us) log.cc:844] Serialized 26 byte log entry
0709 12:17:42.363581 (+175798us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:42.363643 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:42.363749 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:43.143580 (+779831us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:43.217356 (+ 73776us) raft_consensus.cc:1685] finished
0709 12:17:43.217380 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:43.220037 (+  2657us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1257,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":120,"spinlock_wait_cycles":13325440,"thread_start_us":175284,"threads_started":1,"wal-append.queue_time_us":269727}
I20260709 12:17:43.233340 24141 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:43.236492 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:43.220667 25685 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:43.253376 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:43.255681 25743 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 12:17:43.270160 25744 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.095s	user 0.002s	sys 0.000s
I20260709 12:17:43.273344 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:43.298173 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61793.3us
I20260709 12:17:43.312779 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:43.245484 24093 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
W20260709 12:17:43.313685 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 80465.4us
I20260709 12:17:43.283640 25687 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:43.299587 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.321928 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.322913 24169 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:43.323863 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.324580 24169 raft_consensus.cc:2368] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4.
W20260709 12:17:43.325527 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.323009 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:43.319597 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:43.317835 25748 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:43.307921 25742 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:17:43.327553 25747 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:43.329504 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.312526 25751 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:43.331765 25749 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:43.345465 24249 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.346038 24169 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:43.346607 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.347438 24174 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
W20260709 12:17:43.346899 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:43.350306 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.348860 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.353324 24174 raft_consensus.cc:2393] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:43.349876 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.354445 24169 raft_consensus.cc:2376] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3. Re-sending same reply.
I20260709 12:17:43.357254 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.358846 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.359584 24174 raft_consensus.cc:2376] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2. Re-sending same reply.
I20260709 12:17:43.360652 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.362382 25757 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:43.363397 25757 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.364059 25757 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.364271 25735 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:43.366735 25742 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:43.367370 25742 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:43.368316 25504 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:43.368441 25742 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.370220 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:43.330719 24167 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:43.371321 25747 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:43.371959 25680 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:43.371896 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.372282 25748 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:43.372668 25680 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:43.372982 24167 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:43.373525 25748 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.374092 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.373839 25680 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.371282 24066 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:43.364326 25694 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.379767 24067 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.381886 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.382591 24169 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:17:43.372007 25747 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:43.384497 25749 consensus_queue.cc:1243] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Peer 729aa4b1ccec48b588c14e67652c61e1 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:43.385227 24807 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:17:43.385433 25747 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.387485 25669 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:43.388150 25669 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:43.389130 25669 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.391759 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.392623 24176 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:17:43.393772 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.395737 25554 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.396106 24171 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.396342 25554 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.397492 24171 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.399714 25554 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:43.408245 24168 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260709 12:17:43.408696 24168 pending_rounds.cc:85] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 1
I20260709 12:17:43.408980 24168 pending_rounds.cc:107] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:43.409235 24168 raft_consensus.cc:2889] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:43.413307 25757 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:43.413599 24170 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:43.387396 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:43.417311 24808 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:43.417446 25666 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:43.417937 25666 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:43.419148 24215 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:43.418848 25666 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.420149 25727 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:43.420207 24067 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.420717 25727 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:43.421180 25727 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:43.421648 25495 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:43.422142 24067 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.393823 24176 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:43.425956 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.426680 24173 raft_consensus.cc:2410] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:43.398831 24171 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.410856 24168 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:43.429494 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50122.5us
I20260709 12:17:43.430297 24066 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:43.431463 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:43.428593 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 202923us
W20260709 12:17:43.439596 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.442305 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:43.429981 24167 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:43.446561 24812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 246) took 1258 ms. Trace:
I20260709 12:17:43.447170 24812 rpcz_store.cc:276] 0709 12:17:42.182146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:42.199413 (+ 17267us) service_pool.cc:224] Handling call
0709 12:17:43.429079 (+1229666us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b540070f654. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:43.440152 (+ 11073us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187474304}
I20260709 12:17:43.450953 24170 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:43.450412 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:43.463729 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:43.466306 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 146776us
I20260709 12:17:43.467267 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:43.441573 25504 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:43.449348 25735 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:43.469601 24214 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:43.470815 24169 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:43.429275 25684 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.451411 25736 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:43.464895 25683 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:43.490549 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 167631us
I20260709 12:17:43.478390 25504 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.479136 25661 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:43.496361 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:43.496050 25504 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:43.481782 25651 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:43.489010 25735 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:43.493435 25683 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.510419 24169 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:43.508225 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 78019.5us
I20260709 12:17:43.516145 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.498973 25661 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.523368 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:43.524187 24097 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:43.494531 24170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "c090031f610346ed82285cd847bca6d6"
 from {username='slave'} at 127.0.0.1:51222
I20260709 12:17:43.527130 24170 raft_consensus.cc:606] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Received request to transfer leadership to TS c090031f610346ed82285cd847bca6d6
I20260709 12:17:43.527696 24170 raft_consensus.cc:614] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:43.510315 25735 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:43.492219 25684 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.533129 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:43.516592 25683 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:43.540141 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:43.541070 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 118986us
I20260709 12:17:43.518600 25473 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.516371 25651 raft_consensus.cc:697] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:43.515619 25762 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:43.529454 25661 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:43.550665 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.555591 23998 catalog_manager.cc:5697] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:17:43.580446 23998 catalog_manager.cc:5697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:17:43.579332 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.567274 25694 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:43.514721 25757 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:17:43.582267 23998 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:17:43.590842 23998 catalog_manager.cc:5697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 3, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 3 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:43.577098 25762 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.520581 25664 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:17:43.588044 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.576578 25473 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:43.586104 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 53062us
I20260709 12:17:43.580109 25742 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:43.607085 23998 catalog_manager.cc:5697] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:17:43.580515 24808 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:17:43.611413 23998 catalog_manager.cc:5697] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 2, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 2 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:17:43.565595 25413 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:17:43.597472 25750 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:43.588234 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45296.9us
I20260709 12:17:43.616909 24067 leader_election.cc:400] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4.
I20260709 12:17:43.617198 24067 leader_election.cc:403] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
W20260709 12:17:43.601668 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 61624.1us
I20260709 12:17:43.577127 25495 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:43.578111 25756 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:17:43.662892 25756 raft_consensus.cc:3055] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:43.663321 25756 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:17:43.622570 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.591073 25760 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:43.604678 23997 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 189) took 8319 ms. Trace:
I20260709 12:17:43.607167 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:43.609534 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.617842 25748 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.693817 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.694660 24175 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:43.696030 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.697798 24173 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:43.698935 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:43.699380 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.699771 24167 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:43.700098 24172 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:43.590351 25759 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:43.700730 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.701086 25759 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:43.701974 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:43.702612 24171 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:43.702186 25759 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.703580 24097 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
W20260709 12:17:43.604756 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 91596.4us
W20260709 12:17:43.628664 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.618592 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.600445 25762 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:43.660977 25651 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.662046 25771 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:43.613790 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:43.717319 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 98811.1us
I20260709 12:17:43.718761 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.713636 24175 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
W20260709 12:17:43.737370 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 120608us
I20260709 12:17:43.653997 25750 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.743525 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:43.762396 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.768625 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.745275 25760 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:43.748327 25742 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:43.724311 25495 raft_consensus.cc:697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:43.763571 25755 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:43.711025 25748 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.783775 24140 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:43.763865 25673 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:43.804957 24067 leader_election.cc:400] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3.
I20260709 12:17:43.811874 24067 leader_election.cc:403] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:17:43.719334 25767 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4.
I20260709 12:17:43.817958 25757 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:43.818523 25757 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:43.819049 25757 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:43.819828 25748 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:43.820267 25666 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:43.691818 23997 rpcz_store.cc:276] 0709 12:17:35.285546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:35.301533 (+ 15987us) service_pool.cc:224] Handling call
0709 12:17:43.604478 (+8302945us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:42.224876 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:42.225716 (+   840us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:42.225769 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:17:42.225795 (+    26us) tablet.cc:662] Decoding operations
0709 12:17:42.226358 (+   563us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:42.226448 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:42.226500 (+    52us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:42.226934 (+   434us) tablet.cc:701] Row locks acquired
0709 12:17:42.226957 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:17:42.237306 (+ 10349us) write_op.cc:270] Start()
0709 12:17:42.279169 (+ 41863us) write_op.cc:276] Timestamp: P: 1783599462233114 usec, L: 0
0709 12:17:42.279220 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 12:17:42.337391 (+ 58171us) log.cc:844] Serialized 928 byte log entry
0709 12:17:42.811488 (+474097us) spinlock_profiling.cc:243] Waited 3.37 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c05576e28 00007f4c08fb1581 00007f4c08fb0d58 00007f4c08fb59f1 00007f4c08fb59a9 00007f4c08fb5939 00007f4c08fb5901 00007f4c08fb4b2d 0000000000388634 0000000000388479
0709 12:17:42.858889 (+ 47401us) op_driver.cc:464] REPLICATION: finished
0709 12:17:43.069613 (+210724us) write_op.cc:301] APPLY: starting
0709 12:17:43.071884 (+  2271us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:43.103868 (+ 31984us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:43.103893 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:43.130621 (+ 26728us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:43.133374 (+  2753us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:43.133437 (+    63us) write_op.cc:312] APPLY: finished
0709 12:17:43.134614 (+  1177us) log.cc:844] Serialized 28 byte log entry
0709 12:17:43.134804 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:43.134923 (+   119us) write_op.cc:454] Released schema lock
0709 12:17:43.135006 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:43.135427 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:43.135461 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":138,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":173710,"apply.run_cpu_time_us":4360,"apply.run_wall_time_us":68757,"num_ops":2,"prepare.queue_time_us":157,"prepare.run_cpu_time_us":11904,"prepare.run_wall_time_us":586845,"replication_time_us":546497,"spinlock_wait_cycles":7757184,"thread_start_us":108808,"threads_started":1}]]}
I20260709 12:17:43.821465 25761 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.822041 25761 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.822487 25669 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3.
I20260709 12:17:43.824499 25756 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.826089 25756 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:43.827875 25755 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.828810 25755 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.832918 25609 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.833776 25609 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:43.834822 25673 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:43.835678 25755 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:43.841722 25683 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.843530 25772 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:43.736826 25771 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:43.850170 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:43.852245 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.836346 25673 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.781965 25751 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:43.878999 24141 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:43.878535 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:43.818557 25768 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:17:43.807384 25684 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:43.880349 24099 raft_consensus.cc:2410] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:43.880949 24141 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:43.866540 25685 consensus_meta.cc:287] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.010s
I20260709 12:17:43.857301 25771 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:43.900868 24141 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:43.897212 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 465132us
I20260709 12:17:43.904479 24812 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:43.884361 25748 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:43.908566 24216 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.928s (SENT)
I20260709 12:17:43.913061 25727 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.885234 25742 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:43.890911 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:43.960031 24216 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.080s (SENT)
I20260709 12:17:43.968923 24101 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:43.906358 25751 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:43.919509 25760 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:43.973068 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45390.1us
W20260709 12:17:43.984225 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.962234 25755 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:43.992925 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 85350.9us
I20260709 12:17:43.929540 25742 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.994917 24808 raft_consensus.cc:2410] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:17:44.008476 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 225245us
I20260709 12:17:43.995718 25773 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.231s
W20260709 12:17:44.013664 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.028399 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:44.040007 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:43.992456 25750 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:44.049991 24101 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:17:44.049996 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.050712 24101 pending_rounds.cc:85] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 4
I20260709 12:17:44.051113 24101 pending_rounds.cc:107] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:17:44.051432 24101 raft_consensus.cc:2889] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:44.055151 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:17:44.058616 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:44.061089 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 56291.3us
I20260709 12:17:44.061930 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:44.070554 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.071838 24099 raft_consensus.cc:2410] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:44.042541 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.013860 25755 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:43.991302 25495 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.030050 25736 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
W20260709 12:17:44.161399 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 380035us
I20260709 12:17:44.164163 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.108067 24096 raft_consensus.cc:2410] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:44.041112 25661 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.111375 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:44.170387 24245 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 1.
I20260709 12:17:44.114207 24246 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:44.117497 24241 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:44.119256 25780 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:17:44.103340 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 48354.9us
I20260709 12:17:44.069967 25609 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:44.168004 23986 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5d0f174a97494d0cbf08ae81ec4c807a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:17:44.128613 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:44.166599 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 45945.1us
I20260709 12:17:44.079922 25777 consensus_queue.cc:1059] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.090s
I20260709 12:17:44.197744 24066 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:44.163192 25673 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:44.089540 25750 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:17:44.204800 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:44.181598 25767 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:44.165556 24093 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:44.204797 25666 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:44.216867 25787 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:17:44.220346 25742 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:44.221542 25788 log.cc:927] Time spent T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:17:44.222533 25781 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:17:44.223359 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.228922 25727 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.229404 25470 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.231590 25413 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.232442 25755 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.210004 25790 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:44.237080 25751 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:44.237880 24241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
W20260709 12:17:44.238209 25735 consensus_meta.cc:287] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.002s
I20260709 12:17:44.199105 25760 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.199522 25747 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:44.223667 25785 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260709 12:17:44.255822 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 43535.3us
I20260709 12:17:44.241459 25666 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.205159 25609 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:17:44.244079 25664 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.214128 25673 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.291755 24245 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:44.299440 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 94835.2us
W20260709 12:17:44.302569 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.303676 25736 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:44.307533 24067 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.312610 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.319960 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:44.320911 24101 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.284042 24241 raft_consensus.cc:606] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:44.282047 25803 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:44.284448 25666 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.339704 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.340493 24099 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:44.323297 24094 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:44.344285 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:44.345155 24094 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.299635 25747 raft_consensus.cc:697] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:44.280009 25751 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.354252 24812 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:44.347384 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.355620 24098 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:44.323155 25504 consensus_meta.cc:287] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.815s	user 0.013s	sys 0.004s
I20260709 12:17:44.359598 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:44.333321 24241 raft_consensus.cc:614] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:44.337884 25594 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:44.296555 25664 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.285208 25735 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.348033 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:44.358098 25789 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 12:17:44.289966 25760 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.374758 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:44.357910 25803 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:44.385504 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:44.378378 25694 consensus_meta.cc:287] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.007s
I20260709 12:17:44.368626 25661 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:44.389122 24812 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:44.371824 25594 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:44.373176 25684 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:44.400316 24094 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:44.401616 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.380052 25685 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.374783 25761 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:44.390581 24092 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:44.363922 25504 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.382202 24808 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:44.383929 25473 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:44.388444 25736 raft_consensus.cc:2764] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
W20260709 12:17:44.428125 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.400828 25594 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:44.430646 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.375032 25748 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 12:17:44.424212 25756 consensus_meta.cc:287] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.008s
I20260709 12:17:44.402455 24810 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:17:44.440625 25810 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:17:44.440675 25664 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.441020 25760 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:44.436427 25796 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:17:44.438755 25757 consensus_meta.cc:287] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.619s	user 0.014s	sys 0.000s
I20260709 12:17:44.432945 25704 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:17:44.459419 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.463675 25757 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.470839 25757 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.424762 25747 consensus_queue.cc:237] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:44.471580 25802 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:17:44.478111 25673 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.483531 25756 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:17:44.487466 25762 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.768s	user 0.003s	sys 0.011s
I20260709 12:17:44.488096 25762 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.426846 25685 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.495787 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:44.496647 24807 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.460565 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:44.501888 24067 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.497933 25669 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:44.491896 25704 raft_consensus.cc:697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:44.493873 25504 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:44.521530 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 71674.3us
I20260709 12:17:44.519516 25686 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:44.519253 25684 raft_consensus.cc:2764] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:17:44.526562 25704 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.528862 25685 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.531209 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:44.533797 24101 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:44.537184 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.517037 25748 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.546639 24067 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.548763 25727 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:44.548875 25808 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:17:44.549312 25727 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:44.549789 25727 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:44.550431 25809 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:17:44.552611 25762 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:44.556093 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 212314us
I20260709 12:17:44.507390 25736 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:17:44.559305 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 188738us
I20260709 12:17:44.563608 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:44.564343 24095 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.539593 25669 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:44.565634 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:44.564739 25772 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:44.568837 25735 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.564740 25790 consensus_queue.cc:1059] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:17:44.569152 25772 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.559013 25684 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.572574 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.574939 25751 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.579466 25651 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.580065 25651 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.582472 25651 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.493770 25803 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.586390 24175 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:51222
W20260709 12:17:44.586695 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:44.587086 24175 raft_consensus.cc:606] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:44.587466 24175 raft_consensus.cc:614] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:17:44.587615 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:44.595070 25735 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:44.598532 25594 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.600220 24101 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:44.558089 25748 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.604712 24067 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:44.606755 24067 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.595569 25735 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:44.601030 25777 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:44.615475 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:44.618067 25470 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:44.618552 25470 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.618955 25470 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:44.619447 25748 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.620685 25727 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.607841 25736 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:44.623378 25819 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
I20260709 12:17:44.624362 24813 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:44.616704 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:17:44.626400 25594 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.626462 25790 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:44.625952 24214 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:44.614563 25735 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.637118 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.637111 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:44.630059 25790 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.605588 25666 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.639703 25790 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.622776 25816 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.641505 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:17:44.642022 25666 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.642103 25772 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:44.627583 25791 raft_consensus.cc:3055] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:44.627905 25669 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.643069 25791 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:44.644358 25791 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.645452 25753 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:44.645967 25753 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.646360 25791 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.647056 25782 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:44.647871 25782 raft_consensus.cc:697] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:44.647560 25784 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:44.640964 25816 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.647392 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:44.631894 25736 raft_consensus.cc:2764] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:17:44.669538 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:44.638789 24807 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:44.652694 25594 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:17:44.671468 25751 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:44.672313 25751 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.646370 25753 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.694044 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:44.676679 25686 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.695277 25680 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:44.695713 25686 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.695959 25680 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:44.697396 25680 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:44.698139 25686 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.656785 25666 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:44.662551 25504 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:44.665668 25784 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 12:17:44.649317 25782 consensus_queue.cc:237] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.710518 25684 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:44.727002 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:44.631115 25777 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.715196 25773 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.740362 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:44.717257 25504 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:44.751238 24094 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:44.751801 24096 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:44.725340 25751 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.755390 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.728147 25807 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:44.762543 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.757815 24095 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:44.764628 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:44.766474 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.773636 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:44.774307 24174 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.776643 24097 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:44.753114 25748 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:44.744793 25683 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:44.778738 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 51850.3us
I20260709 12:17:44.779634 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.799469 25504 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.783159 25770 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:44.800701 25770 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:44.801126 25770 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.788362 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:44.803655 24167 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 2.
I20260709 12:17:44.804006 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:44.804644 24176 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.804841 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:44.805490 24167 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.790340 24172 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:44.791047 25822 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:17:44.787708 24173 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:44.797266 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:44.766253 25807 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.815455 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:44.824488 24174 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:44.828116 24095 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:44.837888 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.745218 25773 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.795488 25748 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:44.847282 25784 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.833125 25771 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.825973 25686 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.855454 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:44.860401 24172 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.834663 25651 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.864992 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:44.866819 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:44.844676 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:44.848083 25748 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:44.855394 25609 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:44.876482 25761 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:44.906025 24172 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:44.883821 25686 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.869719 25784 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.894281 25816 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.884903 25735 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.883589 25651 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:44.905728 25683 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:44.926683 25735 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.929026 25651 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:44.932035 25824 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:44.932571 25824 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:44.932992 25824 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:44.934995 24176 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:44.894513 25470 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.902633 25609 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:44.944842 25470 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:44.946595 25686 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:44.965953 25806 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.504s	user 0.006s	sys 0.001s
W20260709 12:17:44.947070 25832 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:17:44.953855 25816 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:44.983919 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 117223us
I20260709 12:17:44.994318 24216 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.003750 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1390) took 1490 ms. Trace:
I20260709 12:17:45.004303 24092 rpcz_store.cc:276] 0709 12:17:43.512924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.514574 (+  1650us) service_pool.cc:224] Handling call
0709 12:17:43.541674 (+ 27100us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:44.425564 (+883890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:45.003369 (+577805us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b5400329454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:45.003632 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1948525440}
I20260709 12:17:44.986590 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:44.986931 25816 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:45.037968 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.018553 25773 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:45.017794 25767 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:45.022048 24811 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:45.010600 25777 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:45.024191 25504 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.063843 25798 raft_consensus.cc:3055] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:45.064334 25798 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:45.066032 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.045531 25609 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:45.019129 25790 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.035977 25784 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:45.046655 25836 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:17:45.068781 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.075320 25801 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:45.035794 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:45.098685 24216 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.082289 25777 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:17:45.104648 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.107542 24173 raft_consensus.cc:2410] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:45.055552 25767 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.112720 25609 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.112936 25767 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:45.097397 25504 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.113878 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.075345 25798 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:45.115916 25848 log.cc:927] Time spent T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.002s
I20260709 12:17:45.100178 25753 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.124595 25750 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:17:45.126379 25753 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:45.114918 25609 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:45.128139 25790 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:45.129462 25816 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:45.129853 25609 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:45.134218 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.119330 25473 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.099143 25801 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.146592 25801 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:45.151795 25829 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.254s	user 0.003s	sys 0.000s
I20260709 12:17:45.122682 25748 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.143992 25770 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.160203 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:45.162899 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.169112 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:45.173090 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:45.171340 25473 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:45.176136 24167 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:45.177105 25753 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.138127 25790 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:45.175477 25504 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:45.183897 24810 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:45.176265 25777 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.200778 24249 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:17:45.187503 23986 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 5d0f174a97494d0cbf08ae81ec4c807a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:45.205360 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.180001 25790 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:45.191457 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:45.209338 24807 raft_consensus.cc:2393] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:17:45.209477 25835 log.cc:927] Time spent T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.346s	user 0.002s	sys 0.000s
I20260709 12:17:45.192802 25727 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:45.193172 25750 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:17:45.195683 25831 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.298s	user 0.003s	sys 0.000s
I20260709 12:17:45.198312 25680 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:45.213198 25680 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.186445 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:45.206946 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:45.207455 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:17:45.218089 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.207875 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:45.208406 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.218938 24176 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:45.220151 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:45.217208 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:45.221652 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.222323 24169 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.222373 24067 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:45.222826 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.224434 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:45.186462 25847 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:17:45.225826 24067 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:45.226673 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.228122 24170 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:45.230425 24170 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:45.230644 24067 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:45.228850 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:45.233503 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:45.229564 24168 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:45.234087 24249 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.235423 25797 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:45.235663 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.236059 25797 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:45.230314 25473 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:17:45.237049 25797 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.239053 25736 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:45.241732 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:45.200345 25504 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:45.227560 25680 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:45.248984 25853 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:17:45.248828 24243 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:45.251672 25685 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:45.260071 25685 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:45.260505 25685 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:45.252168 25803 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:45.253386 25704 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.263029 25704 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:45.264201 25807 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:45.264334 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.226924 25782 raft_consensus.cc:2764] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:17:45.225885 25413 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.265359 25704 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:45.252831 25747 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:45.265720 25413 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:45.232342 25727 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:17:45.239580 25495 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:17:45.267693 24812 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:45.267977 25413 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:45.269183 24168 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:45.229408 25753 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:17:45.270308 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.270908 24171 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.048815 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:45.216292 25790 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.258502 25504 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.220151 25801 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.260406 25736 raft_consensus.cc:697] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:45.257751 23998 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 207) took 1856 ms. Trace:
I20260709 12:17:45.198976 24811 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:45.280095 24249 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:45.220543 25651 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.294435 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.325881 24176 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:45.298019 24169 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:45.226332 25750 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.333731 24249 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:45.335703 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 61747.1us
W20260709 12:17:45.336906 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 106338us
I20260709 12:17:45.336987 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:45.340773 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.293982 25770 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:45.234095 25666 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:45.314617 25842 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 12:17:45.315019 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 90611.7us
I20260709 12:17:45.327968 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.367396 24245 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:45.348884 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:45.368932 24096 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:45.298550 25747 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:17:45.363317 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:45.374811 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 47395.5us
I20260709 12:17:45.367434 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.366169 24171 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:45.326848 25751 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:17:45.304931 24214 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:45.319499 25801 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.306084 25803 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 12:17:45.369844 25824 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.357628 25735 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:45.339459 25756 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:17:45.338883 25651 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:45.409607 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:45.372413 24093 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:45.371356 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:45.373127 25771 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:45.310364 23998 rpcz_store.cc:276] 0709 12:17:43.401425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:43.401554 (+   129us) service_pool.cc:224] Handling call
0709 12:17:45.257677 (+1856123us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:44.035197 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:44.204175 (+168978us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:44.207016 (+  2841us) write_op.cc:435] Acquired schema lock
0709 12:17:44.210678 (+  3662us) tablet.cc:662] Decoding operations
0709 12:17:44.237103 (+ 26425us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:44.237208 (+   105us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:44.237252 (+    44us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:17:44.237851 (+   599us) tablet.cc:701] Row locks acquired
0709 12:17:44.237879 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:17:44.238061 (+   182us) write_op.cc:270] Start()
0709 12:17:44.238204 (+   143us) write_op.cc:276] Timestamp: P: 1783599464238010 usec, L: 0
0709 12:17:44.238241 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:17:44.280310 (+ 42069us) log.cc:844] Serialized 2539 byte log entry
0709 12:17:44.597502 (+317192us) op_driver.cc:464] REPLICATION: finished
0709 12:17:44.745705 (+148203us) write_op.cc:301] APPLY: starting
0709 12:17:44.764453 (+ 18748us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:44.824994 (+ 60541us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:44.844794 (+ 19800us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:44.915612 (+ 70818us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:44.923044 (+  7432us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:17:44.923109 (+    65us) write_op.cc:312] APPLY: finished
0709 12:17:44.923453 (+   344us) log.cc:844] Serialized 52 byte log entry
0709 12:17:44.923665 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:44.923831 (+   166us) write_op.cc:454] Released schema lock
0709 12:17:44.923894 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:44.924348 (+   454us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:44.924389 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":131871,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":128972,"apply.run_cpu_time_us":7854,"apply.run_wall_time_us":192820,"num_ops":6,"prepare.queue_time_us":360384,"prepare.run_cpu_time_us":22792,"prepare.run_wall_time_us":346875,"raft.queue_time_us":118854,"raft.run_cpu_time_us":8127,"raft.run_wall_time_us":82073,"replication_time_us":347741,"thread_start_us":395736,"threads_started":4,"wal-append.queue_time_us":141945}]]}
I20260709 12:17:45.374482 25748 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:45.429144 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 124300us
W20260709 12:17:45.435318 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67960.1us
I20260709 12:17:45.436607 24216 leader_election.cc:400] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4.
I20260709 12:17:45.429144 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:45.437131 24216 leader_election.cc:403] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:45.442417 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:45.443125 25793 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.375082 25807 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:17:45.400503 25770 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:45.439849 24170 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:45.446445 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:45.450642 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 93678.2us
I20260709 12:17:45.415571 23996 catalog_manager.cc:5697] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 2 to 3, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 3 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:45.458089 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:45.460278 24216 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.463939 23996 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 2 to 3, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 3 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:17:45.497031 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:45.439952 25777 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:45.501825 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.452345 25860 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:17:45.510087 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.511384 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.512364 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.523761 24173 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:45.513825 24172 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:45.519255 24100 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:45.515084 24168 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:17:45.520321 24175 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:45.515661 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.521677 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.526182 24169 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.523046 24171 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:45.526268 24174 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.479516 25782 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:17:45.459043 25666 raft_consensus.cc:697] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:45.480195 25771 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:45.449406 25735 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:45.461194 25770 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:45.541706 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.445480 25661 consensus_queue.cc:1059] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:17:45.545419 24169 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:45.391795 25736 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:45.547093 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 162318us
W20260709 12:17:45.547072 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 170926us
I20260709 12:17:45.461581 25473 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:17:45.456163 25793 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.529542 25751 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:45.554217 24067 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:45.569067 24175 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:45.556417 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.567469 24173 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:45.517274 25844 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:45.566462 24174 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:45.537933 25777 raft_consensus.cc:697] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:17:45.573299 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 119172us
I20260709 12:17:45.516428 25761 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:17:45.547760 25770 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.522913 25683 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:17:45.578871 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.590456 24173 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:45.578538 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.573967 25844 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:45.582651 25801 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:45.583670 25824 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:45.522119 25747 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:17:45.592295 24168 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:45.595573 24171 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:45.598088 24096 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:45.572980 25771 raft_consensus.cc:3055] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:45.579643 25661 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:45.604028 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:45.604498 24245 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 1. Current term is 2. Ops: []
I20260709 12:17:45.589236 25473 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.614343 25473 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:45.606640 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.607599 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.607416 25666 consensus_queue.cc:237] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.608381 25861 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:45.608677 25798 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.591725 25803 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.608784 25735 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.611264 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.600533 25771 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:45.612306 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:45.613085 25685 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:45.613094 25790 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.596169 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.616331 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.617272 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:45.618011 24248 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:45.624115 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.575850 25751 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.594439 25844 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.625057 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.712435 24247 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:45.630775 24250 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:45.627612 25860 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.605165 25661 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:45.648936 24169 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:45.710398 24246 raft_consensus.cc:2393] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:45.645012 24244 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:45.713502 24167 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:45.713948 24242 raft_consensus.cc:2410] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:45.636694 25861 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:45.642659 25803 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.722848 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.725065 24246 raft_consensus.cc:2410] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:45.634732 25793 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:45.733804 24176 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:45.735109 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.736204 24245 raft_consensus.cc:2393] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:45.731667 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.744174 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.748147 25861 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.754256 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.756011 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.756713 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:45.757686 24246 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:45.757632 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.754472 25803 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:45.647876 25866 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260709 12:17:45.775503 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.722952 25868 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.743357 24241 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:45.806620 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.807664 24247 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:45.719941 25860 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:45.770252 25790 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:45.650146 25777 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:45.833374 24244 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:45.843734 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.841063 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.834995 25793 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:45.774415 25771 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.800275 25753 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 12:17:45.868897 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.872702 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:45.879563 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 558729us
I20260709 12:17:45.883714 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.842931 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:45.894164 25860 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:45.802906 24242 raft_consensus.cc:2410] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:45.828074 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.913110 24248 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:45.799396 25661 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.916680 24248 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:45.917327 24245 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:45.918435 24247 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
W20260709 12:17:45.919433 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:45.867769 24244 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:45.813223 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:45.957561 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:45.906693 25683 consensus_queue.cc:1059] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:17:45.897686 25793 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.869657 25473 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:46.060467 25473 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:46.062103 25793 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.038166 24215 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:45.801661 25868 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:45.998188 25651 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:46.058373 24241 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:46.079181 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:46.079952 24176 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:46.089138 25473 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:46.089666 25761 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.089903 25473 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:46.090435 25761 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:46.052217 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 239063us
I20260709 12:17:46.091323 25473 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:46.092916 24216 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:46.070885 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.054929 25753 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.093406 25761 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:46.120266 24244 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:17:46.126195 24176 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:17:46.064989 25868 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.078410 25793 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.084951 25685 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:46.144063 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:46.153991 24245 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:17:46.157923 24094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.034s	sys 0.052s
W20260709 12:17:46.158741 24094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.035s	sys 0.052s
I20260709 12:17:46.162356 24099 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:46.124027 25751 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.117334 25753 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.172079 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:46.175940 24095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.037s	sys 0.020s
I20260709 12:17:46.151764 25761 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:46.176455 24095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.037s	sys 0.020s
I20260709 12:17:46.158241 25661 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:46.152168 25694 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:46.169557 25685 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:46.166846 25413 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:46.172201 25495 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.221251 24250 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:46.226436 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.155781 25793 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:46.242048 24142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.014s	sys 0.034s
W20260709 12:17:46.242592 24142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.014s	sys 0.034s
I20260709 12:17:46.244057 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.245078 24096 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
W20260709 12:17:46.229923 25748 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.023s	sys 0.070s
W20260709 12:17:46.259490 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.225371 25685 raft_consensus.cc:697] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:46.268021 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.210662 25694 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:46.250416 24093 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:46.259882 25748 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.024s	sys 0.070s
W20260709 12:17:46.270480 25798 consensus_meta.cc:287] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.640s	user 0.013s	sys 0.001s
W20260709 12:17:46.277212 25782 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.723s	user 0.013s	sys 0.003s
I20260709 12:17:46.231048 25495 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.224598 25413 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:46.279301 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:46.282353 25504 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.966s	user 0.016s	sys 0.000s
I20260709 12:17:46.274308 25651 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:46.329223 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.330302 24098 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:46.348686 25798 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.352135 25798 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.353314 25694 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.354518 25798 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:46.354682 25685 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:46.321910 25782 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4.
I20260709 12:17:46.367722 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.368944 25495 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.334801 25651 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.371467 25413 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:46.393644 24249 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:46.424702 25750 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:46.414489 25868 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.414075 25751 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:46.332901 25504 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.372318 25651 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:46.453004 24067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.051s	sys 0.097s
W20260709 12:17:46.466356 24067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.896s	user 0.051s	sys 0.097s
W20260709 12:17:46.466737 25770 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.870s	user 0.015s	sys 0.002s
I20260709 12:17:46.469236 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:46.467128 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 912951us
I20260709 12:17:46.429796 25753 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:46.451924 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.453162 25790 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.451133 25748 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:46.454777 25750 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:17:46.461069 25844 consensus_meta.cc:287] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.733s	user 0.015s	sys 0.000s
I20260709 12:17:46.521533 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:46.522706 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.522907 24140 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:46.526232 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.490322 25748 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.529320 25803 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:46.529870 25803 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.530292 25803 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:46.490039 25790 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.536162 25790 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:46.537218 25860 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:46.537664 25860 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.538045 25860 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:46.538228 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.544191 25771 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:46.552439 24246 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:46.553714 25747 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:46.554457 25747 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.556856 25793 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.561477 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1306) took 1169 ms. Trace:
I20260709 12:17:46.465085 25868 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.564244 25504 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:46.563777 24094 rpcz_store.cc:276] 0709 12:17:45.391740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.392277 (+   537us) service_pool.cc:224] Handling call
0709 12:17:45.392605 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.448667 (+ 56062us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.448705 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.452343 (+  3638us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.159246 (+706903us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:46.159309 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.159411 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:46.561182 (+401771us) raft_consensus.cc:1685] finished
0709 12:17:46.561210 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:46.561397 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56936,"raft.queue_time_us":59198,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":4479,"thread_start_us":630305,"threads_started":1,"wal-append.queue_time_us":1022678}
I20260709 12:17:46.597551 25868 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.611613 25750 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.614106 25750 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:46.528723 25748 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.517547 25844 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.647965 25747 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:46.665378 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:46.675436 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 200883us
I20260709 12:17:46.467818 25751 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.491196 24093 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:46.701866 24067 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:17:46.690474 24175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.010s	sys 0.024s
I20260709 12:17:46.694118 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:46.704170 24175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.010s	sys 0.024s
I20260709 12:17:46.694654 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.638957 25844 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:46.478173 25770 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:46.696421 25865 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.005s	sys 0.028s
W20260709 12:17:46.708353 23985 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.026s	sys 0.020s
I20260709 12:17:46.709542 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.688679 25864 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.724269 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:17:46.727749 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.026s	sys 0.025s
W20260709 12:17:46.737617 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.134s	user 0.026s	sys 0.025s
W20260709 12:17:46.738044 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 1.13652e+06us
I20260709 12:17:46.701148 25747 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.738571 24140 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:17:46.740097 24214 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.123s	user 0.013s	sys 0.023s
W20260709 12:17:46.743286 24214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.014s	sys 0.023s
W20260709 12:17:46.743639 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 1.14083e+06us
I20260709 12:17:46.744477 24214 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:46.725507 25621 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:46.748661 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:17:46.726012 25865 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.005s	sys 0.029s
W20260709 12:17:46.727790 23985 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.027s	sys 0.021s
W20260709 12:17:46.739892 25704 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.142s	user 0.012s	sys 0.024s
I20260709 12:17:46.708930 25413 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
W20260709 12:17:46.748050 25773 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.199s	user 0.013s	sys 0.029s
I20260709 12:17:46.725862 25669 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:17:46.777535 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:46.747871 25621 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.725857 25870 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
W20260709 12:17:46.783608 24141 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.021s	user 0.015s	sys 0.037s
I20260709 12:17:46.742283 25864 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:46.764035 25704 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.171s	user 0.012s	sys 0.025s
W20260709 12:17:46.768175 24092 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.271s	user 0.045s	sys 0.059s
I20260709 12:17:46.752216 25772 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:46.751837 25661 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:46.784005 24141 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.021s	user 0.015s	sys 0.037s
I20260709 12:17:46.762852 25651 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:46.772125 25773 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.230s	user 0.013s	sys 0.030s
W20260709 12:17:46.792716 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 1.03005e+06us
W20260709 12:17:46.779503 24808 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.017s	sys 0.021s
I20260709 12:17:46.795820 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:46.781061 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:46.798837 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:46.800554 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54914.4us
W20260709 12:17:46.783259 25666 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.017s	sys 0.034s
W20260709 12:17:46.789475 24092 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.310s	user 0.045s	sys 0.060s
I20260709 12:17:46.746918 25747 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.783356 25495 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:46.819113 24141 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 2.107s (SENT) [suppressed 41 similar messages]
I20260709 12:17:46.783033 25621 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:46.816349 25886 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:46.816815 24812 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.018s	user 0.025s	sys 0.033s
W20260709 12:17:46.827870 24812 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.025s	sys 0.033s
W20260709 12:17:46.803850 24808 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.017s	sys 0.021s
W20260709 12:17:46.816215 25666 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.017s	sys 0.035s
I20260709 12:17:46.793968 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.791371 25772 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:46.793499 25651 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:46.816656 25736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.220s	user 0.003s	sys 0.051s
I20260709 12:17:46.779114 25767 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 12:17:46.780593 25860 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:46.807107 25661 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.842170 24101 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:46.827443 25747 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.792124 25786 consensus_queue.cc:1059] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:17:46.832830 25876 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:46.833036 25748 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:46.832496 25751 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.838019 25651 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:46.872736 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1419) took 1496 ms. Trace:
W20260709 12:17:46.839735 24168 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.010s	sys 0.035s
W20260709 12:17:46.879310 24168 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.011s	sys 0.035s
I20260709 12:17:46.879837 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:46.859901 24807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.007s	sys 0.047s
I20260709 12:17:46.840179 25772 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:46.883087 25748 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.887655 25770 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:46.889062 25727 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:46.889923 25727 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:46.890292 25748 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.869951 25669 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:17:46.891496 25874 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260709 12:17:46.891274 25669 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:46.891083 25727 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.870337 25773 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:46.839303 25736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.251s	user 0.003s	sys 0.052s
I20260709 12:17:46.899294 25773 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:46.900625 25770 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:46.901477 25790 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:46.901979 25504 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:46.902446 25504 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 2 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:46.903612 24096 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:46.903435 25504 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:46.904520 25504 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:46.905756 24807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.022s	user 0.008s	sys 0.048s
I20260709 12:17:46.906520 25816 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:46.877637 24101 rpcz_store.cc:276] 0709 12:17:45.376061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.376359 (+   298us) service_pool.cc:224] Handling call
0709 12:17:45.376760 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:46.865339 (+1488579us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.872377 (+  7038us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540028b254. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:46.872640 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3369522944}
I20260709 12:17:46.907270 25816 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:46.863394 25797 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:46.880460 25735 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.027s	sys 0.029s
I20260709 12:17:46.886831 24141 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:46.870448 25872 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.162s	user 0.002s	sys 0.000s
I20260709 12:17:46.858779 25824 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 12:17:46.921765 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.946908 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:46.933990 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:46.921797 24096 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:46.923187 25798 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.900110 25773 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:46.892553 25747 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:46.973572 25748 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:46.946852 25680 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.407s	user 0.003s	sys 0.044s
W20260709 12:17:46.968225 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 81503.1us
I20260709 12:17:46.977836 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:46.965971 25735 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.029s	sys 0.032s
I20260709 12:17:46.976333 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:46.968779 24779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.019s	sys 0.038s
I20260709 12:17:46.958039 25727 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:46.975732 25770 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:46.913815 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:46.910022 25751 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:17:46.981820 24096 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:46.908361 25767 raft_consensus.cc:3055] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:46.982867 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:46.879050 25876 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:46.924054 24811 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.158s	user 0.008s	sys 0.043s
W20260709 12:17:46.893671 24813 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.837s	user 0.018s	sys 0.039s
W20260709 12:17:46.981398 25863 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.201s	user 0.013s	sys 0.048s
I20260709 12:17:46.949620 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:46.951673 25860 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:47.007922 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1305) took 1618 ms. Trace:
I20260709 12:17:47.008500 24095 rpcz_store.cc:276] 0709 12:17:45.389394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.389600 (+   206us) service_pool.cc:224] Handling call
0709 12:17:45.389931 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.445846 (+ 55915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.445880 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.446386 (+   506us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.177008 (+730622us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:46.177070 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.177174 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.007615 (+830441us) raft_consensus.cc:1685] finished
0709 12:17:47.007648 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.007837 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55501,"raft.queue_time_us":56334,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":13742,"spinlock_wait_cycles":57728,"thread_start_us":680269,"threads_started":1,"wal-append.queue_time_us":1244991}
W20260709 12:17:46.978649 25680 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.441s	user 0.003s	sys 0.047s
I20260709 12:17:46.998476 24141 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:47.013441 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:46.923398 25790 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:47.014642 25790 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:47.015359 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:47.017627 25790 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:47.018325 25790 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:46.975798 25864 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:47.005925 25770 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:47.021389 25770 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:46.986780 24779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.020s	sys 0.038s
I20260709 12:17:47.022081 25816 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:46.977793 25798 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:47.005010 25767 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:47.028258 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:47.029112 24101 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:47.039166 24214 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:46.971386 25797 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:47.006471 24811 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.240s	user 0.008s	sys 0.044s
W20260709 12:17:47.025280 25863 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.245s	user 0.013s	sys 0.048s
W20260709 12:17:47.043608 24171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.948s	user 0.019s	sys 0.023s
I20260709 12:17:47.044323 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:47.050621 24169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.016s	sys 0.027s
W20260709 12:17:47.050940 24169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.016s	sys 0.027s
I20260709 12:17:47.051244 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:47.025046 24813 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.971s	user 0.018s	sys 0.041s
I20260709 12:17:47.047866 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:47.046968 24172 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.018s	sys 0.042s
I20260709 12:17:47.047588 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:47.031409 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:47.048926 24216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.023s	sys 0.022s
I20260709 12:17:47.043275 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:47.061079 24216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.967s	user 0.023s	sys 0.022s
I20260709 12:17:47.061477 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:47.061720 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 968863us
I20260709 12:17:47.062971 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:47.063288 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:47.041047 25865 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.064049 24141 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:47.052157 24171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.019s	sys 0.024s
W20260709 12:17:47.069391 24172 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.015s	user 0.018s	sys 0.042s
I20260709 12:17:47.052416 25750 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:47.066144 25868 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.065898 25793 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:47.140648 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 54094.7us
I20260709 12:17:47.050442 25661 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:47.033572 25621 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:47.083917 25777 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.186s	user 0.010s	sys 0.017s
I20260709 12:17:47.085566 25770 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:47.119859 25803 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.558s	user 0.014s	sys 0.000s
I20260709 12:17:47.085419 25771 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:47.083590 25866 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.002s	sys 0.023s
I20260709 12:17:47.119192 25750 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.115859 25669 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:47.151590 25770 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:47.169024 24094 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:47.065623 25767 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:47.152383 25777 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.255s	user 0.010s	sys 0.017s
I20260709 12:17:47.150672 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:47.121973 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:47.148265 25751 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:47.208066 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57535.7us
W20260709 12:17:47.204334 24780 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 1.394s	user 0.012s	sys 0.021s
W20260709 12:17:47.146860 25861 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.276s	user 0.030s	sys 0.040s
W20260709 12:17:47.188490 25866 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.002s	sys 0.026s
W20260709 12:17:47.207089 25685 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.000s	sys 0.028s
W20260709 12:17:47.216434 24780 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.406s	user 0.012s	sys 0.021s
I20260709 12:17:47.218159 24216 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:47.202250 25770 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:47.209187 25882 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:17:47.201268 25750 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:47.219101 25861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.030s	sys 0.040s
W20260709 12:17:47.209808 25871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.094s	user 0.005s	sys 0.024s
I20260709 12:17:47.245088 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:47.264816 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46767.4us
I20260709 12:17:47.265877 24216 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:47.247231 25767 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:47.251293 24099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.015s	sys 0.015s
I20260709 12:17:47.214915 25771 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:47.274457 24099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.015s	sys 0.015s
W20260709 12:17:47.215996 24810 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.310s	user 0.007s	sys 0.024s
W20260709 12:17:47.234252 25685 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.000s	sys 0.028s
I20260709 12:17:47.200424 25803 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:47.219285 25751 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:47.260264 25816 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:47.268987 25871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.005s	sys 0.026s
W20260709 12:17:47.273617 24781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.122s	user 0.006s	sys 0.024s
I20260709 12:17:47.295553 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:47.304586 24781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.153s	user 0.006s	sys 0.024s
W20260709 12:17:47.305935 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 1.155e+06us
W20260709 12:17:47.277799 24810 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.372s	user 0.007s	sys 0.024s
W20260709 12:17:47.317512 25905 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260709 12:17:47.306524 24247 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.013s	sys 0.015s
I20260709 12:17:47.271991 25824 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.257992 25777 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:17:47.314474 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:47.320071 24247 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.013s	sys 0.015s
W20260709 12:17:47.321655 25884 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:17:47.323508 24813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 249) took 1558 ms. Trace:
I20260709 12:17:47.323381 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:47.324101 25891 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:47.324469 24809 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:47.324180 24813 rpcz_store.cc:276] 0709 12:17:45.764900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.765274 (+   374us) service_pool.cc:224] Handling call
0709 12:17:45.765901 (+   627us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.766939 (+  1038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.768522 (+  1583us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.851676 (+ 83154us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.073715 (+1222039us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:47.083312 (+  9597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.115850 (+ 32538us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.323160 (+207310us) raft_consensus.cc:1685] finished
0709 12:17:47.323184 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.323380 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3973,"raft.queue_time_us":242,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":9461,"thread_start_us":1003425,"threads_started":1,"wal-append.queue_time_us":1406045}
I20260709 12:17:47.326622 25803 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:47.327636 24808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 245) took 1563 ms. Trace:
I20260709 12:17:47.328034 24808 rpcz_store.cc:276] 0709 12:17:45.763730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.765102 (+  1372us) service_pool.cc:224] Handling call
0709 12:17:45.765470 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.766017 (+   547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.766052 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.766537 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:17:45.862159 (+ 95622us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b180033b260. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:17:46.840828 (+978669us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:46.856482 (+ 15654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.868071 (+ 11589us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.327281 (+459210us) raft_consensus.cc:1685] finished
0709 12:17:47.327317 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.327552 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":732,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":6921,"spinlock_wait_cycles":31872768,"thread_start_us":968256,"threads_started":1,"wal-append.queue_time_us":1438715}
I20260709 12:17:47.329859 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:47.330579 24815 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:47.270408 25798 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:47.323459 25877 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:17:47.296530 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:47.374454 25473 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.005s	sys 0.023s
I20260709 12:17:47.324858 24807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 248) took 1560 ms. Trace:
I20260709 12:17:47.311620 25797 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:47.312676 25881 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:47.391829 24814 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:17:47.393661 25621 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:47.308591 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:47.312444 25816 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:47.397454 25881 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:47.397627 25885 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:17:47.397972 25881 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:47.398586 25651 consensus_meta.cc:287] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.505s	user 0.012s	sys 0.001s
I20260709 12:17:47.401233 25651 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:47.384217 25473 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.005s	sys 0.023s
I20260709 12:17:47.394687 24806 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:47.403602 25651 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:47.408367 25816 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:47.366518 25906 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.367566 25876 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:47.417327 24100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.155s	user 0.005s	sys 0.019s
W20260709 12:17:47.421119 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 124679us
W20260709 12:17:47.475287 24100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.213s	user 0.005s	sys 0.020s
I20260709 12:17:47.475930 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:47.474010 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.004s	sys 0.019s
W20260709 12:17:47.478533 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.004s	sys 0.019s
W20260709 12:17:47.478974 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 697974us
I20260709 12:17:47.384832 24811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 244) took 1618 ms. Trace:
I20260709 12:17:47.383584 25798 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:17:47.504019 24065 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.017s	sys 0.011s
W20260709 12:17:47.504865 24065 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.018s	sys 0.011s
I20260709 12:17:47.493647 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:47.506994 24097 raft_consensus.cc:2393] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:47.509327 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:17:47.503643 25495 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.006s	sys 0.019s
W20260709 12:17:47.511011 25495 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.006s	sys 0.019s
I20260709 12:17:47.511643 25495 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:47.512408 25790 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.512858 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:47.513121 24067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.008s	sys 0.017s
I20260709 12:17:47.513315 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:47.513782 24067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.009s	sys 0.017s
I20260709 12:17:47.515581 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:47.419543 25886 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.023s	sys 0.015s
I20260709 12:17:47.515623 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:47.499956 24175 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.015s	sys 0.010s
W20260709 12:17:47.555408 24175 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.016s	sys 0.010s
I20260709 12:17:47.557040 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1386) took 1973 ms. Trace:
I20260709 12:17:47.558430 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:47.559659 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:47.510732 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:47.561604 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:47.561797 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 51180.1us
I20260709 12:17:47.562258 24097 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:47.562302 24249 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:47.563068 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:47.563428 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:47.564097 24097 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:47.564493 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:47.564776 24168 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.021s	sys 0.031s
W20260709 12:17:47.565183 24168 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.021s	sys 0.031s
I20260709 12:17:47.565099 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:47.565186 24245 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:47.566586 24097 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:47.557542 24175 rpcz_store.cc:276] 0709 12:17:45.583363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.587109 (+  3746us) service_pool.cc:224] Handling call
0709 12:17:45.587488 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.587865 (+   377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.587894 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.588419 (+   525us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.704664 (+1116245us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:47.556028 (+851364us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.556339 (+   311us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.556495 (+   156us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.556547 (+    52us) raft_consensus.cc:1685] finished
0709 12:17:47.556563 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.556846 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1105,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":5149,"thread_start_us":1932268,"threads_started":2,"wal-append.queue_time_us":1499781}
W20260709 12:17:47.570333 24812 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.015s	sys 0.038s
W20260709 12:17:47.570757 24812 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.016s	sys 0.038s
I20260709 12:17:47.571691 24812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 246) took 1807 ms. Trace:
I20260709 12:17:47.490849 25473 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:47.581007 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:47.581560 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:47.516420 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 720631us
I20260709 12:17:47.564226 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.649781 24249 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:47.578019 24248 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:17:47.560746 25886 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.024s	sys 0.015s
I20260709 12:17:47.572162 24812 rpcz_store.cc:276] 0709 12:17:45.764014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.768783 (+  4769us) service_pool.cc:224] Handling call
0709 12:17:45.769142 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.769445 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:46.828972 (+1059527us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.571230 (+742258us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:47.571308 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:47.571373 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.571464 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.571618 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1446030,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"thread_start_us":1772110,"threads_started":2}
I20260709 12:17:47.514597 25771 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.583001 24245 raft_consensus.cc:2410] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:47.648661 24246 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:47.688956 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.689859 24246 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:47.689921 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.656369 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:47.656484 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 75611.2us
I20260709 12:17:47.691200 24174 raft_consensus.cc:2410] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:47.690743 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.691716 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.691954 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:47.692651 24170 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.693071 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:47.675653 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.693862 24175 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.694432 24248 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:47.694753 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.695595 24176 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
W20260709 12:17:47.686303 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.012s	sys 0.012s
I20260709 12:17:47.675226 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:47.645597 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.691852 24246 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
W20260709 12:17:47.697101 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.012s	sys 0.012s
I20260709 12:17:47.696651 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:47.697868 24176 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:47.697988 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 633984us
I20260709 12:17:47.699148 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:47.559660 25860 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.571926 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:47.711964 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.715616 24173 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:47.716228 24176 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:47.716952 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.717718 24141 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:47.577780 25798 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:47.723843 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:47.492018 25906 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:47.676244 25413 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.012s	sys 0.044s
I20260709 12:17:47.712159 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.736351 24250 raft_consensus.cc:2410] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:47.719012 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.712996 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.737941 24246 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
W20260709 12:17:47.676769 24092 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.000s	sys 0.026s
W20260709 12:17:47.730468 24215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.012s	sys 0.058s
W20260709 12:17:47.748986 24215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.013s	sys 0.058s
I20260709 12:17:47.717223 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.745810 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.659400 25886 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:47.644928 25863 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:47.753630 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.754633 24250 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:47.756222 24250 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:47.747478 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.758715 24173 raft_consensus.cc:2368] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
I20260709 12:17:47.739549 25771 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:47.760458 25771 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:47.704089 25651 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:17:47.745091 24172 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.007s	sys 0.016s
W20260709 12:17:47.737347 25413 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.012s	sys 0.045s
W20260709 12:17:47.768676 24169 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.018s	sys 0.024s
W20260709 12:17:47.776895 24169 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.019s	sys 0.025s
I20260709 12:17:47.746591 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.724037 25798 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:47.723491 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:47.740218 25884 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:17:47.713501 25793 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:17:47.768880 24172 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.016s
W20260709 12:17:47.759634 25680 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.021s	sys 0.006s
I20260709 12:17:47.773298 25685 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:47.793962 24779 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.009s	sys 0.032s
W20260709 12:17:47.795185 24779 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.010s	sys 0.032s
W20260709 12:17:47.795537 24171 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.012s	sys 0.012s
W20260709 12:17:47.795604 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 593604us
W20260709 12:17:47.796137 24171 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.012s	sys 0.012s
W20260709 12:17:47.751945 24092 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.000s	sys 0.027s
I20260709 12:17:47.647347 25473 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:47.747874 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:47.739612 25504 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:47.777374 24101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.009s	sys 0.008s
I20260709 12:17:47.782286 24246 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:47.785431 25798 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:47.727648 25803 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.761571 25902 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:47.790639 24098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.015s	sys 0.025s
W20260709 12:17:47.829788 24098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.016s	sys 0.025s
I20260709 12:17:47.773610 25797 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:17:47.808429 24101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.009s	sys 0.009s
I20260709 12:17:47.794051 25751 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:47.497812 24811 rpcz_store.cc:276] 0709 12:17:45.763389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.763602 (+   213us) service_pool.cc:224] Handling call
0709 12:17:45.764357 (+   755us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.765015 (+   658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.765049 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.765854 (+   805us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.064955 (+1299101us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:47.068133 (+  3178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.074479 (+  6346us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.354882 (+280403us) raft_consensus.cc:1685] finished
0709 12:17:47.354916 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.382087 (+ 27171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":145,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":1282346,"threads_started":1,"wal-append.queue_time_us":1501445}
I20260709 12:17:47.811820 25926 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.813838 24810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 247) took 2049 ms. Trace:
I20260709 12:17:47.823378 24167 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:47.789747 25680 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.021s	sys 0.007s
I20260709 12:17:47.784372 25621 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.795107 24170 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
W20260709 12:17:47.854633 25898 log.cc:927] Time spent T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:17:47.845085 25900 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 12:17:47.816067 25886 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:47.850857 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:47.849589 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:47.778271 25651 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:47.851076 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:47.826130 25892 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.490s	user 0.002s	sys 0.000s
W20260709 12:17:47.878019 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 154347us
I20260709 12:17:47.809000 24175 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:47.800545 25793 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:47.820966 25816 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:47.386967 24807 rpcz_store.cc:276] 0709 12:17:45.764579 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.767077 (+  2498us) service_pool.cc:224] Handling call
0709 12:17:45.810532 (+ 43455us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.866552 (+ 56020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.867912 (+  1360us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.883754 (+ 15842us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.906270 (+1022516us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:46.906343 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:46.906475 (+   132us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.324585 (+418110us) raft_consensus.cc:1685] finished
0709 12:17:47.324607 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.324786 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8103,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"thread_start_us":1021933,"threads_started":1,"wal-append.queue_time_us":1362465}
I20260709 12:17:47.868721 25609 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:47.844211 25771 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:47.880265 25866 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:17:47.781885 25495 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:47.852234 25770 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.000s
W20260709 12:17:47.845835 25901 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 12:17:47.854835 25803 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.863643 25924 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:47.846791 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.827378 25504 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:47.886670 24248 raft_consensus.cc:2410] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:17:47.878018 25767 consensus_meta.cc:287] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.585s	user 0.009s	sys 0.004s
I20260709 12:17:47.773185 25863 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:47.892388 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:47.873150 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:47.897364 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 222247us
W20260709 12:17:47.902136 24247 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.013s	sys 0.027s
I20260709 12:17:47.836568 25902 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:47.896987 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1411) took 2606 ms. Trace:
I20260709 12:17:47.902891 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:47.904167 25926 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:17:47.924502 24175 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:47.906041 25770 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:47.911895 24174 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:47.918386 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:47.922086 24247 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.013s	sys 0.028s
I20260709 12:17:47.880640 25666 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:47.940734 24097 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:17:47.920683 24170 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
W20260709 12:17:47.937453 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 45168.5us
W20260709 12:17:47.889010 25772 consensus_meta.cc:287] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.001s	user 0.015s	sys 0.007s
I20260709 12:17:47.937963 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1391) took 2151 ms. Trace:
I20260709 12:17:47.952813 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1393) took 2164 ms. Trace:
I20260709 12:17:47.879000 25916 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:47.979315 25868 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:47.987485 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 102) took 2332 ms. Trace:
I20260709 12:17:47.873615 25797 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:47.912645 25910 log.cc:927] Time spent T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:17:47.924075 25907 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:17:47.991732 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:47.983604 25751 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:17:47.916193 25504 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:47.979807 25903 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.117s	user 0.004s	sys 0.000s
I20260709 12:17:47.924132 25902 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:47.982218 24168 rpcz_store.cc:276] 0709 12:17:45.786792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.787320 (+   528us) service_pool.cc:224] Handling call
0709 12:17:45.803824 (+ 16504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.804263 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.804303 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.819441 (+ 15138us) log.cc:844] Serialized 26 byte log entry
0709 12:17:46.881281 (+1061840us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:47.565681 (+684400us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.573128 (+  7447us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.573209 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.937663 (+364454us) raft_consensus.cc:1685] finished
0709 12:17:47.937686 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.937879 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36766,"prepare.queue_time_us":930145,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":14154,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":88819,"thread_start_us":1679228,"threads_started":2,"wal-append.queue_time_us":1421586}
W20260709 12:17:47.989480 25881 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.000s
I20260709 12:17:47.996028 24247 rpcz_store.cc:276] 0709 12:17:45.647331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.919369 (+272038us) service_pool.cc:224] Handling call
0709 12:17:46.530079 (+610710us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:46.530376 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:46.530669 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:17:47.320483 (+789814us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.979698 (+659215us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:47.979800 (+   102us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:17:47.979860 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.979946 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.980104 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47239,"prepare.queue_time_us":1171888,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":47921,"raft.run_wall_time_us":3685,"spinlock_wait_cycles":84082176,"thread_start_us":1400811,"threads_started":2,"wal-append.queue_time_us":664220}
I20260709 12:17:47.984699 24171 rpcz_store.cc:276] 0709 12:17:45.788036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.885088 (+ 97052us) service_pool.cc:224] Handling call
0709 12:17:45.910151 (+ 25063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:46.032547 (+122396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.032600 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:46.033405 (+   805us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.068569 (+1035164us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:47.796791 (+728222us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.952248 (+155457us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.952412 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.952482 (+    70us) raft_consensus.cc:1685] finished
0709 12:17:47.952503 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.952721 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5978,"prepare.queue_time_us":743336,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":32,"raft.queue_time_us":122634,"raft.run_cpu_time_us":354,"raft.run_wall_time_us":15222,"thread_start_us":1781914,"threads_started":3,"wal-append.queue_time_us":1323403}
I20260709 12:17:47.980917 25844 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:47.982847 25926 consensus_queue.cc:1243] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:47.920169 25863 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:47.946568 25917 consensus_queue.cc:1059] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:17:47.937628 25609 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:47.988446 25777 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:48.017544 24246 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:48.015915 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:47.903164 25816 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.031253 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1392) took 2244 ms. Trace:
I20260709 12:17:48.053763 24169 rpcz_store.cc:276] 0709 12:17:45.787156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.844995 (+ 57839us) service_pool.cc:224] Handling call
0709 12:17:45.872847 (+ 27852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.891834 (+ 18987us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.891886 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:46.042602 (+150716us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.051301 (+1008699us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:47.783134 (+731833us) log.cc:844] Serialized 14 byte log entry
0709 12:17:48.001179 (+218045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.001303 (+   124us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.030923 (+ 29620us) raft_consensus.cc:1685] finished
0709 12:17:48.030957 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.031170 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19406,"prepare.queue_time_us":760391,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":96800,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":26083,"thread_start_us":1880880,"threads_started":3,"wal-append.queue_time_us":1298589}
I20260709 12:17:48.002394 25747 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:47.913636 25906 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:48.025087 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.063100 24170 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:17:48.047721 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 125981us
I20260709 12:17:47.988821 25772 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:48.029260 25748 consensus_meta.cc:287] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.049s	user 0.010s	sys 0.006s
I20260709 12:17:48.043212 25790 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.021790 25824 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:48.022136 24242 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:47.911463 25924 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.065753 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:48.075003 25913 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:17:48.046696 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:48.052356 24167 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:17:48.086444 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 94840.1us
I20260709 12:17:48.127745 24095 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:48.128309 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.000201 25916 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.079495 25609 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:48.079632 25934 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:17:48.081179 25793 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:48.081453 25473 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:48.081817 25943 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:48.059131 25926 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:17:48.065292 25863 raft_consensus.cc:3055] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:48.083377 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:48.058789 25777 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:48.076503 25750 consensus_meta.cc:287] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.803s	user 0.010s	sys 0.004s
W20260709 12:17:48.130729 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 273252us
I20260709 12:17:48.130475 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1388) took 2546 ms. Trace:
I20260709 12:17:48.144639 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1309) took 1933 ms. Trace:
W20260709 12:17:48.110440 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44791.7us
I20260709 12:17:48.155277 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.060344 25868 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:17:48.049937 25937 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260709 12:17:48.043243 25881 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.182768 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.081195 25797 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:48.068791 25865 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.192435 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.191546 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:48.180946 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:48.131376 25751 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:48.201468 24172 rpcz_store.cc:276] 0709 12:17:45.584114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.593922 (+  9808us) service_pool.cc:224] Handling call
0709 12:17:45.867849 (+273927us) spinlock_profiling.cc:243] Waited 2.12 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:45.868133 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:45.868720 (+   587us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:45.868749 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:45.889872 (+ 21123us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.069915 (+1180043us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:47.785101 (+715186us) log.cc:844] Serialized 14 byte log entry
0709 12:17:48.067836 (+282735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.068048 (+   212us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.070235 (+  2187us) raft_consensus.cc:1685] finished
0709 12:17:48.130147 (+ 59912us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.130385 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73073,"prepare.queue_time_us":742187,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":90601,"raft.run_cpu_time_us":339,"raft.run_wall_time_us":23667,"spinlock_wait_cycles":4883200,"thread_start_us":1919520,"threads_started":3,"wal-append.queue_time_us":1488220}
I20260709 12:17:48.231916 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:48.203728 25919 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.331s	user 0.001s	sys 0.001s
I20260709 12:17:48.236861 24250 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:48.181499 25863 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:48.059131 25942 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.133s
I20260709 12:17:48.127883 25748 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.191090 24100 rpcz_store.cc:276] 0709 12:17:46.211005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.211204 (+   199us) service_pool.cc:224] Handling call
0709 12:17:46.224913 (+ 13709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:46.234129 (+  9216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.234185 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:46.234912 (+   727us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.476043 (+1241131us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:47.476116 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.476226 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:47.923406 (+447180us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:48.128878 (+205472us) raft_consensus.cc:1685] finished
0709 12:17:48.128907 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.144524 (+ 15617us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4820,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":3117,"spinlock_wait_cycles":8492928,"thread_start_us":1213349,"threads_started":1,"wal-append.queue_time_us":1526292}
I20260709 12:17:48.150311 25909 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.233489 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:48.230669 25751 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.234872 24172 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:48.142021 25900 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:17:48.209877 25924 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:48.076298 25824 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:48.189342 24093 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:48.196986 25938 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.075546 25936 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.170s
I20260709 12:17:48.250458 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1449) took 1006 ms. Trace:
W20260709 12:17:48.251530 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 59251.3us
I20260709 12:17:48.352645 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.338779 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:48.086270 25790 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:48.254189 25935 log.cc:927] Time spent T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
W20260709 12:17:48.254854 25925 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.353s	user 0.001s	sys 0.000s
I20260709 12:17:48.201782 25750 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:48.243989 25908 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.366s	user 0.000s	sys 0.002s
I20260709 12:17:48.351917 24094 rpcz_store.cc:276] 0709 12:17:47.244080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.258107 (+ 14027us) service_pool.cc:224] Handling call
0709 12:17:47.258889 (+   782us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:47.270488 (+ 11599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:47.270532 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:47.294732 (+ 24200us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.782605 (+487873us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:47.783035 (+   430us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.783129 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.250212 (+467083us) raft_consensus.cc:1685] finished
0709 12:17:48.250240 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.250385 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10032,"raft.queue_time_us":10572,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":21228,"thread_start_us":461076,"threads_started":1,"wal-append.queue_time_us":583824}
I20260709 12:17:48.358348 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.250205 25906 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:48.266799 25751 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.250182 25770 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:48.243109 25951 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.366542 24248 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:48.366336 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:48.260501 25651 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:48.368476 24141 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.372270 24176 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:48.374218 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.381399 24173 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:48.384624 24141 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.337328 24172 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:48.359833 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:47.861388 24810 rpcz_store.cc:276] 0709 12:17:45.764306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.767038 (+  2732us) service_pool.cc:224] Handling call
0709 12:17:45.905043 (+138005us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:45.905346 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.905671 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:47.317548 (+1411877us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.813380 (+495832us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:47.813478 (+    98us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:47.813534 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.813619 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.813764 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1354656,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":61,"raft.queue_time_us":1678,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":8474368,"thread_start_us":1898833,"threads_started":2,"wal-append.queue_time_us":685090}
I20260709 12:17:48.339768 25952 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.367463 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:48.395159 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.356812 25861 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:17:48.243445 25918 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.153s
I20260709 12:17:48.396232 24100 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:48.373804 25906 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:48.371140 25413 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:17:48.389735 25651 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.386148 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:48.402859 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.382650 25793 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.359195 25938 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.407599 25906 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:48.412703 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 172573us
I20260709 12:17:48.379794 25863 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:47.922761 24092 rpcz_store.cc:276] 0709 12:17:45.284231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:45.297821 (+ 13590us) service_pool.cc:224] Handling call
0709 12:17:45.372983 (+ 75162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:45.382841 (+  9858us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:46.827115 (+1444274us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.862372 (+1035257us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:47.871727 (+  9355us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:47.874224 (+  2497us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.877610 (+  3386us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:47.890961 (+ 13351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":200876,"prepare.queue_time_us":137853,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":67368,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":8706,"spinlock_wait_cycles":7705472,"thread_start_us":2331730,"threads_started":2,"wal-append.queue_time_us":985444}
I20260709 12:17:48.418669 24243 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:48.435995 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.441154 24779 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.443825 24170 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:17:48.391517 25824 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.416626 25772 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.457517 25953 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:17:48.458882 25947 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260709 12:17:48.459048 25920 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:48.459990 25937 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:48.459692 25920 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.461001 25960 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:48.461517 25960 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.461864 25960 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.462473 25920 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:48.463567 25954 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:17:48.464540 25916 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:48.449970 25944 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.239s	user 0.000s	sys 0.001s
I20260709 12:17:48.439180 25945 raft_consensus.cc:476] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Not starting pre-election -- already a leader
W20260709 12:17:48.470461 25941 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
I20260709 12:17:48.476480 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:48.477983 25937 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:48.478426 25937 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:48.478849 25930 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.491s	user 0.002s	sys 0.000s
I20260709 12:17:48.480373 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1442) took 1513 ms. Trace:
I20260709 12:17:48.480782 24098 rpcz_store.cc:276] 0709 12:17:46.966622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.059278 (+ 92656us) service_pool.cc:224] Handling call
0709 12:17:47.059713 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:47.085896 (+ 26183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:47.085934 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:47.146583 (+ 60649us) log.cc:844] Serialized 26 byte log entry
0709 12:17:47.830468 (+683885us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:47.830523 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.830604 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.478304 (+647700us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b240013aee8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023149c4 00007f4c02312acb 00007f4c024cddc9 00007f4c024cda55 00007f4c024cd09d 00007f4c050ff10e 00007f4c0511688c 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221
0709 12:17:48.479998 (+  1694us) raft_consensus.cc:1685] finished
0709 12:17:48.480024 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.480291 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26693,"raft.queue_time_us":11654,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2809,"spinlock_wait_cycles":4303744,"thread_start_us":636033,"threads_started":1,"wal-append.queue_time_us":824741}
I20260709 12:17:48.486099 25960 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:48.488794 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 52997.6us
I20260709 12:17:48.491746 25790 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:48.478899 25937 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.522346 25960 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.523591 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:48.524477 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:48.524825 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:48.525416 24246 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:48.525555 24807 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.527158 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:48.527791 24246 raft_consensus.cc:2376] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4. Re-sending same reply.
I20260709 12:17:48.529986 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:48.530618 24246 raft_consensus.cc:2376] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3. Re-sending same reply.
W20260709 12:17:48.495198 25798 consensus_meta.cc:287] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.660s	user 0.005s	sys 0.008s
W20260709 12:17:48.495234 25773 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.508s	user 0.019s	sys 0.000s
I20260709 12:17:48.534417 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:48.506101 25750 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:48.505304 25938 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.512344 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.517068 25751 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.533020 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:48.535411 24807 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:48.535905 24810 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.536265 24176 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:48.533984 25773 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.535526 24175 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:48.540041 24096 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:17:48.540838 24246 raft_consensus.cc:2393] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:48.543187 25773 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:48.532569 25798 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.544333 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:48.545296 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:48.545390 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:48.546506 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:48.547657 24249 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:48.548465 25938 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.549638 24246 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.549556 25938 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.540304 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:48.551255 25960 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:48.551697 24175 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.551937 25960 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.550410 24810 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:48.554330 25960 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.555845 25960 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.556486 25960 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.551311 25798 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:48.498088 25824 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.564375 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.576932 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.498586 25863 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.509107 25861 consensus_queue.cc:1243] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:17:48.594174 24175 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:48.597707 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:48.598594 24170 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.600224 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.602252 24246 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:48.602305 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:48.601598 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.604554 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.607756 25798 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.606477 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.609675 25750 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:48.610216 25750 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:48.610505 24175 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:48.610767 25750 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.612277 24175 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:48.614234 24175 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:48.616794 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.623168 25798 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:48.623870 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.623982 25798 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:48.570787 25651 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.625870 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:48.629607 24246 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:48.539009 25751 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.562170 25952 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.608377 25937 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.585289 25938 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.633201 25770 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:48.636651 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.644991 24175 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:17:48.647543 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:48.648329 24246 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:48.648396 24216 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.649433 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:48.650403 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.647133 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.654541 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:48.655820 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:48.657003 24101 raft_consensus.cc:2410] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:17:48.655548 24098 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
W20260709 12:17:48.658818 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56613.5us
I20260709 12:17:48.660221 24067 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.661260 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.661916 24170 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:48.662493 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.663208 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:48.664374 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.665573 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.665791 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:48.669221 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.671204 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:48.673724 24175 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.673810 24067 leader_election.cc:400] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
I20260709 12:17:48.674391 24067 leader_election.cc:403] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:48.674265 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:48.680203 25965 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.680450 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.685956 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.687882 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:48.633947 25750 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.667342 25770 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:48.658152 25861 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.675858 25936 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:48.693005 25962 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.677280 25797 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:48.672943 25924 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:48.683789 25916 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
I20260709 12:17:48.717649 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.695176 25940 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:48.669942 25909 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:48.668503 25767 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:48.692433 25950 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:48.677899 25773 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:48.706737 24067 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:48.707865 25936 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.733525 24247 raft_consensus.cc:2410] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:48.691452 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:48.701465 25920 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:17:48.714844 25770 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:48.715118 25797 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:48.727849 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.719460 25957 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:17:48.730960 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:48.714533 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1013) took 1145 ms. Trace:
I20260709 12:17:48.738090 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1446) took 1615 ms. Trace:
I20260709 12:17:48.741683 24245 rpcz_store.cc:276] 0709 12:17:47.568696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.721757 (+153061us) service_pool.cc:224] Handling call
0709 12:17:47.722174 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:47.745816 (+ 23642us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:47.745870 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:48.596626 (+850756us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b2c000970b8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2
0709 12:17:48.625345 (+ 28719us) log.cc:844] Serialized 26 byte log entry
0709 12:17:48.696409 (+ 71064us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:48.696506 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.696589 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.714053 (+ 17464us) raft_consensus.cc:1685] finished
0709 12:17:48.714091 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:48.714458 (+   367us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23146,"raft.queue_time_us":24695,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":21015,"spinlock_wait_cycles":3540224,"thread_start_us":69410,"threads_started":1,"wal-append.queue_time_us":85213}
I20260709 12:17:48.732791 25790 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:48.734220 24067 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:48.720377 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 120535us
I20260709 12:17:48.716843 25962 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.716900 25924 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:48.743484 24095 rpcz_store.cc:276] 0709 12:17:47.122620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.138854 (+ 16234us) service_pool.cc:224] Handling call
0709 12:17:47.139291 (+   437us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.128363 (+989072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:48.737790 (+609427us) spinlock_profiling.cc:243] Waited 988 ms on lock 0x7b540011a654. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:48.738014 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2272699136}
I20260709 12:17:48.732357 24175 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:48.747972 24141 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:48.709380 25861 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.726141 25661 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:48.734728 25936 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:48.734700 25950 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:48.755429 25950 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.737563 25963 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:48.739578 25940 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:48.753021 24141 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:48.754576 25939 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:48.756704 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:48.748245 25473 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.760143 25939 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:48.750398 25773 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:48.760589 25939 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.760483 25473 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.761075 25773 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:48.762138 25773 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.763024 25473 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:48.741501 25797 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.732620 25767 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.743410 25824 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:48.746368 24092 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:48.737810 25975 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.759102 25951 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:48.718019 25798 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.759094 24244 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:48.756665 25920 consensus_queue.cc:1059] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:17:48.750607 25924 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:48.746881 25790 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:48.757544 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:48.770131 25880 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:48.764598 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:48.769883 25770 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.759081 25937 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.756425 25918 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:17:48.756260 25772 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:17:48.772229 25750 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:48.764715 25960 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.790904 25951 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:48.777199 25860 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:48.777650 25916 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:48.779201 25957 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.743088 24093 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:48.786644 25621 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:48.791857 24812 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:48.792781 25413 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.775712 25963 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:48.833506 25413 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.833338 25957 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.806504 24066 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:48.773345 25940 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.804481 25965 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.801496 25790 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.787863 25473 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:17:48.784750 25906 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.834143 25963 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:48.783174 25824 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.810312 25880 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:48.839677 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:48.840683 25918 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.843631 25962 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.846300 24815 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:48.835547 25965 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.860864 25920 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:48.853610 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:48.837354 25860 raft_consensus.cc:697] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:48.841002 25916 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:48.887326 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 102417us
I20260709 12:17:48.795321 25975 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.852470 25906 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.836447 25621 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.889024 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.906968 25793 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:48.923985 25793 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:48.896310 25951 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.945932 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:48.920542 25943 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:48.948372 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 108818us
I20260709 12:17:48.947871 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:48.934799 25881 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:48.945825 25861 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:48.950767 25865 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:48.966946 25942 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:48.992755 25975 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.947742 25860 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:48.998245 25942 raft_consensus.cc:697] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:48.935961 25880 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.002368 25965 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:48.971310 25916 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.012859 25865 consensus_queue.cc:1059] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:17:49.032797 25865 raft_consensus.cc:3055] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:49.033267 25865 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:49.034631 24167 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:49.030261 25911 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.168s	user 0.004s	sys 0.002s
I20260709 12:17:49.045508 25942 consensus_queue.cc:237] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.046304 25666 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:49.051476 25844 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.052136 25844 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.043493 25621 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:49.053781 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.064895 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:49.071053 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:49.037514 25880 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:49.066112 25881 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.046871 25666 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:49.074395 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 963) took 1372 ms. Trace:
I20260709 12:17:49.075243 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:49.090468 24101 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:49.034363 25865 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:49.091759 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:49.095901 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 349841us
I20260709 12:17:49.111580 24215 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:49.118177 24215 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:49.113857 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:49.112231 24216 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:49.128798 25924 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.153715 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.155730 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:49.122687 25865 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:49.159416 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1308) took 2985 ms. Trace:
I20260709 12:17:49.093771 25881 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:49.133841 25863 consensus_meta.cc:287] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.540s	user 0.016s	sys 0.000s
I20260709 12:17:49.161310 24099 rpcz_store.cc:276] 0709 12:17:46.173654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:46.174164 (+   510us) service_pool.cc:224] Handling call
0709 12:17:46.174669 (+   505us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:46.349781 (+175112us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:46.349830 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:46.395970 (+ 46140us) log.cc:844] Serialized 52 byte log entry
0709 12:17:47.274971 (+879001us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:47.321449 (+ 46478us) log.cc:844] Serialized 14 byte log entry
0709 12:17:47.322002 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:47.504302 (+182300us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54002d6ed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:47.504454 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:48.969938 (+1465484us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:49.159133 (+189195us) raft_consensus.cc:1685] finished
0709 12:17:49.159161 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.159339 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25349,"prepare.queue_time_us":45900,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":235,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":4720,"spinlock_wait_cycles":417997824,"thread_start_us":846438,"threads_started":1,"wal-append.queue_time_us":1278473}
I20260709 12:17:49.162128 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:49.153061 25793 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:49.122951 25936 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:49.092583 24167 rpcz_store.cc:276] 0709 12:17:47.701554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.240679 (+539125us) service_pool.cc:224] Handling call
0709 12:17:49.034053 (+793374us) spinlock_profiling.cc:243] Waited 7.23 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:49.034374 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:49.041727 (+  7353us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.066540 (+ 24813us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16625024}
I20260709 12:17:49.177285 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.167130 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:49.195092 24101 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:17:49.212827 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:49.179035 25924 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.185597 25926 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:49.260959 24066 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:49.247834 25844 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.265260 25981 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:49.296449 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:49.298105 25773 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:49.299059 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:49.257882 25924 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:49.299676 25844 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:49.334148 24175 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:49.247335 25986 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:49.259128 25950 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.236805 25983 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.121s
I20260709 12:17:49.369954 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.375769 24100 raft_consensus.cc:2410] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:49.369954 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:49.376592 24171 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:49.355386 25924 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:49.424546 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:49.425647 24100 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:49.429544 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:49.480079 25936 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:49.483994 24171 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:49.500253 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:49.451900 25881 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:49.488667 25939 consensus_meta.cc:287] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.727s	user 0.015s	sys 0.003s
I20260709 12:17:49.485067 25943 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:49.523316 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 411155us
W20260709 12:17:49.496896 25963 consensus_meta.cc:287] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.637s	user 0.016s	sys 0.000s
I20260709 12:17:49.525054 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:49.530550 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:49.500614 25924 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.532388 24172 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:49.547113 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:49.549409 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:49.550222 24246 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:49.533995 25951 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:49.538578 25936 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:17:49.533210 25963 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.522645 25939 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.545535 25943 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:49.562150 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 957) took 1862 ms. Trace:
I20260709 12:17:49.569651 24246 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:49.569481 24174 rpcz_store.cc:276] 0709 12:17:47.699983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.263683 (+563700us) service_pool.cc:224] Handling call
0709 12:17:48.264181 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:48.350841 (+ 86660us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:48.350875 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:48.351471 (+   596us) log.cc:844] Serialized 26 byte log entry
0709 12:17:48.937657 (+586186us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b18000cb800. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:17:49.182865 (+245208us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:49.182931 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.183061 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.559790 (+376729us) raft_consensus.cc:1685] finished
0709 12:17:49.559827 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.562068 (+  2241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70165,"raft.queue_time_us":102212,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":10348,"spinlock_wait_cycles":13540736,"thread_start_us":244775,"threads_started":1,"wal-append.queue_time_us":996536}
I20260709 12:17:49.571766 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:49.572960 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:49.546161 25983 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:49.574959 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:49.575953 25963 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:49.558813 26001 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.577474 26001 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.578862 25953 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:49.577461 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:49.586301 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 468176us
I20260709 12:17:49.586781 24098 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:49.587311 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:49.587574 24215 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:49.591018 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:49.574448 25983 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.592950 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:49.593972 24246 raft_consensus.cc:2410] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:49.559691 25951 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:49.572253 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1288) took 1013 ms. Trace:
I20260709 12:17:49.579401 25953 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:49.568943 25943 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:17:49.599767 25993 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.173s	user 0.000s	sys 0.002s
I20260709 12:17:49.559924 25942 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:17:49.605644 25986 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.590780 25860 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:49.594563 25950 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.596865 25951 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:49.614653 25666 consensus_meta.cc:287] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.519s	user 0.016s	sys 0.002s
I20260709 12:17:49.600414 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:49.609030 25943 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:49.641397 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 104526us
I20260709 12:17:49.646819 25975 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:49.641049 25666 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:49.649497 25998 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.191s	user 0.000s	sys 0.002s
I20260709 12:17:49.656672 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.653803 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.620366 25942 consensus_queue.cc:1243] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:17:49.635973 25797 consensus_meta.cc:287] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.854s	user 0.016s	sys 0.001s
I20260709 12:17:49.639057 25963 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:49.642879 25790 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.791s	user 0.014s	sys 0.002s
I20260709 12:17:49.659560 24101 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:49.641111 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1011) took 2073 ms. Trace:
I20260709 12:17:49.649629 25666 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:49.623641 25986 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.649539 25953 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.663236 25881 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.691815 24100 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:17:49.668538 25770 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:49.679138 24242 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:49.674656 26015 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.672008 26003 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:49.707041 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:49.669052 25797 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.670497 25963 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.719166 25953 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:49.720870 25963 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:49.598476 24244 rpcz_store.cc:276] 0709 12:17:48.548731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.828501 (+279770us) service_pool.cc:224] Handling call
0709 12:17:48.870931 (+ 42430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:48.903999 (+ 33068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:48.904053 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:48.904820 (+   767us) log.cc:844] Serialized 26 byte log entry
0709 12:17:49.196669 (+291849us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:49.196750 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.196888 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.537352 (+340464us) raft_consensus.cc:1685] finished
0709 12:17:49.537434 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.561766 (+ 24332us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":12780,"thread_start_us":279874,"threads_started":1,"wal-append.queue_time_us":534457}
I20260709 12:17:49.723663 25983 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.724399 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:49.725449 24244 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:49.726040 25986 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.726511 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:49.710530 26015 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.746107 25951 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:49.726649 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.726819 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.751996 26015 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:49.752815 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:49.754299 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1273) took 1231 ms. Trace:
I20260709 12:17:49.757151 25797 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.756783 24243 rpcz_store.cc:276] 0709 12:17:48.522901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.523124 (+   223us) service_pool.cc:224] Handling call
0709 12:17:49.752560 (+1229436us) spinlock_profiling.cc:243] Waited 1.81 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456e9c 00007f4c02456a5b 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:49.754216 (+  1656us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4169600}
I20260709 12:17:49.675468 24241 rpcz_store.cc:276] 0709 12:17:47.567536 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.568425 (+   889us) service_pool.cc:224] Handling call
0709 12:17:48.918932 (+1350507us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:48.939137 (+ 20205us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.961782 (+ 22645us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:17:49.353059 (+391277us) log.cc:844] Serialized 14 byte log entry
0709 12:17:49.603982 (+250923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:49.604070 (+    88us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:49.616322 (+ 12252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.619862 (+  3540us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.638802 (+ 18940us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12084,"prepare.queue_time_us":433511,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":10842,"raft.queue_time_us":20990,"raft.run_wall_time_us":18277,"spinlock_wait_cycles":23159040,"thread_start_us":534074,"threads_started":2,"wal-append.queue_time_us":256057}
W20260709 12:17:49.731649 26006 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:17:49.767148 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:49.731858 26008 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:17:49.733103 26007 log.cc:927] Time spent T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:17:49.768888 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:49.769150 25816 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.769758 24244 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:49.712401 26001 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.675164 25790 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.734843 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1457) took 1866 ms. Trace:
I20260709 12:17:49.736148 25939 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.783434 24094 rpcz_store.cc:276] 0709 12:17:47.868092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.387122 (+519030us) service_pool.cc:224] Handling call
0709 12:17:49.733985 (+1346863us) spinlock_profiling.cc:243] Waited 3.02 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:49.734252 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:49.734482 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:49.734508 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:49.734555 (+    47us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:49.734583 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.734643 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.734772 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6939904}
I20260709 12:17:49.737447 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.743932 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:49.712705 26003 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.698909 25881 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:49.713677 25865 consensus_meta.cc:287] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.550s	user 0.016s	sys 0.003s
I20260709 12:17:49.761927 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 116) took 1177 ms. Trace:
I20260709 12:17:49.770114 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:49.772258 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:49.773216 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:49.698200 26004 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:17:49.781771 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:49.798439 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:49.801756 26012 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:49.803192 26011 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:49.801791 25880 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.707s	user 0.015s	sys 0.001s
I20260709 12:17:49.802114 24806 raft_consensus.cc:2410] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:49.791265 24248 rpcz_store.cc:276] 0709 12:17:48.584162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.002755 (+418593us) service_pool.cc:224] Handling call
0709 12:17:49.004519 (+  1764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:49.005071 (+   552us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:49.488212 (+483141us) log.cc:844] Serialized 14 byte log entry
0709 12:17:49.657793 (+169581us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:49.664557 (+  6764us) log.cc:844] Serialized 26 byte log entry
0709 12:17:49.664741 (+   184us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:49.667157 (+  2416us) log.cc:844] Serialized 14 byte log entry
0709 12:17:49.667490 (+   333us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.667608 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.761484 (+ 93876us) raft_consensus.cc:1685] finished
0709 12:17:49.761517 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.761829 (+   312us) inbound_call.cc:177] Queueing success response
0709 12:17:49.766768 (+  4939us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b1800306e80. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
Metrics: {"prepare.queue_time_us":448181,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":121,"raft.queue_time_us":1130,"raft.run_cpu_time_us":566,"raft.run_wall_time_us":9123,"spinlock_wait_cycles":5552896,"thread_start_us":598325,"threads_started":2,"wal-append.queue_time_us":184984}
I20260709 12:17:49.795305 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:49.820629 24812 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:49.822472 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:49.797132 25953 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:49.779271 24811 consensus_queue.cc:237] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:49.799074 24241 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:49.815553 25860 raft_consensus.cc:697] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:49.824502 24242 raft_consensus.cc:2410] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:49.846333 25860 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.847023 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.856076 25748 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:49.858935 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 131) took 1204 ms. Trace:
I20260709 12:17:49.859697 24092 rpcz_store.cc:276] 0709 12:17:48.654415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.666698 (+ 12283us) service_pool.cc:224] Handling call
0709 12:17:48.715427 (+ 48729us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.781049 (+ 65622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.858590 (+1077541us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b540028a854. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:49.858847 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34320128}
I20260709 12:17:49.862066 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1280) took 1318 ms. Trace:
I20260709 12:17:49.862586 24247 rpcz_store.cc:276] 0709 12:17:48.543928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.544057 (+   129us) service_pool.cc:224] Handling call
0709 12:17:49.861814 (+1317757us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54001dd8d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:49.861974 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":432820608}
I20260709 12:17:49.837149 25751 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 12:17:49.885402 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 115443us
I20260709 12:17:49.886822 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:49.880003 25951 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:49.889663 25880 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:49.890897 25865 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:49.902838 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:49.859014 25943 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:49.908996 24248 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:49.898275 26003 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.900503 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:49.928277 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:49.930111 24099 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:49.906143 25865 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:49.934446 25881 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.947875 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 118) took 2455 ms. Trace:
I20260709 12:17:49.948431 24096 rpcz_store.cc:276] 0709 12:17:47.492611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.492804 (+   193us) service_pool.cc:224] Handling call
0709 12:17:47.497095 (+  4291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:48.540568 (+1043473us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.947462 (+1406894us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540011b054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:49.947783 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2397818752}
I20260709 12:17:49.908420 25790 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:49.960579 25413 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:49.962488 25943 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:49.968562 24096 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:49.969264 24167 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:49.964246 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1286) took 1416 ms. Trace:
I20260709 12:17:49.964942 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:49.971413 26011 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:49.907564 25880 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:49.973419 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:49.970321 24245 rpcz_store.cc:276] 0709 12:17:48.548115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.743887 (+195772us) service_pool.cc:224] Handling call
0709 12:17:49.736102 (+992215us) spinlock_profiling.cc:243] Waited 3.69 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:49.739852 (+  3750us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:49.740301 (+   449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:49.740333 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:49.768684 (+ 28351us) log.cc:844] Serialized 26 byte log entry
0709 12:17:49.854099 (+ 85415us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:49.854147 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.854246 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:49.963911 (+109665us) raft_consensus.cc:1685] finished
0709 12:17:49.963936 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:49.964175 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17775,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"spinlock_wait_cycles":8495360,"thread_start_us":84776,"threads_started":1,"wal-append.queue_time_us":136735}
I20260709 12:17:49.974546 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:49.948348 25865 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:49.983645 25880 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:49.972626 26011 raft_consensus.cc:3055] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:49.986161 26011 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:49.987272 26011 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:49.989012 26011 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:49.991583 25943 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:49.997344 25943 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:49.998045 25943 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:50.002249 25943 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:50.002485 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:50.005122 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 958) took 2304 ms. Trace:
I20260709 12:17:50.005587 24168 rpcz_store.cc:276] 0709 12:17:47.700263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.026508 (+326245us) service_pool.cc:224] Handling call
0709 12:17:48.049024 (+ 22516us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:48.052759 (+  3735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:48.052796 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:48.073277 (+ 20481us) log.cc:844] Serialized 26 byte log entry
0709 12:17:49.729374 (+1656097us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b1800142180. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:17:49.854494 (+125120us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:49.854536 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.854860 (+   324us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:50.004767 (+149907us) raft_consensus.cc:1685] finished
0709 12:17:50.004797 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.005042 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3260,"raft.queue_time_us":132886,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":15816,"spinlock_wait_cycles":27831168,"thread_start_us":124915,"threads_started":1,"wal-append.queue_time_us":1803531}
I20260709 12:17:49.997449 24244 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
W20260709 12:17:50.009645 25923 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 2.147s	user 0.009s	sys 0.001s
I20260709 12:17:50.016850 24810 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:50.017668 24810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 263) took 1275 ms. Trace:
I20260709 12:17:50.018021 24810 rpcz_store.cc:276] 0709 12:17:48.742424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.745928 (+  3504us) service_pool.cc:224] Handling call
0709 12:17:50.016174 (+1270246us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:50.016425 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:50.017367 (+   942us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.017600 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8526208}
I20260709 12:17:50.024263 24067 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:50.028435 24067 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:50.029345 25669 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:50.029464 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:50.029805 25669 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.030257 25669 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.030850 24813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 260) took 2701 ms. Trace:
I20260709 12:17:50.031476 25880 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.032182 25880 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:50.031313 24813 rpcz_store.cc:276] 0709 12:17:47.328969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.329931 (+   962us) service_pool.cc:224] Handling call
0709 12:17:47.330275 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.005411 (+675136us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:48.016841 (+ 11430us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:48.023629 (+  6788us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:48.028270 (+  4641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.030496 (+2002226us) spinlock_profiling.cc:243] Waited 83.1 ms on lock 0x7b54006cf554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:50.030555 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.030735 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":155870,"raft.run_cpu_time_us":3615,"raft.run_wall_time_us":30363,"spinlock_wait_cycles":191224704,"thread_start_us":496182,"threads_started":1}
I20260709 12:17:50.033188 25999 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.033618 25999 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.033880 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1015) took 2374 ms. Trace:
I20260709 12:17:50.034080 25999 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.032725 25865 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.034339 24250 rpcz_store.cc:276] 0709 12:17:47.660030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.757414 (+ 97384us) service_pool.cc:224] Handling call
0709 12:17:47.757740 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.237384 (+479644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.033548 (+1796164us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b5400359dd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:50.033764 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1101328256}
I20260709 12:17:50.036531 25747 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:50.037150 25747 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:50.040356 25747 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:50.032636 25880 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.043126 25777 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:50.045907 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.046067 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:50.049351 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:50.013717 25956 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.362s	user 0.043s	sys 0.038s
W20260709 12:17:50.055168 25946 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.630s	user 0.003s	sys 0.003s
I20260709 12:17:50.059806 24169 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:50.062083 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:50.062829 24169 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:50.065044 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:50.064666 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:50.066349 24169 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:50.066251 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.067329 24172 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:50.067771 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.067916 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:50.068128 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:50.068378 24168 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.068472 24169 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:50.071249 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.072196 24167 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:50.073419 24167 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:50.074034 26001 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:50.065505 26031 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:17:50.077050 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.078517 25958 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:50.090499 25958 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:50.057942 25946 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.634s	user 0.003s	sys 0.003s
I20260709 12:17:50.083006 24174 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:50.100569 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.101801 24174 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:50.103026 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:50.103780 24174 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:50.104604 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:50.105015 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:50.105952 26001 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:50.057214 25956 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.408s	user 0.044s	sys 0.038s
I20260709 12:17:50.092243 24172 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.056766 25936 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:50.120409 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:50.121565 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.121902 24067 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:50.111405 24216 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:50.123651 26001 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.124275 26001 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:50.124693 26001 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.125197 25777 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:50.125386 26031 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:50.126164 25777 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:50.126543 25777 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:50.126623 26031 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.127213 26031 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.127660 26031 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.129491 25963 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:50.116833 25994 raft_consensus.cc:3055] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:50.129926 25963 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:50.130060 25994 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:50.131148 25994 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.131215 25963 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.132628 25994 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.132999 25963 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.134294 26001 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.127599 25777 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.136170 25777 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.135977 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.137187 25965 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:50.137790 25965 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:50.138083 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:50.138307 25965 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.140075 26001 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:50.123617 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:50.143770 24174 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:50.091600 25958 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.145769 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:50.146669 24174 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:50.148154 24174 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:50.150036 25865 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:50.151437 26026 log.cc:927] Time spent T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:17:50.151659 24092 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:17:50.152988 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:50.156071 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:50.157979 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:50.167531 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:50.168478 24247 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.169703 24172 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:50.157526 26001 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.158562 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.174288 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.177911 25504 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.178496 25504 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.179526 25942 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.180047 25942 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.181300 25504 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:50.145664 25936 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:50.162128 26003 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.184968 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:50.162003 25798 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:50.153317 25666 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:17:50.195259 24174 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:17:50.197073 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.158639 25816 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:17:50.175132 25958 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.184844 26001 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:50.182628 25942 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.212301 25936 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.190935 26003 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.193543 25798 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:50.200467 25790 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:17:50.226239 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.239564 24168 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:50.226853 24247 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:50.234730 24099 raft_consensus.cc:2376] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5. Re-sending same reply.
W20260709 12:17:50.246281 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 67730us
I20260709 12:17:50.229496 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.216830 26001 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.241897 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.230351 25798 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.220106 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.224784 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.227795 26003 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.254654 24094 raft_consensus.cc:2410] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:17:50.256733 24100 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:50.200941 25999 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.258059 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:50.258227 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:50.262437 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.273205 24101 raft_consensus.cc:2393] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:17:50.267812 26033 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:17:50.268814 25880 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.252830 25790 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:50.267640 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.281395 24100 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:50.274049 24099 raft_consensus.cc:2376] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5. Re-sending same reply.
I20260709 12:17:50.254045 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.285893 24214 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:50.262939 25771 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 12:17:50.288198 25771 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:50.288661 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 133) took 1333 ms. Trace:
I20260709 12:17:50.289095 24095 rpcz_store.cc:276] 0709 12:17:48.955734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.955953 (+   219us) service_pool.cc:224] Handling call
0709 12:17:48.956442 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:50.287223 (+1330781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:50.287260 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:50.287301 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:50.287344 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.288396 (+  1052us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540011bf54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:50.288446 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.288593 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3059985792}
I20260709 12:17:50.297660 25767 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.299530 25790 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.275781 25495 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:50.303527 25680 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:50.304082 25680 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:50.304150 25495 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:50.305575 25495 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.305160 25680 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:50.307806 24249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1266) took 2701 ms (client timeout 1568 ms). Trace:
W20260709 12:17:50.308243 24249 rpcz_store.cc:269] 0709 12:17:47.606852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:47.651022 (+ 44170us) service_pool.cc:224] Handling call
0709 12:17:50.298787 (+2647765us) spinlock_profiling.cc:243] Waited 856 ms on lock 0x7b54003d9354. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:50.298976 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1969017216}
W20260709 12:17:50.332595 26035 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:17:50.333202 25999 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.334221 25956 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.334849 25956 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.335462 25669 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:50.338259 26034 log.cc:927] Time spent T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:17:50.274658 24244 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:50.353926 24244 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:50.358596 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.362293 25965 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.363209 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.363941 24096 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:50.365057 25669 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.365324 25965 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.315668 25680 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.366127 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 970) took 2473 ms. Trace:
I20260709 12:17:50.366510 24176 rpcz_store.cc:276] 0709 12:17:47.892274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.406306 (+514032us) service_pool.cc:224] Handling call
0709 12:17:48.414759 (+  8453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:48.536867 (+122108us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.365840 (+1828973us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540009f454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:50.366058 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278631808}
I20260709 12:17:50.350541 24174 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:50.375559 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:50.376483 25880 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.377004 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:50.378122 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:50.379678 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 967) took 2507 ms. Trace:
I20260709 12:17:50.380069 24173 rpcz_store.cc:276] 0709 12:17:47.872613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.389110 (+516497us) service_pool.cc:224] Handling call
0709 12:17:48.389462 (+   352us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.456928 (+ 67466us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:48.456969 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:48.457023 (+    54us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:48.457061 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.379415 (+1922354us) spinlock_profiling.cc:243] Waited 49.3 ms on lock 0x7b54003b1854. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:50.379471 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.379612 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17704,"raft.queue_time_us":26221,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":152,"spinlock_wait_cycles":113365760}
I20260709 12:17:50.388787 25936 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.389277 25936 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:50.389704 25936 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:50.404032 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.418675 24066 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:50.414209 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:50.422482 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:50.425405 25955 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 2.019s	user 0.003s	sys 0.000s
I20260709 12:17:50.426548 25985 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:50.432164 25981 raft_consensus.cc:3055] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:50.404805 26011 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:17:50.436096 25957 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.440608 26003 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.392184 25816 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:50.446799 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:50.476141 25790 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:50.484608 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 88513us
I20260709 12:17:50.485103 26051 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:17:50.490659 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 204860us
I20260709 12:17:50.447788 25865 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.500320 25958 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:50.502415 25981 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:50.518062 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:50.505115 24808 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:50.513947 26011 raft_consensus.cc:3055] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:50.513247 25816 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:50.515808 24813 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:50.644814 24244 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:50.465204 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.530712 25504 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:50.652662 24168 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:50.652981 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.652545 25504 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.656405 25748 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:50.657183 25504 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.642967 24250 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:50.657992 25748 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.551741 25816 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:50.571594 25936 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:50.659142 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:50.527990 25876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.020s	sys 0.043s
I20260709 12:17:50.659904 25971 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:50.575100 25975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.011s	sys 0.024s
I20260709 12:17:50.661243 24249 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:50.558177 25981 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.518065 25790 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.540273 25798 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.531507 25803 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:50.549937 25824 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:50.523182 25865 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:50.550431 26001 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.560396 26003 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:50.533742 26011 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:50.571990 26031 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.676687 26051 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:17:50.710813 25803 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:17:50.711529 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 60549.1us
I20260709 12:17:50.657897 24214 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:50.680182 24250 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:50.683305 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:50.685007 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1464) took 1615 ms. Trace:
I20260709 12:17:50.689467 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 998) took 1390 ms. Trace:
I20260709 12:17:50.692746 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.671150 24244 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:50.706297 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.709563 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:50.730314 24241 raft_consensus.cc:2376] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5. Re-sending same reply.
I20260709 12:17:50.731334 24807 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.736570 25958 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:50.737761 25865 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:50.737584 25958 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.738970 25957 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:50.741146 25957 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:50.744464 24249 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: [2.2-4.3]
I20260709 12:17:50.729249 24815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 258) took 1914 ms. Trace:
I20260709 12:17:50.709424 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:50.716081 24098 rpcz_store.cc:276] 0709 12:17:49.069871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.070622 (+   751us) service_pool.cc:224] Handling call
0709 12:17:50.684369 (+1613747us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54001f54d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:50.684703 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148012800}
I20260709 12:17:50.705910 24243 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:50.759199 25975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.098s	user 0.012s	sys 0.024s
I20260709 12:17:50.753690 25777 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:50.760243 25971 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.761518 25777 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:50.762373 25748 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:50.763041 26057 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.073s	user 0.000s	sys 0.002s
I20260709 12:17:50.734580 25798 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:50.716208 24171 rpcz_store.cc:276] 0709 12:17:49.303848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.534863 (+231015us) service_pool.cc:224] Handling call
0709 12:17:50.687812 (+1152949us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:50.688305 (+   493us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:50.688675 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:50.688709 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:50.688812 (+   103us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:50.688856 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.688929 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:50.689182 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2695552}
I20260709 12:17:50.745896 24815 rpcz_store.cc:276] 0709 12:17:48.806281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.806451 (+   170us) service_pool.cc:224] Handling call
0709 12:17:48.809685 (+  3234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:48.862082 (+ 52397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:50.714607 (+1852525us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b54005e01d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:50.720085 (+  5478us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83566848}
I20260709 12:17:50.752238 24245 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:50.753705 26001 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:50.753957 25876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.152s	user 0.022s	sys 0.045s
I20260709 12:17:50.713263 25803 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.755374 25824 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:50.756129 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.770630 25504 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:50.772831 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:50.780800 25957 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:50.783742 25936 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:50.787216 24247 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
W20260709 12:17:50.794317 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 136908us
I20260709 12:17:50.795397 24250 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:50.795732 24214 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:50.796981 25803 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.797721 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:50.797982 25956 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.792174 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:50.799361 25824 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:50.802472 24813 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:50.802744 25985 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:50.803355 25985 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:50.804175 24250 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:50.805160 25985 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:50.806596 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 97697.8us
I20260709 12:17:50.806773 25747 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:50.807710 25816 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:17:50.810550 24098 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.822078 24244 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:50.823671 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.824594 24241 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:50.824925 24243 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:50.826042 25985 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.826439 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.826892 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.827335 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:50.827625 24249 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:50.828262 24093 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.828974 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.829887 24249 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:50.833159 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:50.833739 24245 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:50.834699 25798 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:50.835577 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.802531 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.839455 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:50.840586 24097 raft_consensus.cc:2410] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:50.841054 24250 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 5. Ops: [3.2-3.2]
W20260709 12:17:50.842859 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 96292.1us
I20260709 12:17:50.845302 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.846565 24095 raft_consensus.cc:2393] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:50.846374 25413 consensus_queue.cc:1059] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:50.847538 25413 raft_consensus.cc:3055] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:50.847960 25413 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:50.849095 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.849278 25413 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.851794 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:50.854239 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.855448 24101 raft_consensus.cc:2410] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:50.855876 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.859246 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.871439 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.826726 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:50.887504 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 90133.7us
I20260709 12:17:50.890080 24247 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:50.890784 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:50.892204 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.893098 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:50.893841 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:50.894750 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.895979 25413 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.894667 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:50.861267 24807 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:50.897379 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.903662 24098 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:50.906802 24214 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:50.862574 25936 raft_consensus.cc:2764] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:50.911619 24172 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:17:50.918707 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.916193 25958 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:50.916817 26053 log.cc:927] Time spent T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
I20260709 12:17:50.917220 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.919409 24243 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 5: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:50.924216 24247 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:50.925042 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.927456 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:50.928399 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.928853 24807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 265) took 2184 ms. Trace:
I20260709 12:17:50.928936 24249 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:17:50.914779 24097 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:50.939400 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:50.939976 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.940191 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.941035 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:50.941481 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.941783 24241 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:50.942173 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.938015 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:50.943684 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 106839us
I20260709 12:17:50.944376 25999 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:50.945127 25999 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.945665 25680 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:50.946285 25772 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:50.946785 25669 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:50.947341 25669 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:50.947182 25772 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.947767 25669 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.949810 25772 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.953999 25844 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:50.955888 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.952013 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.956297 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.956947 24243 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:50.957135 24169 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:50.950160 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.943784 24815 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
W20260709 12:17:50.939046 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 44571.6us
I20260709 12:17:50.938295 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:50.953428 26061 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.226s	user 0.000s	sys 0.002s
I20260709 12:17:50.950938 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:50.936980 24249 pending_rounds.cc:85] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 2
I20260709 12:17:50.945741 26031 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.953241 24174 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:50.964704 24245 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:50.960073 26017 log.cc:927] Time spent T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 1.107s	user 0.006s	sys 0.000s
I20260709 12:17:50.904534 25971 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.966879 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:50.961920 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:50.940653 25957 raft_consensus.cc:2764] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
W20260709 12:17:50.975668 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:50.964385 24249 pending_rounds.cc:107] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:50.976841 24249 raft_consensus.cc:2889] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:50.978142 24250 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:50.978464 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.946628 25680 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.979984 26031 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:50.981351 25680 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:50.981937 25965 raft_consensus.cc:3055] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:50.982395 25965 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:50.936559 24807 rpcz_store.cc:276] 0709 12:17:48.744915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:48.746134 (+  1219us) service_pool.cc:224] Handling call
0709 12:17:50.196399 (+1450265us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:50.709237 (+512838us) spinlock_profiling.cc:243] Waited 8.86 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:50.928743 (+219506us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29421696}
I20260709 12:17:50.983551 25965 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:50.985574 24173 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:50.986387 24214 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:50.986925 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.987375 24243 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 4. Ops: []
I20260709 12:17:50.987789 24173 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:50.988392 24214 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:50.988734 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.989534 26001 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:50.990145 26001 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:50.990440 25881 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:50.991629 26001 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:50.992228 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.993021 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:50.993167 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:50.994521 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:50.934018 25790 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:50.999670 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:50.994868 24168 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:50.958952 25981 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:50.991540 25881 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:51.008924 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:51.009186 24779 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:51.008926 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:51.011518 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:51.014202 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:51.016206 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:51.016285 25956 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:51.017177 24174 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:50.998441 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:51.017843 25926 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:17:51.018625 24100 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:51.019516 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1293) took 1467 ms. Trace:
I20260709 12:17:51.023648 24813 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:51.024492 26012 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:17:51.025746 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:51.026535 24176 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:17:51.014842 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 51360us
I20260709 12:17:51.036818 24246 rpcz_store.cc:276] 0709 12:17:49.551941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.594615 (+ 42674us) service_pool.cc:224] Handling call
0709 12:17:50.832641 (+1238026us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:50.949876 (+117235us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:51.019390 (+ 69514us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14289536}
I20260709 12:17:51.042500 24172 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.045076 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:51.046387 24247 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:51.044524 24169 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:51.049844 24249 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:51.050231 24250 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:51.050266 24173 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:51.053567 25790 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:51.054016 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:51.054513 26031 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:51.055928 26031 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:51.055999 24248 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260709 12:17:51.056419 26031 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:51.056499 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:51.058422 25956 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:51.058568 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49512.3us
I20260709 12:17:51.066464 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:51.068794 26056 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:17:51.068804 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 57473us
I20260709 12:17:51.069705 25816 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:51.070134 25816 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:51.070561 25816 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.059340 25956 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:51.072268 25956 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:51.072558 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 184) took 1414 ms. Trace:
W20260709 12:17:51.059805 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 43834.4us
I20260709 12:17:51.060415 25876 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:51.060518 25999 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.062948 24250 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:51.064245 25957 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:51.065184 25915 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:17:51.088402 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.089159 24249 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:51.057495 26031 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.090957 25957 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:51.091434 25957 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:51.091862 26031 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.092470 25957 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.093951 25957 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.053783 26027 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:51.095460 25772 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:51.095993 25772 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:51.095964 26027 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.073021 24170 rpcz_store.cc:276] 0709 12:17:49.658251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.658438 (+   187us) service_pool.cc:224] Handling call
0709 12:17:49.658846 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:49.674465 (+ 15619us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:49.674887 (+   422us) log.cc:844] Serialized 14 byte log entry
0709 12:17:49.734818 (+ 59931us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:49.747362 (+ 12544us) log.cc:844] Serialized 26 byte log entry
0709 12:17:49.747553 (+   191us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:49.747607 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:49.747695 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:50.038483 (+290788us) spinlock_profiling.cc:243] Waited 5.68 ms on lock 0x7b1800254440. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e522 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:17:50.932674 (+894191us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:51.071986 (+139312us) raft_consensus.cc:1685] finished
0709 12:17:51.072012 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.072318 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2624,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":48372,"raft.run_cpu_time_us":407,"raft.run_wall_time_us":11967,"spinlock_wait_cycles":15427584,"thread_start_us":52128,"threads_started":2,"wal-append.queue_time_us":152527}
I20260709 12:17:51.097342 25772 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.098587 26027 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.075727 25876 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.097378 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:51.102365 24172 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:51.106616 24100 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:51.098783 25772 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:51.110909 25876 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:51.124761 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:51.128165 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:51.130426 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:51.132834 25651 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.133656 25651 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.115871 25777 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:51.144090 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:51.145740 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60082.4us
I20260709 12:17:51.073557 25956 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.153551 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:51.154381 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:51.147089 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:51.156246 24214 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:51.159561 24250 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:51.160075 25881 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.157760 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:51.161010 25881 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.157219 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:51.156560 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 50288.9us
I20260709 12:17:51.175892 25971 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:51.176455 25971 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:51.177565 25971 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.178957 25971 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.180409 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.179556 26056 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:51.181732 26056 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:51.182150 26056 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.182904 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:51.142840 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:51.195749 24214 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:51.199517 24250 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:51.201963 25777 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:51.228323 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:51.229780 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:51.230513 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47807.6us
I20260709 12:17:51.206110 26027 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:17:51.233172 24246 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:51.235435 24246 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:51.207597 24093 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:51.224997 25956 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.247963 24214 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:51.242888 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:51.249605 24100 raft_consensus.cc:2410] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:51.252274 24101 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:51.247291 24246 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.246909 26058 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.261030 24246 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.261248 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:51.262216 25860 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.267987 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:51.268501 24244 raft_consensus.cc:2376] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5. Re-sending same reply.
I20260709 12:17:51.279717 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.280583 24093 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:51.281219 26046 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:51.283722 25942 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.284798 24140 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:51.287712 25942 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.288257 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.289651 25790 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:51.291098 26058 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.293503 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.294057 26058 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.295431 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:51.303591 24141 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:51.304132 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:51.311741 24170 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:51.311954 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1432) took 1215 ms. Trace:
W20260709 12:17:51.312433 26067 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:17:51.253527 26031 consensus_queue.cc:1059] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:17:51.319993 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.320974 25777 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:51.321622 25777 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.331183 24781 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:17:51.331885 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 58600.8us
I20260709 12:17:51.351653 25680 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:51.352037 25939 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:51.352941 25939 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.353835 25958 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:51.354312 25958 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:51.355247 25999 consensus_queue.cc:1059] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:51.355383 25958 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.353070 25680 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:51.401208 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.340149 25942 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:51.349929 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46565.1us
I20260709 12:17:51.347208 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.401801 26058 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:51.366806 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.416402 24067 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:51.382259 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.379978 25866 raft_consensus.cc:3055] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:51.414359 25958 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:51.430034 26068 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:17:51.341382 26051 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:51.342942 24241 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:51.378647 26012 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:48150 (request call id 0) took 2412 ms. Trace:
I20260709 12:17:51.438164 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:51.312585 24167 rpcz_store.cc:276] 0709 12:17:50.096148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.230156 (+134008us) service_pool.cc:224] Handling call
0709 12:17:50.262625 (+ 32469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:50.296074 (+ 33449us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:50.296119 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:50.296828 (+   709us) log.cc:844] Serialized 26 byte log entry
0709 12:17:50.853906 (+557078us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b1800248da0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:17:51.153142 (+299236us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:51.169797 (+ 16655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:51.204241 (+ 34444us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:51.304023 (+ 99782us) raft_consensus.cc:1685] finished
0709 12:17:51.304058 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:51.311682 (+  7624us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3629,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":170,"spinlock_wait_cycles":13641984,"thread_start_us":260785,"threads_started":1,"wal-append.queue_time_us":933458}
W20260709 12:17:51.440519 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.344049 25975 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:17:51.355247 25790 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:51.444489 25963 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.445271 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:51.448822 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:51.449770 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 74923.5us
I20260709 12:17:51.451833 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:51.452471 24170 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.453171 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:51.434959 24141 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:51.358850 25876 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.456243 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:51.457192 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:51.459918 24176 raft_consensus.cc:2393] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:51.396449 25816 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.460887 25748 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.446322 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:51.463703 25880 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:51.464268 25880 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:51.465399 24173 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:51.433660 25939 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:51.466367 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:51.468489 24245 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:51.435775 25803 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:51.432708 25866 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:51.442679 26058 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.446112 25915 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:51.461829 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:51.493357 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:51.437824 26051 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.494908 24066 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:51.509553 25777 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:51.510077 26070 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:17:51.510655 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 98) took 9671 ms. Trace:
I20260709 12:17:51.511536 24168 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:51.491302 26031 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:51.518436 25748 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.519214 25748 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.499050 25963 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.521541 25748 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:51.523197 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50682.4us
I20260709 12:17:51.524173 25495 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:51.525025 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.531679 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:51.462126 26056 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.511106 23996 rpcz_store.cc:276] 0709 12:17:41.704675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.709312 (+  4637us) service_pool.cc:224] Handling call
0709 12:17:41.796211 (+ 86899us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:17:51.361057 (+9564846us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:45.837676 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:45.860035 (+ 22359us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:45.860096 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:17:45.860125 (+    29us) tablet.cc:662] Decoding operations
0709 12:17:45.860750 (+   625us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:45.860843 (+    93us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:45.860896 (+    53us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:17:45.861354 (+   458us) tablet.cc:701] Row locks acquired
0709 12:17:45.861376 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:17:45.861608 (+   232us) write_op.cc:270] Start()
0709 12:17:45.861782 (+   174us) write_op.cc:276] Timestamp: P: 1783599465861538 usec, L: 0
0709 12:17:45.861806 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:17:46.050416 (+188610us) log.cc:844] Serialized 918 byte log entry
0709 12:17:48.491483 (+2441067us) op_driver.cc:464] REPLICATION: finished
0709 12:17:48.606493 (+115010us) write_op.cc:301] APPLY: starting
0709 12:17:48.606598 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:48.606722 (+   124us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:48.606884 (+   162us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:48.607384 (+   500us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:48.607568 (+   184us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:17:48.607611 (+    43us) write_op.cc:312] APPLY: finished
0709 12:17:48.607839 (+   228us) log.cc:844] Serialized 28 byte log entry
0709 12:17:48.608744 (+   905us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.608865 (+   121us) write_op.cc:454] Released schema lock
0709 12:17:48.608915 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:48.610323 (+  1408us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:48.610353 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":17,"spinlock_wait_cycles":37858688,"child_traces":[["op",{"apply.queue_time_us":114724,"apply.run_cpu_time_us":2194,"apply.run_wall_time_us":3806,"num_ops":2,"prepare.queue_time_us":267440,"prepare.run_cpu_time_us":38039,"prepare.run_wall_time_us":1555602,"raft.queue_time_us":77240,"raft.run_cpu_time_us":33532,"raft.run_wall_time_us":118027,"replication_time_us":2629465,"thread_start_us":1380676,"threads_started":4,"wal-append.queue_time_us":1503857,"wal-append.run_cpu_time_us":13313,"wal-append.run_wall_time_us":2037295}]]}
I20260709 12:17:51.470091 26001 raft_consensus.cc:2764] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:17:51.467062 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.529115 24100 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:51.525439 25816 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:51.383524 26011 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.527765 24171 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:51.535365 25803 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.506601 26051 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.562139 24246 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:51.562366 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:51.465647 25880 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.542927 25803 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.547693 25999 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:51.568638 24171 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:51.505748 25790 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:51.578882 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:51.603502 24176 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:51.599784 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:51.617033 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 155291us
I20260709 12:17:51.596573 25999 raft_consensus.cc:697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:51.608124 25957 consensus_meta.cc:287] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.007s
I20260709 12:17:51.443102 26012 rpcz_store.cc:276] 0709 12:17:48.933354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:49.771324 (+837970us) service_pool.cc:224] Handling call
0709 12:17:49.861557 (+ 90233us) log.cc:844] Serialized 501 byte log entry
0709 12:17:50.353204 (+491647us) spinlock_profiling.cc:243] Waited 54.7 ms on lock 0x7b54004db5a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054f0dbe 00007f4c054fb930 00007f4c054fb8d8 00007f4c054fb858 00007f4c054fb813 00007f4c054faa9c 00007f4c0b3e62f6 00007f4c0b3e0aa8 00007f4c055377cb 00007f4c0553a2c0
0709 12:17:51.341825 (+988621us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7249,"raft.queue_time_us":30505,"raft.run_cpu_time_us":1643,"raft.run_wall_time_us":43577,"spinlock_wait_cycles":125825408,"thread_start_us":140468,"threads_started":1,"wal-append.queue_time_us":198107}
W20260709 12:17:51.655751 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 60226.7us
W20260709 12:17:51.684643 26073 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:17:51.685223 26071 log.cc:927] Time spent T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260709 12:17:51.498150 25915 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.569152 25866 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.658289 26058 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.848995 25680 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:51.849419 24100 raft_consensus.cc:2410] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:51.723235 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:51.849809 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:51.570384 25495 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.048s
I20260709 12:17:51.627326 25803 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:51.851610 24098 raft_consensus.cc:2410] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:17:51.851970 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 203734us
I20260709 12:17:51.621547 25939 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:51.855571 24170 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:51.851070 26077 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.852363 25942 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:51.877502 26056 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.878314 25999 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.879802 25866 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.881644 25915 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.882232 25876 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:51.883297 25680 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.851429 26027 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:51.886257 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.889671 24173 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:51.889070 26076 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.882963 24066 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:51.923079 24067 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:17:51.924328 25772 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:51.924903 25772 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.925439 25772 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.912840 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:51.915759 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 285802us
I20260709 12:17:51.904911 24167 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:51.894170 25956 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:51.913863 26080 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.951088 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:51.957006 26080 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:51.958000 25971 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.779s	user 0.006s	sys 0.011s
I20260709 12:17:51.921665 25915 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:17:51.959373 26076 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:51.959524 26080 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:51.959681 25915 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:51.959995 26076 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:51.961277 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 78492.7us
I20260709 12:17:51.921948 25777 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:51.963234 24141 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:51.941977 25939 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.971215 25790 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:51.972738 25413 raft_consensus.cc:3055] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:51.972612 26051 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.973308 25413 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:51.975288 26081 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:51.976035 26081 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:51.977470 25939 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:51.977103 26081 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.921701 25942 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.974303 25413 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.962567 26076 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.983167 24780 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:51.940414 26027 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.982892 25956 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.985663 26051 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.986694 25413 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:51.997618 26075 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.983261 25876 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:51.962880 25495 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:51.999401 25876 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:51.999768 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:52.001925 25876 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:51.996984 25748 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:52.002275 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.002897 25748 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:52.004166 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 53583.1us
I20260709 12:17:52.004994 26085 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:52.005398 25748 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.005916 26046 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:51.965056 25777 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:51.997691 25956 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.004290 25651 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:52.009115 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.005496 26085 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:51.942330 26077 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:52.017318 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48652.1us
I20260709 12:17:52.041945 25772 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.044144 24097 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:52.045220 25772 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:52.033589 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 103761us
W20260709 12:17:52.060493 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.068557 24176 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.079954 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:52.080781 24169 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
W20260709 12:17:52.082384 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 119565us
W20260709 12:17:52.085109 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.084995 24100 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:52.009826 26087 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.011013 25777 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:52.077425 25669 consensus_meta.cc:287] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.129s	user 0.006s	sys 0.017s
I20260709 12:17:52.037070 26085 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.068112 25876 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.091112 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:52.096633 24168 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:52.083590 25958 consensus_meta.cc:287] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.648s	user 0.010s	sys 0.010s
W20260709 12:17:52.078544 25981 consensus_meta.cc:287] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.024s	user 0.011s	sys 0.011s
I20260709 12:17:52.012781 25942 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:52.094159 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 89046.5us
I20260709 12:17:52.096942 24781 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:17:52.112818 24141 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 2.761s (SENT) [suppressed 24 similar messages]
I20260709 12:17:52.115022 25965 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.105430 24092 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:52.102432 26087 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.098798 25669 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.130165 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.141770 24176 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
W20260709 12:17:52.150303 26074 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.581s	user 0.001s	sys 0.003s
I20260709 12:17:52.129177 25981 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:52.155479 25981 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.101668 25876 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.131098 26051 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:52.158509 26051 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.158893 26051 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.160355 25876 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.157950 25981 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:52.131714 25772 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:52.175472 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 62679.4us
I20260709 12:17:52.178062 24141 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.138149 25957 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:52.195449 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 88454.7us
I20260709 12:17:52.181936 25999 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.183130 25680 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:52.230013 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:52.183933 26076 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.235983 26027 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.238345 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:52.219790 26075 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:52.241283 26075 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.199587 25876 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 12:17:52.246399 25669 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:52.247886 26087 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.243794 26075 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.250903 26077 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.233527 25942 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.253103 25942 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.254585 24095 raft_consensus.cc:2410] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:52.256319 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1357) took 1277 ms. Trace:
I20260709 12:17:52.256693 24095 rpcz_store.cc:276] 0709 12:17:50.995307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.030703 (+ 35396us) service_pool.cc:224] Handling call
0709 12:17:52.256035 (+1225332us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540037e454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:52.256249 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2777290496}
I20260709 12:17:52.259491 25777 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:52.260053 25777 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:52.260522 25777 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.258719 24099 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:17:52.261173 24099 pending_rounds.cc:85] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 2
I20260709 12:17:52.261449 24099 pending_rounds.cc:107] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:52.261729 24099 raft_consensus.cc:2889] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:17:52.262682 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 127451us
W20260709 12:17:52.262001 26031 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.017s	sys 0.041s
I20260709 12:17:52.196480 26093 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:17:52.285539 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.301573 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.222926 25999 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.288714 26075 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:17:52.290124 25866 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:52.290819 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
W20260709 12:17:52.284724 26031 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.018s	sys 0.041s
I20260709 12:17:52.290166 24095 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:52.359114 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1496) took 1026 ms. Trace:
I20260709 12:17:52.295922 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:52.306777 24168 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:52.185216 25957 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.368928 24781 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:52.314813 24094 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:52.316941 25844 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:52.326082 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1353) took 1397 ms. Trace:
I20260709 12:17:52.328145 24813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 275) took 1408 ms. Trace:
I20260709 12:17:52.330870 24807 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:52.375011 24099 rpcz_store.cc:276] 0709 12:17:50.929072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.030835 (+101763us) service_pool.cc:224] Handling call
0709 12:17:52.258275 (+1227440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.277170 (+ 18895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.325795 (+ 48625us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540037e450. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:52.325976 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2785758464}
I20260709 12:17:52.333140 24811 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:52.333323 25963 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:52.335587 26079 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.424s	user 0.002s	sys 0.000s
I20260709 12:17:52.335850 24808 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:52.198320 25772 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.343309 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1350) took 1415 ms. Trace:
I20260709 12:17:52.390771 24098 rpcz_store.cc:276] 0709 12:17:50.927769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.936205 (+  8436us) service_pool.cc:224] Handling call
0709 12:17:51.097245 (+161040us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:52.343066 (+1245821us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b54000b9ad4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:52.343230 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294645248}
I20260709 12:17:52.343992 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:52.345577 24092 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1352) took 1417 ms (client timeout 1884 ms). Trace:
I20260709 12:17:52.351625 26101 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:52.353554 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 54170.2us
I20260709 12:17:52.396610 24140 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.359529 24095 rpcz_store.cc:276] 0709 12:17:51.332677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.277416 (+944739us) service_pool.cc:224] Handling call
0709 12:17:52.289914 (+ 12498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.358767 (+ 68853us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.359040 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.372735 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1491) took 1074 ms. Trace:
I20260709 12:17:52.279968 25958 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:17:52.358453 26031 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:52.381844 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1487) took 1088 ms. Trace:
I20260709 12:17:52.354472 26001 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.391414 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.374432 25803 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.404400 26101 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.404786 25803 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:52.393929 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 98172.4us
I20260709 12:17:52.406639 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:52.360318 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:52.407424 24815 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:52.407505 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:52.408259 25963 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:17:52.408691 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:52.409096 26002 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:52.409821 26001 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.397122 25844 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.410898 25942 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.412329 26001 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:52.376617 24813 rpcz_store.cc:276] 0709 12:17:50.919950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.937430 (+ 17480us) service_pool.cc:224] Handling call
0709 12:17:50.976393 (+ 38963us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:51.043006 (+ 66613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.327858 (+1284852us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b540070e9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:52.328067 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44027648}
W20260709 12:17:52.395241 24092 rpcz_store.cc:269] 0709 12:17:50.928631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.937967 (+  9336us) service_pool.cc:224] Handling call
0709 12:17:51.293147 (+355180us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:52.345289 (+1052142us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54002d5fd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:52.345477 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1912988288}
I20260709 12:17:52.414111 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.411847 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.401940 25771 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.390403 26075 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:52.402804 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.418690 26101 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:52.420003 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.420652 24098 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:52.421620 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.422515 25957 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.424197 25680 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:52.424659 25680 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:52.424372 25777 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.395519 25939 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:52.425611 25939 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.425992 25939 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.427369 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:52.403899 24099 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
W20260709 12:17:52.388409 23985 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 97798us
I20260709 12:17:52.412384 25844 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:52.430804 26080 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:52.430572 25771 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.398453 24094 rpcz_store.cc:276] 0709 12:17:51.298391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.282628 (+984237us) service_pool.cc:224] Handling call
0709 12:17:52.314506 (+ 31878us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.372425 (+ 57919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.372666 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.415949 24216 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:52.395960 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1490) took 1098 ms. Trace:
I20260709 12:17:52.400938 24100 rpcz_store.cc:276] 0709 12:17:51.293651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.121683 (+828032us) service_pool.cc:224] Handling call
0709 12:17:52.122184 (+   501us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.122509 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:52.163404 (+ 40895us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.381472 (+218068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.381533 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:52.381577 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.381656 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.381780 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23093,"prepare.queue_time_us":13523,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":25340,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5568,"thread_start_us":234724,"threads_started":2}
I20260709 12:17:52.414811 24092 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:52.417104 26084 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:17:52.417582 26031 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.418649 26075 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:52.439296 26075 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.442314 24815 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:17:52.422816 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.442931 26051 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.443877 25771 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:52.432571 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.445156 24214 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:52.445876 26001 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:52.446079 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:52.446501 26001 raft_consensus.cc:697] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:52.446770 24172 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.434736 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.403366 25866 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:52.448602 25866 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.449134 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:52.449855 25844 consensus_queue.cc:1059] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:52.451172 24095 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:52.451613 25866 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:52.451843 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:52.452702 24101 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.436609 25942 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.436723 25971 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.437870 25772 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.432073 26002 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:52.443324 24098 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:52.447939 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1494) took 1146 ms. Trace:
I20260709 12:17:52.443912 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.470273 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.359773 26085 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.450671 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:52.474784 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.463065 24172 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:17:52.444262 24810 raft_consensus.cc:2368] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
W20260709 12:17:52.478511 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 82004.4us
I20260709 12:17:52.445323 26051 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:52.465322 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49456.1us
I20260709 12:17:52.479803 24140 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.466429 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:52.484007 25771 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:52.469830 24093 rpcz_store.cc:276] 0709 12:17:51.301723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.433876 (+132153us) service_pool.cc:224] Handling call
0709 12:17:52.447646 (+1013770us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b540028c154. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:52.447825 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1388045056}
I20260709 12:17:52.446805 26084 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.470965 24095 raft_consensus.cc:2410] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 6 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:52.486706 26002 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.487593 24095 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:52.487697 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1499) took 1093 ms. Trace:
I20260709 12:17:52.458225 26080 raft_consensus.cc:3055] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:52.472162 24099 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:52.464200 25942 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:52.476753 24097 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1354) took 1547 ms (client timeout 1872 ms). Trace:
I20260709 12:17:52.478744 24781 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:52.484786 25771 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.447647 26001 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.488278 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1500) took 1072 ms. Trace:
I20260709 12:17:52.492164 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1498) took 1145 ms. Trace:
I20260709 12:17:52.504779 24099 rpcz_store.cc:276] 0709 12:17:51.349843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.463890 (+1114047us) service_pool.cc:224] Handling call
0709 12:17:52.471828 (+  7938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.491827 (+ 19999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.492064 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.505924 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:52.491675 24097 rpcz_store.cc:269] 0709 12:17:50.929456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:50.969612 (+ 40156us) service_pool.cc:224] Handling call
0709 12:17:52.002073 (+1032461us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:52.476472 (+474399us) spinlock_profiling.cc:243] Waited 40.8 ms on lock 0x7b5400265cd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:52.476664 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140683776}
I20260709 12:17:52.494225 24095 rpcz_store.cc:276] 0709 12:17:51.418858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.486817 (+1067959us) service_pool.cc:224] Handling call
0709 12:17:52.487247 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:52.488013 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.488223 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.507841 24094 raft_consensus.cc:2410] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:52.432801 24096 rpcz_store.cc:276] 0709 12:17:51.297245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.184239 (+886994us) service_pool.cc:224] Handling call
0709 12:17:52.198130 (+ 13891us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.222515 (+ 24385us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:52.222921 (+   406us) log.cc:844] Serialized 14 byte log entry
0709 12:17:52.394886 (+171965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.395657 (+   771us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:52.395700 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.395776 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.395895 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4591,"prepare.queue_time_us":1138,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":16053,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9284,"thread_start_us":159650,"threads_started":1}
W20260709 12:17:52.499003 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.512952 24101 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:52.508178 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.506842 24099 raft_consensus.cc:2410] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:17:52.498250 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 86492.3us
I20260709 12:17:52.537681 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1489) took 1241 ms. Trace:
I20260709 12:17:52.537607 24246 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:52.542582 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:52.490957 24092 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:52.545600 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:52.549214 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:52.493892 23995 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 2 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.549906 24248 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.538775 24101 rpcz_store.cc:276] 0709 12:17:51.296172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.441793 (+145621us) service_pool.cc:224] Handling call
0709 12:17:52.451683 (+1009890us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:52.537577 (+ 85894us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12888320}
I20260709 12:17:52.554082 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.554739 24099 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:52.554891 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.557560 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.558933 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:52.563197 24094 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:52.564414 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:52.565086 24245 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:17:52.498507 25957 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:52.493719 25771 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:52.494369 26080 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:52.493192 26085 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.572429 24095 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:52.587625 24095 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:52.587877 24066 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.544848 26051 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:52.503695 25975 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:52.499169 25958 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.493870 25942 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:52.590421 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 110706us
I20260709 12:17:52.757721 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.576573 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:52.577123 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1501) took 1142 ms. Trace:
I20260709 12:17:52.577881 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.578120 23995 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 2 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.579802 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.540282 25777 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:52.583629 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:52.591619 26051 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:17:52.574142 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 126349us
I20260709 12:17:52.591725 25999 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:52.600945 24094 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:52.571698 26082 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:52.602826 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.764518 24249 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:52.765035 24215 leader_election.cc:400] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:17:52.765128 25777 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.765498 24215 leader_election.cc:403] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:52.765828 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.765718 25777 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.603010 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.767174 26106 consensus_queue.cc:1059] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:52.760273 24092 rpcz_store.cc:276] 0709 12:17:51.434837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.490052 (+1055215us) service_pool.cc:224] Handling call
0709 12:17:52.490584 (+   532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.548286 (+ 57702us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.572879 (+ 24593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.768375 26084 raft_consensus.cc:3055] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:52.768478 25777 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:52.604591 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.762236 24242 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:17:52.770035 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 165532us
I20260709 12:17:52.760506 26046 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:52.771360 26046 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:52.771754 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.571309 25876 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:17:52.599066 25772 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:52.570597 25865 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:17:52.773787 25865 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:52.774154 25865 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:52.763294 24243 raft_consensus.cc:2393] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:52.775102 25865 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.599072 25771 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:52.776528 25771 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.776696 23995 catalog_manager.cc:5697] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 2 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.488363 24093 rpcz_store.cc:276] 0709 12:17:51.394241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.486181 (+1091940us) service_pool.cc:224] Handling call
0709 12:17:52.486730 (+   549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:52.487121 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.487168 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:52.487292 (+   124us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:52.487344 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.487435 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.487607 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:52.594594 26001 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:17:52.779407 26002 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.780306 26001 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:52.780095 26002 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.780864 26001 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.602696 25958 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.600685 25975 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.783423 26082 raft_consensus.cc:697] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:52.667960 26011 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.784775 25958 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.784845 25975 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.785509 25866 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.671324 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1365) took 1305 ms. Trace:
I20260709 12:17:52.771767 26046 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.787276 25772 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.787154 24098 rpcz_store.cc:276] 0709 12:17:51.366444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.473153 (+1106709us) service_pool.cc:224] Handling call
0709 12:17:52.473704 (+   551us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:52.501861 (+ 28157us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.501895 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:52.502595 (+   700us) log.cc:844] Serialized 26 byte log entry
0709 12:17:52.606290 (+103695us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:52.606351 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.606453 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:52.671061 (+ 64608us) raft_consensus.cc:1685] finished
0709 12:17:52.671087 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.671247 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27629,"raft.queue_time_us":29257,"raft.run_cpu_time_us":190,"raft.run_wall_time_us":32748,"thread_start_us":103186,"threads_started":1,"wal-append.queue_time_us":166397}
I20260709 12:17:52.636811 26080 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.682334 25680 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.790346 25680 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:52.791229 25844 consensus_queue.cc:1175] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c090031f610346ed82285cd847bca6d6" responder_term: 4 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:17:52.785534 25958 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:17:52.686062 25803 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.686609 26031 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.794826 25999 consensus_queue.cc:1059] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:52.795611 26031 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.796586 25965 raft_consensus.cc:3055] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:52.797113 25965 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:52.797904 26031 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.690971 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:52.798523 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:52.798677 24815 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:52.798259 25965 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.691951 25939 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.799749 26002 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:52.800282 25803 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:52.800709 25803 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.801076 25803 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.801280 25939 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:52.703154 24248 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:17:52.703994 24245 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:17:52.732960 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.734855 26110 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.718827 25957 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.803330 26110 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.803609 25957 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.803885 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.805680 26110 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:52.805907 25957 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:52.747938 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.806396 24246 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:52.807082 25965 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.807782 26051 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.810364 26031 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:17:52.812453 26031 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.767557 24247 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:52.768833 26084 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:52.814492 25957 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:52.814210 26084 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.814900 25957 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:52.588940 25971 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.784479 26082 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:52.815860 25957 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.786372 25866 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:52.817332 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:52.818087 24810 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:52.801826 23995 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:17:52.746421 25790 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.812572 26106 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:17:52.814754 24066 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.823650 24141 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:52.751454 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1368) took 1127 ms. Trace:
I20260709 12:17:52.762262 24140 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:52.824775 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 57844.5us
I20260709 12:17:52.825615 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.835582 26080 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.835345 25790 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.835774 23995 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 2 to 3, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:17:52.837903 25790 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:52.837723 23995 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 2 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.840966 24214 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:52.826010 24097 rpcz_store.cc:276] 0709 12:17:51.624173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.507803 (+883630us) service_pool.cc:224] Handling call
0709 12:17:52.549907 (+ 42104us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:52.569232 (+ 19325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:52.569264 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:52.610732 (+ 41468us) log.cc:844] Serialized 52 byte log entry
0709 12:17:52.728869 (+118137us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:52.728922 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:52.728999 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:52.751250 (+ 22251us) raft_consensus.cc:1685] finished
0709 12:17:52.751268 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:52.751392 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17697,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":100,"thread_start_us":77641,"threads_started":1,"wal-append.queue_time_us":113578}
I20260709 12:17:52.826134 24215 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:52.845398 24141 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:52.838792 26110 consensus_queue.cc:1059] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:17:52.846081 25971 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:52.846614 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.841744 25999 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.847141 25971 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.847604 25971 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.847806 25999 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.826928 25771 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:52.849196 25771 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:52.849700 25771 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:52.844858 25413 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:52.853727 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.851926 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.860090 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.874821 24248 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
I20260709 12:17:52.854707 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.875890 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:52.876787 24245 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:17:52.878997 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 52935.5us
I20260709 12:17:52.782923 26001 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:52.893828 24245 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:52.854521 26084 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:52.855540 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.860599 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:52.907495 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 146710us
I20260709 12:17:52.885450 25876 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:52.904729 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50216.3us
I20260709 12:17:52.878860 25957 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.899374 23995 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 1 to 2, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 2 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:17:52.881613 26093 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:52.858701 26106 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:17:52.891935 25958 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.851182 25844 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:17:52.850788 25771 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.907878 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.850813 25939 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:17:52.930160 24140 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:52.926738 25876 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:52.904788 26001 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:52.851737 26117 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:17:52.918633 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:52.908473 25777 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:52.947258 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:52.949959 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:52.951829 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 100113us
I20260709 12:17:52.952997 25865 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:52.915515 24244 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:52.939226 26110 consensus_queue.cc:1243] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer 729aa4b1ccec48b588c14e67652c61e1 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:52.963691 25942 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:52.971398 26085 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:52.973323 26093 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:52.937702 26087 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:17:52.958196 26001 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.961320 26082 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:52.981551 26046 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:52.985049 25413 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:52.987416 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:52.988931 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:52.990818 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:52.950251 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 96179.6us
I20260709 12:17:52.949146 25876 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:53.009294 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:52.990506 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:52.949698 26027 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:53.015208 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:52.958237 25777 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:53.020252 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:53.029039 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:53.032505 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:53.015291 26125 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:17:53.026103 25936 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:53.041872 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:53.042024 25790 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:17:53.046576 24809 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:53.051545 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.052098 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.053083 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.053474 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.053846 24098 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:53.054157 24246 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:53.054931 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.059499 24093 raft_consensus.cc:2393] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:53.055455 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.055764 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.057619 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.018023 26082 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:53.056075 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:53.101609 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.121464 24099 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:53.121309 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.123557 24246 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
W20260709 12:17:53.127890 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 166105us
I20260709 12:17:53.006614 25942 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.035277 26093 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:53.128875 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.037168 25777 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:53.141448 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.120671 26082 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:53.143903 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.157244 24098 raft_consensus.cc:2410] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:53.130704 24808 raft_consensus.cc:2393] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:53.133985 24092 raft_consensus.cc:2410] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:53.158362 24214 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.163563 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.163998 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.031034 26110 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 12:17:53.170724 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.189502 24243 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:53.130882 26122 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.174887 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.182201 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.194343 24246 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:53.162253 25844 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.183794 24097 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:53.155426 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.186333 25942 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.162338 26031 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.182360 26027 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:53.198263 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.211180 24246 raft_consensus.cc:3055] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:53.211388 24095 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:53.201555 25866 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:53.212056 24246 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:53.232023 24248 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:53.234678 24246 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.160528 26093 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.210321 26129 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:53.217095 25942 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.243883 26087 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.244371 24246 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:53.201426 25844 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.246445 24244 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:53.218729 26031 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:53.260463 24101 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:53.237182 25975 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:53.225966 26027 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.245517 26129 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.229846 25866 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:53.307440 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 143520us
I20260709 12:17:53.306641 24095 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:17:53.206161 26122 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.330371 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:53.332696 24095 raft_consensus.cc:2393] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:53.250946 26130 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:53.339617 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.348747 26122 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:53.349882 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.350732 24097 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:17:53.262215 26087 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.353471 26087 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.354014 26027 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.356974 26031 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:53.365763 24246 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:17:53.366344 24246 pending_rounds.cc:85] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 2
I20260709 12:17:53.366690 24246 pending_rounds.cc:107] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:17:53.367031 24246 raft_consensus.cc:2889] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:53.368268 24099 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:53.305580 25680 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.302553 25957 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.338675 26117 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:53.258215 25942 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.387498 26087 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.431447 26087 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:53.432528 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.434278 26087 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:53.435596 25803 consensus_meta.cc:287] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.634s	user 0.015s	sys 0.000s
I20260709 12:17:53.436120 25803 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.439042 26126 raft_consensus.cc:3055] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:53.439862 26126 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:53.378072 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.441174 25844 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:53.441596 24246 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:53.442612 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:53.442821 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.443288 25942 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.443745 24246 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:53.444391 26001 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:53.391897 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:53.404750 24250 raft_consensus.cc:2410] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:53.387511 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.303412 25975 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.359406 26046 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.387490 26117 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:53.450006 26117 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.403091 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:53.453603 24092 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:53.311332 26129 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:53.397332 24244 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:17:53.396848 26132 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:17:53.435616 26093 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.391289 25680 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:53.464861 26120 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.503s	user 0.004s	sys 0.000s
W20260709 12:17:53.466027 26002 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:17:53.466094 25680 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:53.467742 24242 consensus_meta.cc:287] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.698s	user 0.015s	sys 0.000s
I20260709 12:17:53.468166 24242 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:53.469138 24243 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:53.469789 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:17:53.471994 26121 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.497s	user 0.001s	sys 0.001s
I20260709 12:17:53.473066 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:53.474849 24066 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.438730 25803 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.475251 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:53.480279 25958 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.002s
I20260709 12:17:53.487458 24066 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.490108 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.501050 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.508041 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.451817 26117 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:53.514559 24140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.026s	sys 0.006s
I20260709 12:17:53.479679 25975 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:53.469805 24242 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:53.489326 26136 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:53.388206 25957 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.488476 26051 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:53.520175 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:53.514976 24140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.026s	sys 0.006s
I20260709 12:17:53.548553 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:53.549036 24101 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
W20260709 12:17:53.549379 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 602266us
I20260709 12:17:53.549609 24096 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:53.550237 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:53.495286 25680 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:53.495448 25958 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:53.500474 25971 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.650s	user 0.018s	sys 0.000s
I20260709 12:17:53.498759 26137 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:53.506580 26031 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:53.465945 25777 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:53.525342 25413 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:17:53.523113 26084 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:53.555516 26143 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:17:53.569314 26122 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:53.555732 24095 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:53.487093 26056 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 12:17:53.542409 26011 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.746s	user 0.012s	sys 0.005s
I20260709 12:17:53.513706 25803 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:53.574235 26012 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.574651 25803 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.575064 26012 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:53.515736 25942 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:53.376583 26130 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.521330 26141 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.513491 25965 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:17:53.569566 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.521534 25876 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.558338 26137 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.562651 26031 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.556118 26076 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:53.583448 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:53.553615 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 78500.4us
I20260709 12:17:53.552968 26051 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.619704 26051 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:53.558672 25971 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:53.620944 26130 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.622032 25971 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:53.552879 25680 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.593058 24101 raft_consensus.cc:2955] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:17:53.556838 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.623178 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.604301 25965 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:53.605576 26001 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:53.607451 26027 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:53.608214 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.607961 26141 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.602427 24214 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:53.653889 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 51576.8us
I20260709 12:17:53.612716 24779 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:53.624449 24247 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
W20260709 12:17:53.629521 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.595798 25942 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.659126 25942 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:53.559391 26002 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:17:53.586381 24092 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:53.595571 24811 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:53.607504 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.670706 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.671522 24242 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:53.636948 25876 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.610371 26137 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:53.624286 26031 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:53.676149 25777 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:53.654018 26001 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:53.676808 25957 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.677280 26001 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:53.677788 26138 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:17:53.638761 26082 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.678874 25803 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.590190 26084 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.680958 26082 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:53.681248 26084 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:53.641939 26093 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.682180 26093 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:53.684301 26093 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:53.688143 26080 consensus_meta.cc:287] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.852s	user 0.018s	sys 0.004s
I20260709 12:17:53.688938 26141 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:53.691233 24140 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:53.693053 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:53.694274 26137 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.647707 25866 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:53.651180 26140 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:17:53.658130 25790 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:53.658393 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:53.711714 24247 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:53.662431 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49849.7us
W20260709 12:17:53.713346 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.595347 24241 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:17:53.630091 25680 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:53.695744 26046 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:53.695883 25865 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:53.652348 26027 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:53.642583 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.700310 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.699338 26031 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.664481 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.657581 25971 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:53.699643 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:53.701350 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:53.705199 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 228167us
I20260709 12:17:53.741473 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.743453 24172 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:17:53.744589 24248 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:53.740096 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 75730.7us
I20260709 12:17:53.746896 24176 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:53.748869 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:53.717396 26046 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:53.715510 24249 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:53.699590 26011 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:53.657300 25965 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:53.722947 26027 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:53.739840 26093 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:53.726068 25790 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:17:53.771889 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 72349.6us
W20260709 12:17:53.776154 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.776799 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:53.779803 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 126549us
W20260709 12:17:53.701594 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69737.9us
I20260709 12:17:53.753543 25844 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:53.753793 26082 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:53.793119 24247 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:53.763835 26046 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:53.773140 24808 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:53.794888 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:53.794175 26082 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.791572 25844 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:53.791352 26076 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:17:53.795895 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:53.793979 26093 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.789600 26149 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:17:53.837872 24247 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:53.779011 26130 raft_consensus.cc:2764] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:17:53.842121 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:53.842593 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.843281 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.844213 25790 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.847699 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:53.847692 26011 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:53.853142 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:53.853441 25680 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.802675 24248 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:53.771107 25971 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:53.840564 25803 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:17:53.918601 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:53.874830 25844 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:53.838199 26082 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:53.944195 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 162858us
W20260709 12:17:53.949249 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 235807us
W20260709 12:17:53.957229 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 180543us
I20260709 12:17:53.929314 26051 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:53.954675 24247 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:53.958396 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:53.961681 26051 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:53.997241 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 160284us
I20260709 12:17:53.937770 24243 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:54.003978 24141 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:54.005666 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:53.944928 25803 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:54.016880 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:53.935303 24244 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
W20260709 12:17:53.991189 26131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.013s	sys 0.029s
I20260709 12:17:53.931073 25876 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:17:53.936053 26056 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:17:53.914162 25965 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.001852 26130 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:53.944118 26129 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:54.035415 26131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.013s	sys 0.029s
I20260709 12:17:54.008347 26136 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:53.954505 26011 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:54.030404 25803 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:54.043414 24807 raft_consensus.cc:2368] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:17:54.060257 24247 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:54.075134 24245 raft_consensus.cc:2368] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
W20260709 12:17:54.076555 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.049480 26159 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:54.061558 26145 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:54.052744 26130 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:54.086129 24247 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:17:54.086747 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49581.9us
I20260709 12:17:54.049816 25942 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:54.079142 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 128886us
I20260709 12:17:54.072754 25965 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:54.100071 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.073758 25957 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:54.110947 24168 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
W20260709 12:17:54.086016 25975 consensus_meta.cc:287] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.528s	user 0.013s	sys 0.000s
I20260709 12:17:54.083519 26137 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.100991 26130 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:54.090240 26012 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.069700 26136 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.130861 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:54.118952 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:54.144181 24247 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
W20260709 12:17:54.150610 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48140.4us
I20260709 12:17:54.137610 25876 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:54.152956 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:54.162569 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.127231 25975 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.173425 25971 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.174328 25971 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:17:54.177368 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:54.162515 26151 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.231s	user 0.001s	sys 0.000s
W20260709 12:17:54.165911 26152 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.245s	user 0.000s	sys 0.002s
I20260709 12:17:54.159399 26093 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.127137 25957 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:54.174891 25971 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:54.214733 24781 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:54.226765 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:54.232422 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 229595us
I20260709 12:17:54.234741 25971 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.239296 26011 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.241077 25942 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.245559 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:54.246877 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:54.274932 24140 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:54.238848 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:54.242815 25975 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.282167 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1099) took 1239 ms. Trace:
I20260709 12:17:54.283141 24246 rpcz_store.cc:276] 0709 12:17:53.040158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.444777 (+404619us) service_pool.cc:224] Handling call
0709 12:17:53.484007 (+ 39230us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:53.485905 (+  1898us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:53.485957 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:53.495803 (+  9846us) log.cc:844] Serialized 26 byte log entry
0709 12:17:53.733182 (+237379us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:53.733255 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:53.733377 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:54.279499 (+546122us) raft_consensus.cc:1685] finished
0709 12:17:54.279526 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.279702 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24507,"raft.queue_time_us":2455,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":19569,"thread_start_us":185260,"threads_started":1,"wal-append.queue_time_us":298468}
I20260709 12:17:54.230118 26145 raft_consensus.cc:697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:54.299175 24169 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:54.301075 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.302546 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.303460 24170 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:54.304546 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.305397 24170 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:54.306236 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.307334 24814 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:17:54.309129 24814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 184) took 1292 ms. Trace:
I20260709 12:17:54.309175 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:54.309684 24814 rpcz_store.cc:276] 0709 12:17:53.016941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.041287 (+ 24346us) service_pool.cc:224] Handling call
0709 12:17:54.308838 (+1267551us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540067fcd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:54.309013 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2907992960}
I20260709 12:17:54.326691 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.318272 26126 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.328056 26126 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:54.328287 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.328588 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:54.330137 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:54.343729 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.330866 24170 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:54.347658 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.349215 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.349491 26138 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.350028 24170 raft_consensus.cc:2368] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
W20260709 12:17:54.350800 24249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1085) took 1359 ms (client timeout 1503 ms). Trace:
W20260709 12:17:54.351457 24249 rpcz_store.cc:269] 0709 12:17:52.991412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.019926 (+ 28514us) service_pool.cc:224] Handling call
0709 12:17:54.350592 (+1330666us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54003d7a54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:54.350720 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504707840}
I20260709 12:17:54.351006 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.353164 24249 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:54.353847 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:54.356696 24241 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 133) took 1842 ms (client timeout 1697 ms). Trace:
I20260709 12:17:54.354470 24170 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:54.357810 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:54.358073 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:54.358704 24811 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 282) took 1961 ms (client timeout 2141 ms). Trace:
I20260709 12:17:54.358832 24101 raft_consensus.cc:2393] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:54.358999 25777 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:54.359521 25777 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.359983 25777 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:54.359292 24811 rpcz_store.cc:269] 0709 12:17:52.398517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.403879 (+  5362us) service_pool.cc:224] Handling call
0709 12:17:54.358513 (+1954634us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540070f654. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:54.358634 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2642010880}
I20260709 12:17:54.358884 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:54.362318 24170 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:17:54.357342 24241 rpcz_store.cc:269] 0709 12:17:52.514167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.536211 (+ 22044us) service_pool.cc:224] Handling call
0709 12:17:52.783750 (+247539us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456e9c 00007f4c02456a5b 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:52.900656 (+116906us) spinlock_profiling.cc:243] Waited 56.2 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:54.356394 (+1455738us) spinlock_profiling.cc:243] Waited 633 ms on lock 0x7b54003598d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:54.356559 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590546944}
I20260709 12:17:54.369722 24241 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:54.370393 26080 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:54.370798 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 156204us
I20260709 12:17:54.371233 26080 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.372828 26178 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:54.373365 26178 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:54.373720 26178 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:54.373983 26080 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:54.376262 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.376606 25936 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:54.377195 25936 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:54.378057 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:54.350092 26138 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:54.379325 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:54.380740 24215 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:54.385072 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:54.392357 24066 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:54.394385 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.401361 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.408623 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:54.410257 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:54.406584 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.282872 26171 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:54.416406 24174 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:54.422434 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:54.384305 25772 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.436481 24170 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:17:54.395241 25958 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:54.401793 25999 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:54.439561 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:54.440460 24101 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:54.445927 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.448851 24170 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:54.454258 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:54.459532 24141 leader_election.cc:400] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:17:54.459744 25942 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:54.462020 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 94126.3us
I20260709 12:17:54.405836 26137 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
W20260709 12:17:54.466962 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 70475.1us
I20260709 12:17:54.470404 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.471156 24141 leader_election.cc:403] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:17:54.479285 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:17:54.483952 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.446161 25999 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:54.485597 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.438414 26159 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:54.466217 25936 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.485705 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.502754 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:54.503707 24248 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:54.469450 26138 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:54.444509 25772 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.477622 25942 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:54.487735 26117 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.963s	user 0.018s	sys 0.004s
I20260709 12:17:54.480412 25413 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:54.507323 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47986.7us
I20260709 12:17:54.480952 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:54.477831 25958 consensus_queue.cc:1059] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:17:54.495652 25999 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:54.499297 26145 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.519196 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:54.659835 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:54.708144 24100 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:54.708781 24172 raft_consensus.cc:2368] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:17:54.700598 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1333) took 2059 ms. Trace:
I20260709 12:17:54.650419 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.669909 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:54.714632 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.680888 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:54.620770 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:54.594237 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 213587us
I20260709 12:17:54.720338 24215 leader_election.cc:400] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:17:54.720750 24215 leader_election.cc:403] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:17:54.564585 24216 leader_election.cc:336] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.552s (SENT)
I20260709 12:17:54.533288 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.750176 24170 raft_consensus.cc:1813] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Handling vote request from an unknown peer fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:54.751065 24170 raft_consensus.cc:2410] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:17:54.563622 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:54.755659 24243 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:17:54.716691 25942 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:54.756193 26160 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.625s	user 0.004s	sys 0.000s
I20260709 12:17:54.709681 24250 rpcz_store.cc:276] 0709 12:17:52.640898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.774433 (+133535us) service_pool.cc:224] Handling call
0709 12:17:52.854497 (+ 80064us) spinlock_profiling.cc:243] Waited 65.3 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:54.700247 (+1845750us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b5400002654. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:54.700493 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1332447488}
W20260709 12:17:54.621184 26170 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.399s	user 0.000s	sys 0.001s
W20260709 12:17:54.613978 25844 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.006s
W20260709 12:17:54.679299 26186 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:17:54.510875 26193 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:54.817647 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:54.839874 24170 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:54.818435 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 253862us
I20260709 12:17:54.517026 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:54.825129 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:54.618495 26187 log.cc:927] Time spent T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:17:54.837359 26201 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.843830 26201 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.795776 26085 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:17:54.847805 26001 consensus_meta.cc:287] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.170s	user 0.017s	sys 0.021s
I20260709 12:17:54.848934 25844 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.831689 26195 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:54.850370 26195 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:54.667640 25680 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.614406 25957 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:54.835753 26165 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:17:54.836910 26188 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:17:54.836786 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1107) took 1211 ms. Trace:
I20260709 12:17:54.679340 26129 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:54.520211 26138 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.602095 26137 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:17:54.511454 26184 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:54.631155 26174 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:54.570676 26171 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:54.516474 26136 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:54.848371 26001 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:54.851868 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 131759us
W20260709 12:17:54.826977 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 345357us
I20260709 12:17:54.835376 25866 raft_consensus.cc:3055] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:54.846725 26201 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:54.659559 26198 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:54.889591 24248 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:17:55.057662 24100 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:17:54.960263 24213 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.000s	sys 0.024s
W20260709 12:17:55.069115 24213 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.000s	sys 0.031s
I20260709 12:17:55.064402 24170 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:55.058252 24245 rpcz_store.cc:276] 0709 12:17:53.625146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.247652 (+622506us) service_pool.cc:224] Handling call
0709 12:17:54.248101 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.248514 (+   413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.248555 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:54.249198 (+   643us) log.cc:844] Serialized 26 byte log entry
0709 12:17:54.438247 (+189049us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:54.438297 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.438445 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:54.836515 (+398070us) raft_consensus.cc:1685] finished
0709 12:17:54.836539 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:54.836703 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1466,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":124,"spinlock_wait_cycles":30976,"thread_start_us":188294,"threads_started":1,"wal-append.queue_time_us":235679}
I20260709 12:17:54.630785 26177 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:54.815490 26162 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:54.854522 25958 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.081714 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:54.893688 26085 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:17:55.090858 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 261640us
W20260709 12:17:54.979656 25865 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.256s	user 0.035s	sys 0.016s
I20260709 12:17:55.101881 26141 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.103772 25771 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.104184 26201 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.104374 25771 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:55.104766 26201 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:55.105460 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:55.106163 24093 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:55.107375 26201 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:55.100762 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.100446 26085 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:55.108474 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.102623 26141 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:55.109642 26085 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:55.100571 25958 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.816818 25413 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:55.110358 26046 consensus_meta.cc:287] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.273s	user 0.034s	sys 0.003s
I20260709 12:17:55.111197 24094 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:55.111522 26141 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:55.112402 25413 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:55.086074 26082 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.097s	user 0.020s	sys 0.010s
I20260709 12:17:55.056885 26195 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:55.113166 26082 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:54.839054 26193 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:55.114413 24172 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:55.114594 26193 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:55.115463 26082 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:55.115592 25772 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:55.081534 25866 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:55.117359 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:55.117313 25866 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:55.101305 24247 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:55.101933 25865 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:55.082166 26171 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:55.082592 26174 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:54.947347 26027 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.166s	user 0.016s	sys 0.016s
I20260709 12:17:55.026386 26012 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.082881 26177 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:55.057719 25844 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:54.589489 26159 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:55.110846 26046 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:55.107705 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:54.854538 26117 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:55.120067 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:55.127267 24169 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:55.135061 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 60781.6us
I20260709 12:17:55.073732 26137 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:17:55.147311 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 43498.9us
I20260709 12:17:55.125700 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1352) took 1515 ms. Trace:
I20260709 12:17:55.079766 26206 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:55.084829 26138 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:55.228224 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:55.422081 24245 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
W20260709 12:17:55.161469 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.184105 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:55.412449 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:55.425199 24248 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
W20260709 12:17:55.126614 26161 log.cc:927] Time spent T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.002s	user 0.004s	sys 0.000s
I20260709 12:17:55.091210 26198 raft_consensus.cc:697] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:55.411975 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:55.428277 24172 raft_consensus.cc:2368] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4.
I20260709 12:17:55.431126 24066 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:55.420261 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:55.227439 24173 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:55.119053 26084 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:55.133972 26171 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:55.176155 26165 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:17:55.118952 25866 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:55.412480 25803 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.317s	user 0.014s	sys 0.006s
I20260709 12:17:55.241295 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:55.237923 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 227382us
W20260709 12:17:55.490563 24141 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 2.761s (SENT)
I20260709 12:17:55.495728 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:55.160463 24247 rpcz_store.cc:276] 0709 12:17:53.610771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.146866 (+536095us) service_pool.cc:224] Handling call
0709 12:17:54.165074 (+ 18208us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.123630 (+958556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.125406 (+  1776us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400341f54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:55.125627 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2152574720}
W20260709 12:17:55.287804 25965 consensus_meta.cc:287] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.164s	user 0.021s	sys 0.008s
I20260709 12:17:55.137161 26177 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:55.287581 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:55.485087 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1112) took 1104 ms. Trace:
I20260709 12:17:55.507426 24246 rpcz_store.cc:276] 0709 12:17:54.381017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.806501 (+425484us) service_pool.cc:224] Handling call
0709 12:17:54.815510 (+  9009us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.815802 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:54.847219 (+ 31417us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.484621 (+637402us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:55.484702 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:55.484756 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.484834 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.484992 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":137790,"prepare.queue_time_us":36231,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":84,"raft.queue_time_us":140218,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":10118,"thread_start_us":499101,"threads_started":1}
W20260709 12:17:55.283630 26191 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:17:55.162022 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1101) took 1667 ms. Trace:
I20260709 12:17:55.096177 26162 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:55.416173 26046 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:55.125361 25958 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:55.201563 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:55.516028 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.492473 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:55.136349 26027 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:55.494894 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 59685.8us
W20260709 12:17:55.472051 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46031.1us
I20260709 12:17:55.136731 26174 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:55.476432 26136 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:55.494136 25803 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:55.287858 25771 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:55.214287 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:55.575559 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.575268 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:55.576417 24247 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:55.481720 26084 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:55.498081 25777 consensus_meta.cc:287] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.138s	user 0.013s	sys 0.013s
I20260709 12:17:55.518400 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:55.523468 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:55.580878 24246 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 2.
W20260709 12:17:55.525575 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.136762 26012 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:55.519917 25999 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.705s	user 0.011s	sys 0.002s
W20260709 12:17:55.538973 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.515799 26145 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:55.584127 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:55.591734 24216 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.656s (SENT)
I20260709 12:17:55.427600 26206 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:55.638675 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.528017 25958 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:55.429726 26137 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:55.605619 24174 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:55.662379 24216 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:55.665684 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:55.666225 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 47585.7us
I20260709 12:17:55.565024 26184 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:17:55.577085 26136 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:55.860232 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:55.773213 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 107729us
I20260709 12:17:55.856448 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:55.881392 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:55.891168 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.891687 24101 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:55.813120 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:55.838894 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:55.691395 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1539) took 1337 ms. Trace:
I20260709 12:17:55.893684 24172 raft_consensus.cc:1813] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Handling vote request from an unknown peer fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:55.813592 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1038) took 1516 ms. Trace:
W20260709 12:17:55.606817 26165 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:17:55.596079 26084 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:55.889031 24099 raft_consensus.cc:2410] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:55.896454 24172 raft_consensus.cc:2410] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:17:55.597260 26129 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.894582 24175 rpcz_store.cc:276] 0709 12:17:54.296814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.297000 (+   186us) service_pool.cc:224] Handling call
0709 12:17:54.297490 (+   490us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:54.443829 (+146339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.443875 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:54.466693 (+ 22818us) log.cc:844] Serialized 52 byte log entry
0709 12:17:54.842803 (+376110us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:54.978063 (+135260us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.288303 (+310240us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b1800373f00. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c05573060 00007f4c05585716 00007f4c05596287 00007f4c05596208
0709 12:17:55.532817 (+244514us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.532938 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:55.533000 (+    62us) raft_consensus.cc:1685] finished
0709 12:17:55.576822 (+ 43822us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.813486 (+236664us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":161146,"prepare.queue_time_us":134731,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":21916,"raft.queue_time_us":202024,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":18545,"spinlock_wait_cycles":21083648,"thread_start_us":571860,"threads_started":2,"wal-append.queue_time_us":639368}
I20260709 12:17:55.899555 24098 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:55.714854 26046 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:55.899340 26136 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:55.899880 26208 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:55.900430 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:55.900652 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 308969us
I20260709 12:17:55.893746 24096 rpcz_store.cc:276] 0709 12:17:54.354207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.354325 (+   118us) service_pool.cc:224] Handling call
0709 12:17:54.354703 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.355070 (+   367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.355097 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:54.355600 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 12:17:54.471495 (+115895us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:54.471904 (+   409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.472661 (+   757us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:55.602637 (+1129976us) raft_consensus.cc:1685] finished
0709 12:17:55.602673 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.691264 (+ 88591us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1509,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":114645,"threads_started":1,"wal-append.queue_time_us":469666}
I20260709 12:17:55.906001 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:55.937311 24101 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:55.938342 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:55.939026 24101 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:55.908404 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:55.940279 24097 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:55.913127 24170 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:55.942065 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:55.943660 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:55.944437 24100 raft_consensus.cc:2376] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4. Re-sending same reply.
I20260709 12:17:55.945708 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:55.881829 26031 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:55.660684 26198 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:55.714854 25876 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.550s	user 0.016s	sys 0.018s
W20260709 12:17:55.812556 26211 log.cc:927] Time spent T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 12:17:55.929407 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:55.903725 26130 consensus_meta.cc:287] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.752s	user 0.027s	sys 0.013s
I20260709 12:17:55.661334 26001 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:55.654819 26193 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.002s
W20260709 12:17:55.949668 24216 leader_election.cc:336] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.692s (SENT)
I20260709 12:17:55.880237 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:55.662485 25999 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:55.932364 26046 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:55.605288 25777 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:56.001855 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 274473us
I20260709 12:17:56.003660 25777 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:55.968251 26174 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.969961 24099 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:55.972340 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:55.937884 26184 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:55.981400 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:17:56.016916 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67293.6us
W20260709 12:17:56.017597 24216 leader_election.cc:336] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.694s (SENT)
I20260709 12:17:56.017948 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:55.984450 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.019506 24098 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:55.986066 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 156) took 2363 ms. Trace:
I20260709 12:17:55.989727 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:55.914387 25958 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:55.985852 26193 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:55.992271 26216 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 12:17:55.993093 26213 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:17:55.993613 26031 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:56.000162 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 146) took 1606 ms. Trace:
I20260709 12:17:56.034248 24249 rpcz_store.cc:276] 0709 12:17:54.393448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.801115 (+407667us) service_pool.cc:224] Handling call
0709 12:17:54.801545 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.851989 (+ 50444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:54.852034 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:54.854004 (+  1970us) log.cc:844] Serialized 26 byte log entry
0709 12:17:55.264028 (+410024us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:55.264076 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.264171 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:55.999859 (+735688us) raft_consensus.cc:1685] finished
0709 12:17:55.999887 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.000077 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":155297,"raft.queue_time_us":91469,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":29482,"thread_start_us":409567,"threads_started":1,"wal-append.queue_time_us":665993}
I20260709 12:17:56.000967 26138 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:55.919121 26200 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.006892 24140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1468) took 1065 ms. Trace:
I20260709 12:17:55.975476 25876 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:56.015177 24096 raft_consensus.cc:2368] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
W20260709 12:17:56.018853 24216 leader_election.cc:336] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.197s (SENT)
I20260709 12:17:56.022281 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:55.938815 26129 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:55.984422 25957 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:56.028247 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.028744 24172 raft_consensus.cc:2368] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:17:56.032344 24101 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:56.042591 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:56.041098 24140 rpcz_store.cc:276] 0709 12:17:54.941562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.006813 (+1065251us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:56.019913 24095 rpcz_store.cc:276] 0709 12:17:53.613792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.614053 (+   261us) service_pool.cc:224] Handling call
0709 12:17:53.614623 (+   570us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:53.615317 (+   694us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:17:53.784851 (+169534us) log.cc:844] Serialized 14 byte log entry
0709 12:17:54.037521 (+252670us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:54.039908 (+  2387us) log.cc:844] Serialized 26 byte log entry
0709 12:17:54.040190 (+   282us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:54.042295 (+  2105us) log.cc:844] Serialized 14 byte log entry
0709 12:17:54.047359 (+  5064us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.047499 (+   140us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:54.363553 (+316054us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b18003d7620. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e522 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:17:54.756065 (+392512us) spinlock_profiling.cc:243] Waited 8.09 ms on lock 0x7b18003d7620. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:17:55.977147 (+1221082us) raft_consensus.cc:1685] finished
0709 12:17:55.977181 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.977380 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13762,"prepare.queue_time_us":39642,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":120,"raft.queue_time_us":4949,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":2934,"spinlock_wait_cycles":28070528,"thread_start_us":252537,"threads_started":2,"wal-append.queue_time_us":199173}
I20260709 12:17:56.029455 26001 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:55.983990 26130 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.054512 24098 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:56.053776 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.027505 25777 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:56.044849 26212 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:56.036976 26204 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:56.083007 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64147.2us
W20260709 12:17:56.086068 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.088105 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.089044 24095 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
W20260709 12:17:56.096442 24140 service_pool.cc:136] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59344 dropped due to backpressure: service queue is full with 50 items [suppressed 1 similar messages]
W20260709 12:17:56.091285 26210 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.351s	user 0.001s	sys 0.001s
I20260709 12:17:56.052960 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.101437 24168 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:56.053755 26027 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.023609 26174 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.029139 26184 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:56.097083 25771 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:56.099480 26162 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.083091 25803 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:56.136685 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:55.512359 24242 rpcz_store.cc:276] 0709 12:17:53.478527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:53.959994 (+481467us) service_pool.cc:224] Handling call
0709 12:17:53.960447 (+   453us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:53.960906 (+   459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:53.960948 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:53.961542 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:17:54.094038 (+132496us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:54.094107 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:54.094222 (+   115us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:55.079633 (+985411us) raft_consensus.cc:1685] finished
0709 12:17:55.079666 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:55.146221 (+ 66555us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19827,"raft.queue_time_us":3009,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":14208,"thread_start_us":131980,"threads_started":1,"wal-append.queue_time_us":203712}
W20260709 12:17:56.120610 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.048182 26200 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:56.112182 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 215078us
I20260709 12:17:56.093178 26222 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:56.055843 25957 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.127154 26206 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.129083 26171 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:56.134114 25942 consensus_meta.cc:287] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.308s	user 0.013s	sys 0.001s
W20260709 12:17:56.160626 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.124406 26012 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:56.099310 26204 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.109362 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1110) took 1724 ms. Trace:
I20260709 12:17:56.156929 24092 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:56.148553 26214 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 12:17:56.166196 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.214811 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.164880 26222 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:56.170755 26225 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:17:56.176883 26184 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.096997 26212 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:56.194063 24097 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:56.225451 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.226739 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.220758 26136 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:56.213579 24243 rpcz_store.cc:276] 0709 12:17:54.380514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.809540 (+429026us) service_pool.cc:224] Handling call
0709 12:17:54.936703 (+127163us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:55.112627 (+175924us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:55.112670 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:55.113329 (+   659us) log.cc:844] Serialized 26 byte log entry
0709 12:17:55.529430 (+416101us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:55.535386 (+  5956us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:55.583419 (+ 48033us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:56.094316 (+510897us) raft_consensus.cc:1685] finished
0709 12:17:56.097687 (+  3371us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.104936 (+  7249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":176937,"raft.queue_time_us":176802,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"thread_start_us":400215,"threads_started":1,"wal-append.queue_time_us":487411}
I20260709 12:17:56.228487 26136 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:56.229306 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.230327 24171 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:56.230621 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.214195 26171 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:56.232071 26206 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:56.226637 26212 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.232671 26206 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:56.233355 26171 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.227670 24097 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:56.099896 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59344 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1046)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.157133 25999 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.232405 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:56.241379 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.238140 26136 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.242458 24092 raft_consensus.cc:2410] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:56.239856 26206 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.241462 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:56.238973 26232 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:56.245018 26232 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.226559 26204 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:56.211267 26231 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:56.247526 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.247702 26231 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:56.252157 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 185143us
I20260709 12:17:56.253912 24097 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:56.254974 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.218050 25942 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.268206 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1046)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.273461 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1046)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.270634 26046 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.280076 26222 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.280718 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:56.281533 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 179088us
I20260709 12:17:56.282114 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:56.278707 26193 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.287400 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:56.288169 24814 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
W20260709 12:17:56.288594 24216 leader_election.cc:336] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.845s (SENT)
I20260709 12:17:56.288681 25999 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:56.260900 24806 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:56.290818 26174 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.290897 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:56.290416 26084 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.289742 26129 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.292066 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1473)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1046)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.275419 24813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 292) took 2106 ms. Trace:
I20260709 12:17:56.307598 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:56.269909 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.305851 24141 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:17:56.296584 25866 consensus_meta.cc:287] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.000s
I20260709 12:17:56.319051 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:56.321431 24173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1040) took 2023 ms (client timeout 1593 ms). Trace:
W20260709 12:17:56.324518 24174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1049) took 2023 ms (client timeout 2226 ms). Trace:
W20260709 12:17:56.432226 24174 rpcz_store.cc:269] 0709 12:17:54.300743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.440307 (+139564us) service_pool.cc:224] Handling call
0709 12:17:56.324298 (+1883991us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54003b10d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:56.324446 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2528009600}
W20260709 12:17:56.433171 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 127413us
W20260709 12:17:56.432861 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 144302us
I20260709 12:17:56.434944 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:56.435806 24174 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:56.437251 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:56.437646 24092 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:56.431892 24173 rpcz_store.cc:269] 0709 12:17:54.297665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.297840 (+   175us) service_pool.cc:224] Handling call
0709 12:17:56.321075 (+2023235us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54003ea3d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:56.321280 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888758656}
I20260709 12:17:56.324900 25772 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:56.439622 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:56.317229 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1481)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1046)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.440572 25772 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.441087 26226 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:56.441242 24810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 291) took 2385 ms. Trace:
I20260709 12:17:56.324077 26200 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.443447 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:56.449183 24815 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
W20260709 12:17:56.356189 26178 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 1.982s	user 0.026s	sys 0.018s
I20260709 12:17:56.306792 26199 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:56.317507 25958 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.446738 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1471)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1046)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.475570 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.455518 25942 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.475653 26199 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:56.476640 24175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1471) took 1534 ms (client timeout 1961 ms). Trace:
I20260709 12:17:56.478334 26199 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:56.456599 26126 consensus_meta.cc:287] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 2.128s	user 0.019s	sys 0.009s
I20260709 12:17:56.479415 24250 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:56.460726 24247 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 2. (index mismatch)
I20260709 12:17:56.479941 26002 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.480540 26002 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:56.482802 24093 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.376s	user 0.015s	sys 0.000s
I20260709 12:17:56.483287 24093 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:17:56.484043 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50598 (request call id 157) took 1416 ms. Trace:
I20260709 12:17:56.425487 25957 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.484495 24093 rpcz_store.cc:276] 0709 12:17:55.067319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.075464 (+  8145us) service_pool.cc:224] Handling call
0709 12:17:56.483950 (+1408486us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.485706 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:17:56.477054 24175 rpcz_store.cc:269] 0709 12:17:54.942458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.475241 (+1532783us) service_pool.cc:224] Handling call
0709 12:17:56.476567 (+  1326us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.485818 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:17:56.477094 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1459)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1046)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.462877 24174 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
W20260709 12:17:56.463943 26177 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.950s	user 0.008s	sys 0.006s
I20260709 12:17:56.464448 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1044) took 2165 ms. Trace:
I20260709 12:17:56.450320 26226 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:56.447117 26171 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:17:56.467697 26117 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.310s	user 0.007s	sys 0.007s
I20260709 12:17:56.472724 26084 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:56.416543 26129 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:56.431869 24813 rpcz_store.cc:276] 0709 12:17:54.162401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.164415 (+  2014us) service_pool.cc:224] Handling call
0709 12:17:54.172924 (+  8509us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:54.219214 (+ 46290us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:17:54.458871 (+239657us) log.cc:844] Serialized 14 byte log entry
0709 12:17:55.132389 (+673518us) spinlock_profiling.cc:243] Waited 5.6 ms on lock 0x7b1800237340. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b23a 00007f4c05585a2a
0709 12:17:55.856522 (+724133us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:55.977152 (+120630us) log.cc:844] Serialized 26 byte log entry
0709 12:17:56.005143 (+ 27991us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:17:56.008485 (+  3342us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.025269 (+ 16784us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:56.235371 (+210102us) raft_consensus.cc:1685] finished
0709 12:17:56.260670 (+ 25299us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.268298 (+  7628us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12884,"prepare.queue_time_us":242288,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":719852,"raft.run_cpu_time_us":305,"raft.run_wall_time_us":33251,"spinlock_wait_cycles":12871936,"thread_start_us":872055,"threads_started":3,"wal-append.queue_time_us":1302848}
W20260709 12:17:56.489058 24174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1473) took 1546 ms (client timeout 1894 ms). Trace:
W20260709 12:17:56.489626 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.489957 24215 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:56.312848 25999 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:56.514295 24174 rpcz_store.cc:269] 0709 12:17:54.964778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.434636 (+1469858us) service_pool.cc:224] Handling call
0709 12:17:56.488989 (+ 54353us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.517294 26084 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:56.517760 26084 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.518172 26084 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.505462 26051 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:56.519503 26051 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:56.520498 26051 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:56.521636 26145 consensus_meta.cc:287] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.002s
I20260709 12:17:56.448475 24810 rpcz_store.cc:276] 0709 12:17:54.056185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.059042 (+  2857us) service_pool.cc:224] Handling call
0709 12:17:54.088109 (+ 29067us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.123497 (+ 35388us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:56.234835 (+2111338us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b180038f920. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c08f733c7 00007f4c055859a7 00007f4c055950bf
0709 12:17:56.235052 (+   217us) log.cc:844] Serialized 14 byte log entry
0709 12:17:56.440551 (+205499us) log.cc:844] Serialized 14 byte log entry
0709 12:17:56.440779 (+   228us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:56.440832 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:56.440906 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.441025 (+   119us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.441168 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":389046,"prepare.run_cpu_time_us":137,"prepare.run_wall_time_us":3033,"raft.queue_time_us":10087,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":14708,"spinlock_wait_cycles":12411776,"thread_start_us":378775,"threads_started":3}
I20260709 12:17:56.358669 26222 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:56.323087 26193 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:56.496883 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:56.530112 24175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1459) took 1591 ms (client timeout 2020 ms). Trace:
W20260709 12:17:56.530640 24175 rpcz_store.cc:269] 0709 12:17:54.938612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.496501 (+1557889us) service_pool.cc:224] Handling call
0709 12:17:56.530030 (+ 33529us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.495661 24169 rpcz_store.cc:276] 0709 12:17:54.299312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.300267 (+   955us) service_pool.cc:224] Handling call
0709 12:17:54.300579 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:55.155900 (+855321us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.464126 (+1308226us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b540019b754. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:56.464343 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1900758272}
I20260709 12:17:56.513370 26129 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.313839 26130 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.535238 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:56.536124 24247 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:56.522166 26145 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:56.529371 26222 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:56.505978 26177 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:56.505793 26171 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:56.496937 26178 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:56.627180 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 141458us
I20260709 12:17:56.559418 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:56.549201 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:56.559144 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:56.497062 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1477)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1472)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1464)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1478)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1046)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
W20260709 12:17:56.567867 24172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1460) took 1628 ms (client timeout 1845 ms). Trace:
I20260709 12:17:56.568751 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:56.585407 24216 leader_election.cc:336] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.422s (SENT)
I20260709 12:17:56.637257 24216 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:56.638065 24247 raft_consensus.cc:2393] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:56.580071 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:56.638844 24246 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.639830 24249 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.637320 24101 raft_consensus.cc:2410] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:56.529959 26117 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
W20260709 12:17:56.631656 24172 rpcz_store.cc:269] 0709 12:17:54.939061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.965672 (+1026611us) service_pool.cc:224] Handling call
0709 12:17:56.567522 (+601850us) spinlock_profiling.cc:243] Waited 7.4 ms on lock 0x7b54002ae9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:56.567765 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17017088}
I20260709 12:17:56.645264 24140 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1046) took 2345 ms. Trace:
I20260709 12:17:56.513955 25772 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:56.649942 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.645754 24140 rpcz_store.cc:276] 0709 12:17:54.299865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.645189 (+2345324us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 12:17:56.658773 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 73448.4us
I20260709 12:17:56.661485 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.621999 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:56.664000 26232 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.664142 24808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 300) took 1462 ms. Trace:
I20260709 12:17:56.664852 26137 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:56.664548 24808 rpcz_store.cc:276] 0709 12:17:55.202129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.214544 (+ 12415us) service_pool.cc:224] Handling call
0709 12:17:56.621745 (+1407201us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:17:56.664055 (+ 42310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13674368}
I20260709 12:17:56.608680 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1039) took 2311 ms. Trace:
I20260709 12:17:56.666043 24167 rpcz_store.cc:276] 0709 12:17:54.297280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.382917 (+ 85637us) service_pool.cc:224] Handling call
0709 12:17:54.444432 (+ 61515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:54.477254 (+ 32822us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:54.501924 (+ 24670us) log.cc:844] Serialized 14 byte log entry
0709 12:17:56.319335 (+1817411us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b1800244e40. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b23a 00007f4c05585a2a
0709 12:17:56.532874 (+213539us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:56.533615 (+   741us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:56.541495 (+  7880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:56.578616 (+ 37121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:56.606415 (+ 27799us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10122,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":23360,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":4819,"spinlock_wait_cycles":102525312,"thread_start_us":182259,"threads_started":1,"wal-append.queue_time_us":2102495}
I20260709 12:17:56.662441 24172 raft_consensus.cc:2410] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:17:56.668593 24172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1478) took 1514 ms (client timeout 1933 ms). Trace:
W20260709 12:17:56.669023 24172 rpcz_store.cc:269] 0709 12:17:55.153876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.644755 (+1490879us) service_pool.cc:224] Handling call
0709 12:17:56.668506 (+ 23751us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.670178 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:56.661988 24216 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.020s (SENT)
I20260709 12:17:56.671296 24216 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:56.670969 24172 raft_consensus.cc:2368] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4.
I20260709 12:17:56.667939 24807 raft_consensus.cc:2368] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
W20260709 12:17:56.671773 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.672514 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491) took 1255 ms. Trace:
I20260709 12:17:56.538343 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:56.656327 24140 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1491)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1083)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1080)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.561307 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:56.673062 24172 rpcz_store.cc:276] 0709 12:17:55.417234 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.669820 (+1252586us) service_pool.cc:224] Handling call
0709 12:17:56.672446 (+  2626us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.644121 26171 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.611791 26129 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:56.646489 26231 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.533679 26193 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.679859 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:56.683125 24249 raft_consensus.cc:2410] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:17:56.681977 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.662276 25999 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.661684 26117 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:56.683524 26149 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:56.680263 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1088)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1083)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1084)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1080)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.675726 26126 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:56.686246 26226 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:56.689895 24246 raft_consensus.cc:2410] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:56.684763 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.697335 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:56.698217 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:56.700203 24172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1476) took 1615 ms (client timeout 2136 ms). Trace:
W20260709 12:17:56.700596 24172 rpcz_store.cc:269] 0709 12:17:55.084593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.692039 (+1607446us) service_pool.cc:224] Handling call
0709 12:17:56.700142 (+  8103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.671510 26084 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:56.696722 26243 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:17:56.695174 26149 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:56.706604 26178 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.707952 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.703603 24242 raft_consensus.cc:2410] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:56.712024 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:56.709277 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1492) took 1232 ms. Trace:
I20260709 12:17:56.708638 24172 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:56.712699 24249 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:56.713915 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1489) took 1297 ms. Trace:
I20260709 12:17:56.714303 24172 rpcz_store.cc:276] 0709 12:17:55.416690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.701197 (+1284507us) service_pool.cc:224] Handling call
0709 12:17:56.713854 (+ 12657us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.711853 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1088)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1083)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1084)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1091)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1080)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.716542 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.717355 24172 raft_consensus.cc:2368] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:17:56.717916 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1493) took 1221 ms. Trace:
I20260709 12:17:56.718274 24172 rpcz_store.cc:276] 0709 12:17:55.496972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.716232 (+1219260us) service_pool.cc:224] Handling call
0709 12:17:56.717862 (+  1630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.717206 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1068)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1069)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1078)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1076)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1088)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1081)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1083)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1084)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1091)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1082)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1080)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1086)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1074)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1093)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1085)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1087)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497)
I20260709 12:17:56.722289 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.713620 24167 rpcz_store.cc:276] 0709 12:17:55.477070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.678126 (+1201056us) service_pool.cc:224] Handling call
0709 12:17:56.707503 (+ 29377us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.722958 24101 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:56.723760 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.724659 24174 raft_consensus.cc:2368] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:17:56.725066 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.725708 24101 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:56.727499 24249 raft_consensus.cc:2410] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:17:56.723796 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:56.725104 24174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1464) took 1784 ms (client timeout 2141 ms). Trace:
W20260709 12:17:56.729300 24174 rpcz_store.cc:269] 0709 12:17:54.940403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.723440 (+1783037us) service_pool.cc:224] Handling call
0709 12:17:56.725041 (+  1601us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1792}
I20260709 12:17:56.729802 24167 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:56.730459 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1479) took 1548 ms. Trace:
I20260709 12:17:56.730880 26149 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.730808 24167 rpcz_store.cc:276] 0709 12:17:55.182302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.723492 (+1541190us) service_pool.cc:224] Handling call
0709 12:17:56.730388 (+  6896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21888}
I20260709 12:17:56.732515 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.730963 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.735797 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1467) took 1794 ms. Trace:
I20260709 12:17:56.736326 24174 rpcz_store.cc:276] 0709 12:17:54.941271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.730151 (+1788880us) service_pool.cc:224] Handling call
0709 12:17:56.735721 (+  5570us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.737488 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.738348 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1495) took 1202 ms. Trace:
I20260709 12:17:56.738731 24174 rpcz_store.cc:276] 0709 12:17:55.536283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.737128 (+1200845us) service_pool.cc:224] Handling call
0709 12:17:56.738285 (+  1157us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.739262 25999 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:17:56.742039 26246 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260709 12:17:56.741984 24170 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1474) took 1761 ms (client timeout 1597 ms). Trace:
W20260709 12:17:56.743198 24170 rpcz_store.cc:269] 0709 12:17:54.980720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.119695 (+138975us) service_pool.cc:224] Handling call
0709 12:17:56.741750 (+1622055us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b54003f7354. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:56.741884 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1742590336}
I20260709 12:17:56.743356 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.744450 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:56.747041 24174 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:56.748333 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.750051 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:56.750667 24094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1548) took 2248 ms (client timeout 1542 ms). Trace:
I20260709 12:17:56.751055 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:17:56.751119 24094 rpcz_store.cc:269] 0709 12:17:54.500611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.510996 (+ 10385us) service_pool.cc:224] Handling call
0709 12:17:56.747941 (+2236945us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540028cb54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:56.748043 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":618376704}
I20260709 12:17:56.750710 24093 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:56.752888 24167 raft_consensus.cc:2393] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:56.750066 24095 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:17:56.754789 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.742113 25999 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.755479 24095 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:56.756544 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.757200 24094 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:17:56.757454 25999 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.759281 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1486) took 1343 ms. Trace:
I20260709 12:17:56.759756 24167 rpcz_store.cc:276] 0709 12:17:55.415736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.732212 (+1316476us) service_pool.cc:224] Handling call
0709 12:17:56.759205 (+ 26993us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.760593 24093 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:56.734843 26222 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:56.778852 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.760876 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.761220 24101 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:56.762472 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.748624 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:56.776294 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.792722 24174 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.795774 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:56.806144 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:56.811560 26138 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:56.812070 26138 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:56.821084 26084 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.774015 26177 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:56.823859 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:56.824221 24174 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:56.839679 26002 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:56.824467 24170 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:56.813046 26138 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:56.841984 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1487) took 1426 ms. Trace:
I20260709 12:17:56.842480 26138 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.833377 26046 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:17:56.843559 26046 consensus_queue.cc:1243] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer 729aa4b1ccec48b588c14e67652c61e1 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:17:56.844271 26046 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:56.829813 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:56.845029 24812 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.842499 24170 rpcz_store.cc:276] 0709 12:17:55.416033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.744228 (+1328195us) service_pool.cc:224] Handling call
0709 12:17:56.841884 (+ 97656us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.847196 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.848129 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1490) took 1431 ms. Trace:
I20260709 12:17:56.848551 24170 rpcz_store.cc:276] 0709 12:17:55.416969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.846772 (+1429803us) service_pool.cc:224] Handling call
0709 12:17:56.848046 (+  1274us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.849673 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.838601 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.853984 24174 raft_consensus.cc:2368] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:17:56.809294 25942 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:56.855614 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1496) took 1199 ms. Trace:
I20260709 12:17:56.856235 24174 rpcz_store.cc:276] 0709 12:17:55.655547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.838215 (+1182668us) service_pool.cc:224] Handling call
0709 12:17:56.854559 (+ 16344us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:56.859076 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.859634 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:56.860065 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.853086 26046 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:56.864741 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.830451 26130 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:56.870950 24095 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:56.871042 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.807144 24167 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:56.869025 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:56.875931 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1462) took 1936 ms. Trace:
W20260709 12:17:56.858016 26249 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:17:56.876327 24174 rpcz_store.cc:276] 0709 12:17:54.939794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.868640 (+1928846us) service_pool.cc:224] Handling call
0709 12:17:56.875859 (+  7219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.872825 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.877626 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.880270 24095 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:56.880268 24101 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:56.881747 24101 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:56.883801 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.868325 26046 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:56.885259 24101 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:56.869222 25971 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.260s	user 0.038s	sys 0.015s
W20260709 12:17:56.894393 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70692.7us
I20260709 12:17:56.895737 24170 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:56.897749 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:56.873430 25999 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:56.882846 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1488) took 1466 ms. Trace:
I20260709 12:17:56.900005 26130 consensus_queue.cc:1059] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:17:56.857702 25936 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:17:56.903373 26177 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:56.921824 26177 raft_consensus.cc:3055] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:56.922221 26177 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:56.922456 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1119) took 1737 ms. Trace:
I20260709 12:17:56.923110 26177 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:56.923884 24216 leader_election.cc:336] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.141s (SENT)
I20260709 12:17:56.922870 24250 rpcz_store.cc:276] 0709 12:17:55.185211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.186156 (+   945us) service_pool.cc:224] Handling call
0709 12:17:56.922246 (+1736090us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54000c6554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:56.922376 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2406777088}
I20260709 12:17:56.901779 24140 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:56.932509 24140 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:56.914330 24101 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:56.934087 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.935652 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.919806 24167 rpcz_store.cc:276] 0709 12:17:55.416399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.760565 (+1344166us) service_pool.cc:224] Handling call
0709 12:17:56.878319 (+117754us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:56.892292 26193 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:56.939102 24140 leader_election.cc:400] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
W20260709 12:17:56.948092 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:56.950034 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:56.914956 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47382.7us
I20260709 12:17:56.937458 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.955960 24101 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:56.944834 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:56.957543 24250 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:56.894923 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:56.961735 24092 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:17:56.962829 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 98059us
I20260709 12:17:56.952051 24093 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:56.896028 25975 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:56.898370 25971 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.297s	user 0.039s	sys 0.015s
I20260709 12:17:56.955472 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:56.936847 24812 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:56.989297 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:56.979769 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:56.979399 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:56.971971 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:56.984295 24096 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:17:57.045084 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.968163 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:57.046381 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:56.937963 25936 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:17:56.994634 24275 heartbeater.cc:646] Failed to heartbeat to 127.22.93.254:36285 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.93.254:36285 timed out after 15.000s (SENT)
I20260709 12:17:56.954560 26176 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:56.953277 26145 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:56.983035 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:56.966221 24067 leader_election.cc:336] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items
I20260709 12:17:57.057699 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:57.013686 26181 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:17:57.061622 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 95438.9us
I20260709 12:17:57.004307 24101 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:17:57.062635 24067 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items
I20260709 12:17:57.024914 24215 leader_election.cc:400] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:17:57.063635 24215 leader_election.cc:403] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:17:57.032151 24250 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:17:57.064100 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:57.064808 24101 raft_consensus.cc:2376] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5. Re-sending same reply.
W20260709 12:17:57.032673 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.035818 24066 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.036414 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1036) took 2755 ms. Trace:
I20260709 12:17:57.045260 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:56.988566 24095 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:57.069872 24066 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.068467 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:57.070887 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:57.071216 24101 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:57.072115 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:57.072404 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 47704.2us
I20260709 12:17:57.072744 24095 raft_consensus.cc:2376] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6. Re-sending same reply.
I20260709 12:17:57.073369 24215 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.073587 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:57.048648 24171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1043) took 2737 ms (client timeout 1606 ms). Trace:
W20260709 12:17:57.048782 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69148.5us
W20260709 12:17:57.049062 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 96752us
I20260709 12:17:57.070372 24093 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:57.076388 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:17:57.049448 24169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1477) took 1959 ms (client timeout 1905 ms). Trace:
W20260709 12:17:57.077219 24169 rpcz_store.cc:269] 0709 12:17:55.147507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.049237 (+1901730us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:57.049367 (+   130us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:57.066273 24168 rpcz_store.cc:276] 0709 12:17:54.281224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.290455 (+  9231us) service_pool.cc:224] Handling call
0709 12:17:54.401617 (+111162us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:56.109105 (+1707488us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.036067 (+926962us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54003f8754. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:57.036323 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3908636416}
W20260709 12:17:57.050089 24173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1481) took 1827 ms (client timeout 1656 ms). Trace:
W20260709 12:17:57.078303 24173 rpcz_store.cc:269] 0709 12:17:55.223248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.049867 (+1826619us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:57.050013 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:57.078655 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.050407 24176 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:17:57.077999 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:57.051295 24175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1472) took 2108 ms (client timeout 2101 ms). Trace:
I20260709 12:17:56.932304 25999 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:57.079622 24175 rpcz_store.cc:269] 0709 12:17:54.942794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.051044 (+2108250us) service_pool.cc:211] Skipping call since client already timed out
0709 12:17:57.051190 (+   146us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:17:57.080536 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.006649 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:57.081030 24093 raft_consensus.cc:2410] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:57.074577 24067 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:17:57.075176 24171 rpcz_store.cc:269] 0709 12:17:54.298972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.308892 (+  9920us) service_pool.cc:224] Handling call
0709 12:17:57.036588 (+2727696us) spinlock_profiling.cc:243] Waited 1.77 s on lock 0x7b540015c554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:57.036706 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4064153984}
I20260709 12:17:57.082605 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.029150 25942 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:57.074682 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:57.089699 24095 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:57.080539 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.075670 26126 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:57.082526 26136 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:57.057345 26140 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.103623 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:57.104574 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.105280 24169 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:57.090898 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.106515 24175 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:56.996706 26171 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:57.108788 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.083365 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:57.082684 26031 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:57.049829 25975 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.054828 24167 raft_consensus.cc:2376] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4. Re-sending same reply.
I20260709 12:17:57.082718 26267 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:57.057200 26145 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:57.096470 25999 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:57.099366 24096 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:17:57.101925 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.102336 24099 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:17:57.109211 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44564.8us
W20260709 12:17:57.161576 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59752.2us
W20260709 12:17:57.161966 24067 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items [suppressed 63 similar messages]
I20260709 12:17:57.162427 24140 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.107563 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.120289 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.163548 24172 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:17:57.165138 24172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1498) took 1327 ms (client timeout 1542 ms). Trace:
W20260709 12:17:57.165627 24172 rpcz_store.cc:269] 0709 12:17:55.837434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.119958 (+1282524us) service_pool.cc:224] Handling call
0709 12:17:57.165042 (+ 45084us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.167078 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.076315 25866 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.131896 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.182966 24170 raft_consensus.cc:2376] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5. Re-sending same reply.
I20260709 12:17:57.087486 25772 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:57.069191 26181 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:57.082856 25971 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:17:57.149714 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.194348 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.196125 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:57.151731 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 105254us
I20260709 12:17:57.089241 26193 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:17:57.089028 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.109268 26232 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.161429 26126 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:57.154335 26267 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:57.104140 25942 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:57.181476 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 108184us
I20260709 12:17:57.053215 25936 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:57.184119 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:57.254417 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.254719 24172 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:57.256102 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.256227 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.257135 24172 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:57.120648 26031 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.184648 24140 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.108942 26254 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:57.131424 26206 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:57.264587 26206 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:57.266122 26181 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.267578 26181 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:57.269091 26251 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:17:57.232168 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:57.271363 26269 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:57.271661 24807 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:57.271833 26269 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.160710 26145 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:17:57.164610 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 57144.2us
I20260709 12:17:57.233131 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.193585 25772 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.186682 26224 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:57.121495 26140 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:57.260243 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 75673us
I20260709 12:17:57.284359 24781 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.284543 24140 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.281450 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:57.181396 26277 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.261611 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.261044 26031 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.253720 26267 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:57.263792 26256 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:17:57.164499 24168 raft_consensus.cc:2368] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
W20260709 12:17:57.285928 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 123113us
W20260709 12:17:57.299597 24067 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Remote error: Service unavailable: RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items
I20260709 12:17:57.300190 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.271889 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.190160 25971 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:57.274690 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.282104 24170 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:57.283273 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:57.305274 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.287247 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.289554 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.261467 26126 raft_consensus.cc:697] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:57.314512 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.315917 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.182257 26253 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.123s
W20260709 12:17:57.318163 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 46371.4us
I20260709 12:17:57.278805 26177 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.338186 24173 raft_consensus.cc:2368] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:17:57.283627 25772 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.279735 24806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 191) took 1038 ms. Trace:
I20260709 12:17:57.282198 26269 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.283190 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:57.347532 24170 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 12:17:57.336529 24216 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.689s (SENT)
I20260709 12:17:57.330219 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:57.349769 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:57.350067 24174 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:57.348806 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1050) took 3047 ms. Trace:
I20260709 12:17:57.273810 26129 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:17:57.311517 25971 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:17:57.310953 26076 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.342826 26206 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:57.367909 24170 rpcz_store.cc:276] 0709 12:17:54.301028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.344599 (+3043571us) service_pool.cc:224] Handling call
0709 12:17:57.345085 (+   486us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:57.348403 (+  3318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.348712 (+   309us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.311240 26224 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:57.283319 26271 consensus_queue.cc:1059] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:17:57.372149 26272 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:57.329047 26168 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:57.296550 24809 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:57.356101 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1055) took 3053 ms. Trace:
I20260709 12:17:57.409610 24174 rpcz_store.cc:276] 0709 12:17:54.302385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.354972 (+3052587us) service_pool.cc:224] Handling call
0709 12:17:57.355400 (+   428us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.355644 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.355694 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:57.355755 (+    61us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:57.355806 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.355878 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.356016 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.339774 26277 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:57.334527 26275 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:57.364581 26254 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:57.408430 24170 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:17:57.408231 24167 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:57.421917 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1059) took 3115 ms. Trace:
I20260709 12:17:57.345438 24806 rpcz_store.cc:276] 0709 12:17:56.241005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.241162 (+   157us) service_pool.cc:224] Handling call
0709 12:17:57.279518 (+1038356us) spinlock_profiling.cc:243] Waited 9.73 ms on lock 0x7b54005d7fd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:57.279656 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22378240}
I20260709 12:17:57.430811 26254 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:57.431543 26084 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:57.433499 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:17:57.435047 26138 consensus_meta.cc:287] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.592s	user 0.013s	sys 0.000s
I20260709 12:17:57.436339 26171 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:57.437314 26002 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:17:57.440093 26268 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 12:17:57.443437 26259 log.cc:927] Time spent T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 12:17:57.425107 26275 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:57.446942 24169 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:57.447744 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1063) took 3140 ms. Trace:
I20260709 12:17:57.448297 24169 rpcz_store.cc:276] 0709 12:17:54.307415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.434525 (+3127110us) service_pool.cc:224] Handling call
0709 12:17:57.434904 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.447476 (+ 12572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.447678 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.450738 24169 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:57.451802 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1446) took 3142 ms. Trace:
I20260709 12:17:57.452286 24169 rpcz_store.cc:276] 0709 12:17:54.308887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.449684 (+3140797us) service_pool.cc:224] Handling call
0709 12:17:57.450467 (+   783us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.451443 (+   976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.451726 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.454418 25936 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:57.455503 26136 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.456076 26136 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:57.416584 26272 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:57.459707 26266 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:17:56.816419 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:17:57.461771 26224 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:57.467073 26253 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:57.467696 26253 raft_consensus.cc:697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:57.472723 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1045) took 3169 ms. Trace:
I20260709 12:17:57.473184 24176 rpcz_store.cc:276] 0709 12:17:54.299587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:54.810648 (+511061us) service_pool.cc:224] Handling call
0709 12:17:54.838454 (+ 27806us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.079333 (+2240879us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.468816 (+389483us) spinlock_profiling.cc:243] Waited 2.21 s on lock 0x7b540009f954. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:57.469073 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5086585600}
I20260709 12:17:57.454449 24169 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 5. Ops: []
W20260709 12:17:57.398630 26137 consensus_meta.cc:287] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.733s	user 0.015s	sys 0.000s
I20260709 12:17:57.427883 24168 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:57.477494 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1061) took 3170 ms. Trace:
I20260709 12:17:57.474706 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1447) took 3165 ms. Trace:
I20260709 12:17:57.428679 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1494) took 1910 ms. Trace:
I20260709 12:17:57.424536 24170 rpcz_store.cc:276] 0709 12:17:54.306048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.390196 (+3084148us) service_pool.cc:224] Handling call
0709 12:17:57.390549 (+   353us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.421601 (+ 31052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.421847 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.477918 24168 rpcz_store.cc:276] 0709 12:17:54.306732 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.427345 (+3120613us) service_pool.cc:224] Handling call
0709 12:17:57.427691 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.477153 (+ 49462us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.477418 (+   265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.478734 24173 rpcz_store.cc:276] 0709 12:17:55.518416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.079114 (+1560698us) service_pool.cc:224] Handling call
0709 12:17:57.428477 (+349363us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54003f7854. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:57.428616 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":537445760}
I20260709 12:17:57.479643 24170 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:57.478235 24169 rpcz_store.cc:276] 0709 12:17:54.309178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.453386 (+3144208us) service_pool.cc:224] Handling call
0709 12:17:57.454170 (+   784us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.474363 (+ 20193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.474626 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.468716 26253 consensus_queue.cc:237] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.475704 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1485) took 2060 ms. Trace:
I20260709 12:17:57.494570 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1449) took 3184 ms. Trace:
I20260709 12:17:57.504364 24176 rpcz_store.cc:276] 0709 12:17:54.309774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.487288 (+3177514us) service_pool.cc:224] Handling call
0709 12:17:57.493874 (+  6586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.494180 (+   306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.494210 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:57.494266 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:57.494306 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.494371 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.494493 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.495885 25942 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:57.412375 26140 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:57.499900 24168 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 5. Ops: []
I20260709 12:17:57.500008 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1406) took 1391 ms. Trace:
W20260709 12:17:57.511111 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 349536us
I20260709 12:17:57.520530 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1456) took 2891 ms. Trace:
I20260709 12:17:57.522974 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:57.521184 24168 rpcz_store.cc:276] 0709 12:17:54.629061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.499329 (+2870268us) service_pool.cc:224] Handling call
0709 12:17:57.499711 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.509200 (+  9489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.520424 (+ 11224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.502010 24100 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:17:57.503203 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1455) took 2934 ms. Trace:
I20260709 12:17:57.529013 24170 rpcz_store.cc:276] 0709 12:17:54.568798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.479047 (+2910249us) service_pool.cc:224] Handling call
0709 12:17:57.479417 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.498092 (+ 18675us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.503122 (+  5030us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:57.506350 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 225023us
W20260709 12:17:57.534703 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 250256us
W20260709 12:17:57.564846 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.509680 24098 rpcz_store.cc:276] 0709 12:17:56.116088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.426273 (+310185us) service_pool.cc:224] Handling call
0709 12:17:56.426736 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:56.427085 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:56.446424 (+ 19339us) log.cc:844] Serialized 14 byte log entry
0709 12:17:57.040077 (+593653us) spinlock_profiling.cc:243] Waited 1.41 ms on lock 0x7b18002db200. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b23a 00007f4c05585a2a
0709 12:17:57.179996 (+139919us) log.cc:844] Serialized 14 byte log entry
0709 12:17:57.499426 (+319430us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b18002db200. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02408c0a 00007f4c0bb48219 00007f4c02490a40 00007f4c0248b4e4 00007f4c0248b455 00007f4c05573060 00007f4c05585716 00007f4c05596287 00007f4c05596208
0709 12:17:57.499635 (+   209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:57.499694 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:57.499756 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.499823 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.499945 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":314290,"prepare.queue_time_us":19308,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":111,"raft.queue_time_us":408466,"raft.run_cpu_time_us":292,"raft.run_wall_time_us":16904,"spinlock_wait_cycles":56649344,"thread_start_us":139312,"threads_started":2,"wal-append.queue_time_us":739265}
I20260709 12:17:57.575634 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:17:57.580648 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 57866.9us
I20260709 12:17:57.589908 24176 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:17:57.592338 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.582919 24173 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:57.592952 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1461) took 2653 ms. Trace:
I20260709 12:17:57.593499 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1457) took 2939 ms. Trace:
I20260709 12:17:57.593459 24176 rpcz_store.cc:276] 0709 12:17:54.939455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.530203 (+2590748us) service_pool.cc:224] Handling call
0709 12:17:57.589370 (+ 59167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.592535 (+  3165us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.592860 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.594084 24173 rpcz_store.cc:276] 0709 12:17:54.654612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.507059 (+2852447us) service_pool.cc:224] Handling call
0709 12:17:57.582695 (+ 75636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.593195 (+ 10500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.593396 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.596429 24176 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:57.597575 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1470) took 2655 ms. Trace:
I20260709 12:17:57.598111 24176 rpcz_store.cc:276] 0709 12:17:54.942115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.594749 (+2652634us) service_pool.cc:224] Handling call
0709 12:17:57.596030 (+  1281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.597253 (+  1223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.597506 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.504128 25999 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:57.421535 26126 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:57.560840 26200 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.503844 24167 rpcz_store.cc:276] 0709 12:17:55.415408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.224320 (+1808912us) service_pool.cc:224] Handling call
0709 12:17:57.475613 (+251293us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.622763 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.629938 24173 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:57.630406 24140 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:57.624197 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.574815 26272 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:57.446760 26275 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.575201 26281 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:57.619761 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:57.630781 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1482) took 2364 ms. Trace:
I20260709 12:17:57.632366 26252 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:57.640901 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 307593us
I20260709 12:17:57.639173 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.527230 25975 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:57.642371 24173 rpcz_store.cc:276] 0709 12:17:55.266490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.615839 (+2349349us) service_pool.cc:224] Handling call
0709 12:17:57.629424 (+ 13585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.630449 (+  1025us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.630705 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.641462 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:57.616636 25413 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:57.650136 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.646469 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:57.647361 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:57.650244 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 74749.3us
I20260709 12:17:57.663864 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:17:57.664126 24176 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:57.619827 26171 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:57.581125 26286 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:57.665902 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1484) took 2276 ms. Trace:
I20260709 12:17:57.666489 24176 rpcz_store.cc:276] 0709 12:17:55.389727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.614550 (+2224823us) service_pool.cc:224] Handling call
0709 12:17:57.648072 (+ 33522us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.665056 (+ 16984us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.665797 (+   741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:57.636401 26277 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:57.684928 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.669034 24214 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.668004 26286 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:57.687198 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.650658 26287 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:57.642396 26281 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:57.625243 25999 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.691840 24214 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.648725 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:57.661290 26266 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
W20260709 12:17:57.694654 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.694417 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 357899us
I20260709 12:17:57.665958 26130 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:17:57.675488 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 362602us
I20260709 12:17:57.693285 26286 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:57.733170 24779 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.668399 24808 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:57.633206 26200 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:57.688076 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 388583us
W20260709 12:17:57.748853 24067 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.511s (SENT)
I20260709 12:17:57.749475 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.687268 26252 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:17:57.691500 26279 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:57.707218 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:57.693957 26272 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:57.695873 26208 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:57.693322 26137 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:57.795259 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.694592 26287 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:57.795997 26287 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.796860 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.798292 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.687538 26285 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:57.723944 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.799252 26285 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:17:57.799705 26285 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:57.800309 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.737802 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:57.801553 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.699747 26281 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:57.763554 24067 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.546s (SENT)
I20260709 12:17:57.804313 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:57.806298 26117 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:57.806743 26117 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:57.807300 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.807483 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:57.807641 26117 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.808287 24245 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:57.802672 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:57.809675 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46178us
W20260709 12:17:57.810334 24067 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.580s (SENT)
W20260709 12:17:57.811195 24067 leader_election.cc:336] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.593s (SENT)
I20260709 12:17:57.811543 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:57.812590 24067 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.606s (SENT)
I20260709 12:17:57.812979 24067 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.715610 26171 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.786619 25772 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.814802 26279 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:57.831926 26279 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.700950 26267 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.835361 26267 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:57.836090 24168 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:57.768908 24249 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:57.839687 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:57.841168 26145 consensus_meta.cc:287] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.000s
I20260709 12:17:57.841603 26145 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.842187 26272 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:57.842607 24171 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:57.770454 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.773357 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.777792 26002 raft_consensus.cc:3055] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:57.766644 26138 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.849220 26138 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.779452 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:57.779704 26291 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:17:57.782387 26200 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:57.756325 24167 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:57.783085 26269 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.732414 26284 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:57.760238 26012 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:57.755950 26169 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:17:57.847918 26002 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:57.787062 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.787376 26031 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.878196 24242 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.788664 26252 raft_consensus.cc:697] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:17:57.788829 26260 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 12:17:57.789511 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1082) took 1149 ms. Trace:
I20260709 12:17:57.897667 24175 rpcz_store.cc:276] 0709 12:17:56.639798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.108472 (+468674us) service_pool.cc:224] Handling call
0709 12:17:57.789272 (+680800us) spinlock_profiling.cc:243] Waited 622 ms on lock 0x7b54003eb2d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:57.789442 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1430435072}
I20260709 12:17:57.792055 26208 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:57.794265 24781 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.795171 26137 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:57.664868 26206 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:57.808038 24241 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
W20260709 12:17:57.733770 26046 consensus_meta.cc:287] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.823s	user 0.011s	sys 0.003s
I20260709 12:17:57.815492 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:57.816982 24067 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.638s (SENT)
I20260709 12:17:57.718562 26277 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:57.824843 26300 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.911545 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:57.912606 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 95646us
W20260709 12:17:57.913719 24067 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.742s (SENT)
I20260709 12:17:57.914153 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:57.814664 25413 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.915738 25413 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.916505 25413 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.827450 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.917514 24246 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:57.767838 26299 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:57.828850 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 121776us
I20260709 12:17:57.829551 26129 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:17:57.921695 26129 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.922297 26129 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:57.829439 26278 consensus_queue.cc:1059] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:57.923900 26278 raft_consensus.cc:3055] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:57.830173 26280 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:17:57.839895 26290 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.204s	user 0.003s	sys 0.000s
I20260709 12:17:57.848057 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.852267 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1469) took 2910 ms. Trace:
W20260709 12:17:57.853185 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 168357us
W20260709 12:17:57.855521 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.772493 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:57.867960 24100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1399) took 1952 ms (client timeout 1944 ms). Trace:
I20260709 12:17:57.844424 26117 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:57.845026 25772 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:57.881512 26289 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.786576 25999 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:57.867542 26138 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:57.887964 26284 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:57.901000 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1466) took 2960 ms. Trace:
I20260709 12:17:57.886552 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.886415 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:17:57.905198 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 111076us
I20260709 12:17:57.890753 26012 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:57.848773 26272 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.891119 25971 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.908655 24169 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
W20260709 12:17:57.949753 24067 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.806s (SENT)
I20260709 12:17:57.898957 24243 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:57.949522 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1558) took 1076 ms. Trace:
I20260709 12:17:57.898187 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1497) took 2104 ms. Trace:
I20260709 12:17:57.906749 26137 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:57.954768 24140 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:57.949898 24100 rpcz_store.cc:269] 0709 12:17:55.915552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:55.945392 (+ 29840us) service_pool.cc:224] Handling call
0709 12:17:57.867669 (+1922277us) spinlock_profiling.cc:243] Waited 1.53 s on lock 0x7b54001f40d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:57.867841 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3517778816}
I20260709 12:17:57.949591 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:57.951720 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:57.929630 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:57.932199 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:57.965704 24174 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
W20260709 12:17:57.963028 24067 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.827s (SENT)
I20260709 12:17:57.954082 24094 rpcz_store.cc:276] 0709 12:17:56.872935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.878850 (+  5915us) service_pool.cc:224] Handling call
0709 12:17:56.879239 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:56.879501 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:56.879527 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:56.893278 (+ 13751us) log.cc:844] Serialized 26 byte log entry
0709 12:17:57.123178 (+229900us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:57.123221 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.123308 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.931938 (+808630us) raft_consensus.cc:1685] finished
0709 12:17:57.931967 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.949444 (+ 17477us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":160741,"threads_started":1,"wal-append.queue_time_us":484753}
I20260709 12:17:57.924293 26278 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:57.906958 26206 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:57.972303 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:57.950325 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:57.999540 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:58.005656 24140 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:58.006644 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.002771 24171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1483) took 2617 ms (client timeout 2892 ms). Trace:
W20260709 12:17:58.007915 24171 rpcz_store.cc:269] 0709 12:17:55.385361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.082354 (+1696993us) service_pool.cc:224] Handling call
0709 12:17:58.002572 (+920218us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b5400210554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:58.002702 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1746013952}
I20260709 12:17:57.997991 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1407) took 1874 ms. Trace:
I20260709 12:17:58.009088 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:58.009229 24097 rpcz_store.cc:276] 0709 12:17:56.123539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.437928 (+314389us) service_pool.cc:224] Handling call
0709 12:17:57.868535 (+1430607us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.869008 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.869050 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:57.869121 (+    71us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:57.869193 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.869278 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.997755 (+128477us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54001f40d0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:17:57.997906 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":638,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":7885,"spinlock_wait_cycles":3289293696}
I20260709 12:17:57.950785 24168 rpcz_store.cc:276] 0709 12:17:54.940959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.524527 (+2583568us) service_pool.cc:224] Handling call
0709 12:17:57.525024 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.836520 (+311496us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.900618 (+ 64098us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54003f7d54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:57.900902 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":714848000}
I20260709 12:17:58.011489 24100 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.010612 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:58.012614 24095 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.929841 26269 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:57.953752 26012 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.959841 26285 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:58.013993 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 63776.1us
I20260709 12:17:57.997664 26138 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:57.950848 24170 rpcz_store.cc:276] 0709 12:17:54.941849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.530082 (+2588233us) service_pool.cc:224] Handling call
0709 12:17:57.530554 (+   472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:17:57.580918 (+ 50364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.580956 (+    38us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:17:57.581655 (+   699us) log.cc:844] Serialized 52 byte log entry
0709 12:17:57.768839 (+187184us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:57.846387 (+ 77548us) log.cc:844] Serialized 14 byte log entry
0709 12:17:57.847156 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.847352 (+   196us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:57.851937 (+  4585us) raft_consensus.cc:1685] finished
0709 12:17:57.851971 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:57.852188 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49835,"prepare.queue_time_us":77356,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":51509,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":128,"spinlock_wait_cycles":17974528,"thread_start_us":186757,"threads_started":1,"wal-append.queue_time_us":267382}
I20260709 12:17:58.042953 24100 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:17:57.907570 26168 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:57.944145 26145 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:57.927966 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:57.927532 26252 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:57.936674 26046 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.943141 26277 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:58.001636 26278 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:58.002056 26253 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:58.018764 24246 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:58.029958 24175 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:58.031559 24781 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:58.017817 24214 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:57.959321 26284 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.957129 26031 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:58.016040 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:58.100013 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 84062.5us
I20260709 12:17:58.044243 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1465) took 3103 ms. Trace:
I20260709 12:17:58.027484 25971 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:58.034605 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:58.087162 24241 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:17:57.935930 26208 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:57.940873 26136 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.027858 24092 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.032349 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:58.091271 24095 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:58.025801 24244 raft_consensus.cc:2410] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 7 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:17:58.015417 26206 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:17:58.093962 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 76230us
W20260709 12:17:58.040623 26290 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 12:17:58.093994 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 62529.5us
I20260709 12:17:58.137071 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:58.026012 26171 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:58.027220 26305 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:17:58.101022 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 138059us
I20260709 12:17:58.020148 26287 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:58.050493 24168 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:58.030957 26285 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:58.018453 26297 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:57.955890 24167 rpcz_store.cc:276] 0709 12:17:55.792179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.642550 (+1850371us) service_pool.cc:224] Handling call
0709 12:17:57.698843 (+ 56293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.884167 (+185324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:57.895959 (+ 11792us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:58.110558 26177 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:17:57.956990 26289 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.110337 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:58.113633 24100 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.122927 24095 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:17:58.070855 26149 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:17:58.101263 26271 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:58.031580 26138 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.143769 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:58.138675 24781 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:58.101181 24169 rpcz_store.cc:276] 0709 12:17:54.940681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.520605 (+2579924us) service_pool.cc:224] Handling call
0709 12:17:57.871966 (+351361us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:17:57.872255 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.956542 (+ 84287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.043926 (+ 87384us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b54003ea3d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:58.044158 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86035072}
I20260709 12:17:58.148705 24248 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:17:58.148196 24067 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.504s (SENT)
I20260709 12:17:58.167960 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:58.034312 26286 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:57.935055 26002 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.107369 24172 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.110076 26278 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.156939 24246 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:58.152916 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:58.128919 25936 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:58.165540 24173 raft_consensus.cc:1240] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:58.148267 26222 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:58.158712 26171 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:17:58.157927 26084 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:58.159204 26300 consensus_queue.cc:1059] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
W20260709 12:17:58.208669 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.204931 24171 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:58.196327 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1060) took 3890 ms. Trace:
I20260709 12:17:58.212278 24174 rpcz_store.cc:276] 0709 12:17:54.306398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.410664 (+3104266us) service_pool.cc:224] Handling call
0709 12:17:57.411056 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:57.966163 (+555107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.196004 (+229841us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b54003f8254. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:58.196249 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275086208}
I20260709 12:17:58.207531 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:58.198133 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 215) took 1147 ms. Trace:
I20260709 12:17:58.218936 24173 rpcz_store.cc:276] 0709 12:17:57.050385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.675280 (+624895us) service_pool.cc:224] Handling call
0709 12:17:57.700526 (+ 25246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.180129 (+479603us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.197856 (+ 17727us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54002af8d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:58.198066 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1068905728}
I20260709 12:17:58.155367 26272 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:17:58.184851 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:58.180325 26168 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:17:58.185742 24092 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:58.176421 26299 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:58.169826 26177 raft_consensus.cc:697] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:17:58.196254 26313 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:17:58.179376 26200 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:58.183974 26269 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:58.199121 26304 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
W20260709 12:17:58.197072 26309 log.cc:927] Time spent T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:17:58.266009 24216 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.542s (SENT)
I20260709 12:17:58.200263 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:17:58.306707 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.206826 26287 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:58.205471 26046 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:58.199095 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:58.204619 26286 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:58.262912 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:58.276474 26177 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.286237 26275 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:17:58.255275 25772 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.314293 25772 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:58.297823 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 159225us
W20260709 12:17:58.298844 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 146054us
I20260709 12:17:58.316758 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:58.300417 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 152265us
W20260709 12:17:58.318081 24067 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.656s (SENT)
I20260709 12:17:58.318120 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:58.304611 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:58.318627 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:58.204484 24094 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 2. (term mismatch)
I20260709 12:17:58.319681 24094 pending_rounds.cc:85] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 1
I20260709 12:17:58.257860 26084 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:58.336086 26084 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:58.320008 24094 pending_rounds.cc:107] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:58.319761 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:58.337097 24094 raft_consensus.cc:2889] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:58.337527 24094 pending_rounds.cc:107] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:17:58.337770 24094 raft_consensus.cc:2889] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:58.338146 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:58.339444 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:58.340165 24096 raft_consensus.cc:2368] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:17:58.308400 26269 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:58.341251 26269 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.322497 26299 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:58.342898 26299 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:58.316147 26293 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.343359 26299 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.343807 26293 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:17:58.344936 24216 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.597s (SENT)
I20260709 12:17:58.345336 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:58.346215 26293 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:17:58.346633 24067 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.226s (SENT)
I20260709 12:17:58.322846 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:58.347676 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:58.323457 25999 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:58.323621 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:58.324057 25772 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:58.320968 24066 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:58.192178 26277 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.329003 26137 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:58.403394 26137 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:58.330897 26171 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.332828 26200 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:58.333468 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:58.407032 24098 raft_consensus.cc:2393] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:58.316386 24241 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.408388 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.408812 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.409720 24168 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:58.409859 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.410557 24169 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:58.411594 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.412173 24174 raft_consensus.cc:2376] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4. Re-sending same reply.
I20260709 12:17:58.412349 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.298162 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:17:58.348877 24067 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.228s (SENT)
I20260709 12:17:58.413059 24168 raft_consensus.cc:2376] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4. Re-sending same reply.
W20260709 12:17:58.349466 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.413916 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:58.414152 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.309049 26303 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.415277 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.415367 26303 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.416044 24167 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:58.354141 26140 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.397825 24066 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:58.417155 26287 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.401072 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:58.413400 24067 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:58.426301 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.542373 24175 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:58.421128 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.426501 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.544450 24168 raft_consensus.cc:2410] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:17:58.545104 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.546077 24174 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:58.439934 24170 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:58.440485 26168 consensus_queue.cc:1059] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:17:58.359032 26136 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:58.391392 26169 consensus_queue.cc:1059] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:17:58.397167 26031 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:58.414089 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:58.390847 26222 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 12:17:58.426699 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:17:58.446225 23995 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 190) took 16546 ms (client timeout 15000 ms). Trace:
I20260709 12:17:58.448957 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:58.356854 26300 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:58.455531 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:58.417048 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.422535 26129 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.395879 26046 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:58.330762 24242 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:58.420920 26140 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.464821 24812 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:17:58.516534 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 118791us
I20260709 12:17:58.685257 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:58.473941 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:58.480079 24241 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:58.686472 24097 raft_consensus.cc:2368] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4.
W20260709 12:17:58.572875 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 224010us
I20260709 12:17:58.582151 26137 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:58.687326 24241 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:17:58.687598 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.687809 24249 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:17:58.500191 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.577512 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.689913 24174 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.578527 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.691352 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.580691 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.692435 24168 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:58.673516 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.693375 24175 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:17:58.458880 26281 consensus_meta.cc:287] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.656s	user 0.010s	sys 0.007s
I20260709 12:17:58.694741 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.572829 26200 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:58.701433 24174 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:58.702474 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.704273 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.539085 26138 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:58.573266 26297 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:58.681718 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:58.579897 26031 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:17:58.688088 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.573803 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.468832 26280 raft_consensus.cc:3055] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:58.717286 24169 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:17:58.699688 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 350865us
W20260709 12:17:58.717913 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 406632us
I20260709 12:17:58.539319 26012 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:58.709280 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.725039 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.726467 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.468055 26284 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:17:58.716399 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:58.700417 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 354384us
I20260709 12:17:58.572372 26287 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.663707 24809 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:17:58.674746 26293 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:17:58.727916 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.730093 24168 raft_consensus.cc:2376] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5. Re-sending same reply.
I20260709 12:17:58.754390 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.731061 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.756098 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.757213 24170 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:17:58.757592 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:58.758241 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.735953 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:58.759398 24250 raft_consensus.cc:2368] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:17:58.760026 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:58.760697 24097 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:17:58.760877 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.761595 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:58.761751 24168 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:58.762354 24097 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 5: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:58.739903 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:58.701476 26200 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:58.767338 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:58.768123 24101 raft_consensus.cc:2368] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:17:58.718429 26031 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.749765 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:58.734091 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:58.762900 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.693928 26222 raft_consensus.cc:3055] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:17:58.719421 26300 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:17:58.584537 23995 rpcz_store.cc:269] 0709 12:17:41.899952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:41.900218 (+   266us) service_pool.cc:224] Handling call
0709 12:17:42.021041 (+120823us) spinlock_profiling.cc:243] Waited 43.1 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:17:58.446101 (+16425060us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:17:53.183337 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:17:53.184116 (+   779us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:17:53.184171 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:17:53.184181 (+    10us) tablet.cc:662] Decoding operations
0709 12:17:53.185177 (+   996us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:17:53.185267 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:17:53.185295 (+    28us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:17:53.186022 (+   727us) tablet.cc:701] Row locks acquired
0709 12:17:53.186073 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:17:53.186277 (+   204us) write_op.cc:270] Start()
0709 12:17:53.186439 (+   162us) write_op.cc:276] Timestamp: P: 1783599473186189 usec, L: 0
0709 12:17:53.186459 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:17:53.236804 (+ 50345us) log.cc:844] Serialized 2869 byte log entry
0709 12:17:53.847940 (+611136us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c024710ac 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b
0709 12:17:54.682922 (+834982us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:56.097585 (+1414663us) op_driver.cc:464] REPLICATION: finished
0709 12:17:56.338239 (+240654us) write_op.cc:301] APPLY: starting
0709 12:17:56.338377 (+   138us) tablet.cc:1367] starting BulkCheckPresence
0709 12:17:56.338600 (+   223us) tablet.cc:1370] finished BulkCheckPresence
0709 12:17:56.338642 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:17:56.358860 (+ 20218us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:17:56.359228 (+   368us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:17:56.359287 (+    59us) write_op.cc:312] APPLY: finished
0709 12:17:56.359696 (+   409us) log.cc:844] Serialized 58 byte log entry
0709 12:17:56.359964 (+   268us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:56.360121 (+   157us) write_op.cc:454] Released schema lock
0709 12:17:56.360194 (+    73us) write_op.cc:341] FINISH: Updating metrics
0709 12:17:56.360717 (+   523us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:17:56.360759 (+    42us) write_op.cc:454] Released schema lock
0709 12:17:56.481254 (+120495us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557832a 00007f4c054fdf14 00007f4c054fdec3 00007f4c054fde38 00007f4c054fddf3 00007f4c054fd0dc 00007f4c05526e16 00007f4c0550ecbb 00007f4c054f939d 00007f4c054fcd75
Metrics: {"mutex_wait_us":26098,"reported_tablets":22,"spinlock_wait_cycles":99104512,"child_traces":[["op",{"apply.queue_time_us":227801,"apply.run_cpu_time_us":4087,"apply.run_wall_time_us":22442,"num_ops":7,"prepare.queue_time_us":188402,"prepare.run_cpu_time_us":48350,"prepare.run_wall_time_us":896186,"raft.queue_time_us":866009,"raft.run_cpu_time_us":15486,"raft.run_wall_time_us":458211,"replication_time_us":2858800,"spinlock_wait_cycles":18125696,"thread_start_us":1391566,"threads_started":4,"wal-append.queue_time_us":800647,"wal-append.run_cpu_time_us":43890,"wal-append.run_wall_time_us":3365229}]]}
I20260709 12:17:58.766506 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.768352 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.788384 24174 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:58.789497 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.722806 26126 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:17:58.773921 24168 raft_consensus.cc:2393] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:58.717549 26280 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:58.688635 26046 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:58.753118 26297 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:58.790649 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.800668 24174 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 2.
I20260709 12:17:58.801317 24101 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:58.748226 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:58.710609 26281 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:58.770505 26200 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:58.775907 24167 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:58.779270 26222 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:58.800014 24215 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:17:58.792457 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55757us
I20260709 12:17:58.806005 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.764513 26293 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:58.786091 26303 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:58.809659 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.231482 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.232123 24168 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
W20260709 12:17:58.834682 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 149514us
I20260709 12:17:59.235265 26046 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:59.141920 26307 log.cc:927] Time spent T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 1.047s	user 0.006s	sys 0.000s
I20260709 12:17:59.237785 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 218) took 2130 ms. Trace:
I20260709 12:17:59.237926 24169 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
W20260709 12:17:59.158191 26206 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.004s	user 0.018s	sys 0.003s
I20260709 12:17:59.128226 26284 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:58.914500 26289 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:17:59.204005 26278 consensus_meta.cc:287] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.022s	user 0.010s	sys 0.010s
I20260709 12:17:59.238211 24176 rpcz_store.cc:276] 0709 12:17:57.107182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.676107 (+568925us) service_pool.cc:224] Handling call
0709 12:17:57.676497 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:57.708422 (+ 31925us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:57.708471 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:57.717852 (+  9381us) log.cc:844] Serialized 26 byte log entry
0709 12:17:57.903013 (+185161us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:17:57.903090 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.190142 (+287052us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b54002aeed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:58.190207 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:58.918556 (+728349us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:59.237529 (+318973us) raft_consensus.cc:1685] finished
0709 12:17:59.237553 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.237710 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43142,"raft.queue_time_us":24696,"raft.run_cpu_time_us":423,"raft.run_wall_time_us":27996,"spinlock_wait_cycles":43656320,"thread_start_us":123167,"threads_started":1,"wal-append.queue_time_us":309159}
W20260709 12:17:59.240161 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 387606us
I20260709 12:17:59.189215 26126 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.241168 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.241014 26126 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.242518 24093 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:59.242420 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.125070 24809 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:17:59.243727 24176 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:59.137836 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1390) took 1305 ms. Trace:
I20260709 12:17:59.244922 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.246214 24176 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 3: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:59.248319 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:59.246366 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.233598 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:59.250232 24174 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:58.843863 24173 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:59.245244 24246 rpcz_store.cc:276] 0709 12:17:57.831899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.396483 (+564584us) service_pool.cc:224] Handling call
0709 12:17:58.411494 (+ 15011us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.411888 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.411918 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.412423 (+   505us) log.cc:844] Serialized 26 byte log entry
0709 12:17:58.721376 (+308953us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:17:58.721419 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.721487 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:59.137477 (+415990us) raft_consensus.cc:1685] finished
0709 12:17:59.137510 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.137729 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":87,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"thread_start_us":308460,"threads_started":1,"wal-append.queue_time_us":634262}
I20260709 12:17:59.250149 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.785403 24807 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:17:59.253549 24066 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:58.914880 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1047) took 4614 ms. Trace:
I20260709 12:17:59.255323 26287 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:58.784360 26300 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:58.906976 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 129621us
I20260709 12:17:58.917873 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 225) took 1638 ms. Trace:
I20260709 12:17:59.303508 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 157) took 1238 ms. Trace:
I20260709 12:17:58.946545 24094 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:59.231489 24170 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
W20260709 12:17:59.267954 26331 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.417s	user 0.003s	sys 0.004s
I20260709 12:17:58.825475 26280 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.305127 24241 rpcz_store.cc:276] 0709 12:17:58.064986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.688175 (+623189us) service_pool.cc:224] Handling call
0709 12:17:58.732498 (+ 44323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.732770 (+   272us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:17:58.764086 (+ 31316us) log.cc:844] Serialized 14 byte log entry
0709 12:17:59.302941 (+538855us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:59.303043 (+   102us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:17:59.303122 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.303231 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.303413 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53583,"prepare.queue_time_us":35631,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":54690,"thread_start_us":484641,"threads_started":1,"wal-append.queue_time_us":483566}
W20260709 12:17:59.300464 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47026.4us
I20260709 12:17:59.304896 24171 rpcz_store.cc:276] 0709 12:17:57.279119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.008811 (+729692us) service_pool.cc:224] Handling call
0709 12:17:58.036466 (+ 27655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.210033 (+173567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.917529 (+707496us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b54002ae9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:58.917773 (+   244us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386857216}
I20260709 12:17:59.252285 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:59.300509 24172 rpcz_store.cc:276] 0709 12:17:54.300125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.340254 (+3040129us) service_pool.cc:224] Handling call
0709 12:17:57.340721 (+   467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:58.174446 (+833725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.914511 (+740065us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54003e03d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:58.914777 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1754774400}
I20260709 12:17:59.256605 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:58.800174 26297 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:59.173511 24175 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:59.317957 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:58.915884 26320 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:17:58.973313 26327 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:59.311957 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:58.914736 26326 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:17:59.239116 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.311163 24167 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
W20260709 12:17:59.313943 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 565797us
I20260709 12:17:58.849756 26325 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.252734 26138 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:17:59.300172 26117 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.343s	user 0.024s	sys 0.000s
I20260709 12:17:59.306149 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:59.320665 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.395805 24172 raft_consensus.cc:1813] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Handling vote request from an unknown peer fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:59.321691 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:59.304006 26299 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.960s	user 0.016s	sys 0.022s
I20260709 12:17:58.848276 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:59.402274 24244 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:59.402884 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1150) took 1302 ms. Trace:
I20260709 12:17:59.403251 24244 rpcz_store.cc:276] 0709 12:17:58.100684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.847792 (+747108us) service_pool.cc:224] Handling call
0709 12:17:59.402809 (+555017us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:59.407334 26299 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.409788 26299 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:59.410283 26171 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:17:59.411237 24095 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:59.411989 26126 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:59.413317 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1394) took 1544 ms. Trace:
I20260709 12:17:59.413568 26297 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.413772 24243 rpcz_store.cc:276] 0709 12:17:57.869442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.456005 (+586563us) service_pool.cc:224] Handling call
0709 12:17:58.456424 (+   419us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.456734 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.456762 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.457400 (+   638us) log.cc:844] Serialized 26 byte log entry
0709 12:17:58.763683 (+306283us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:58.771353 (+  7670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.779821 (+  8468us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:59.267079 (+487258us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:17:59.412928 (+145849us) raft_consensus.cc:1685] finished
0709 12:17:59.412954 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.413236 (+   282us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41309952,"thread_start_us":281196,"threads_started":1,"wal-append.queue_time_us":392575}
I20260709 12:17:59.415020 26297 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.385053 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:17:59.307736 26046 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.351229 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:59.444639 24101 raft_consensus.cc:2393] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:59.322182 24174 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:17:59.445191 24176 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.445942 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:17:59.393585 26208 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.010s	sys 0.083s
I20260709 12:17:59.383966 26280 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.351452 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.396255 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:59.393649 26177 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:59.238927 26206 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.397434 24094 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:59.394941 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.399151 24172 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:59.400182 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.458559 24175 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:17:58.796445 26136 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.478s
I20260709 12:17:59.308568 26300 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:17:59.392385 24168 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:17:58.852370 26319 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.570s
I20260709 12:17:59.307757 26334 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:17:59.367746 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 567816us
I20260709 12:17:59.323468 26129 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:59.369800 25971 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:17:59.454371 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 58257.6us
I20260709 12:17:59.536829 24140 leader_election.cc:400] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:17:59.537180 24140 leader_election.cc:403] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:17:59.396597 24170 raft_consensus.cc:2376] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4. Re-sending same reply.
W20260709 12:17:59.537488 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.537825 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1530) took 1071 ms. Trace:
I20260709 12:17:59.538182 24170 rpcz_store.cc:276] 0709 12:17:58.466075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.321359 (+855284us) service_pool.cc:224] Handling call
0709 12:17:59.537753 (+216394us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:17:59.397579 26138 consensus_queue.cc:1243] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:17:59.450867 26208 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.014s	sys 0.092s
I20260709 12:17:59.460850 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.462800 24167 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:59.394959 26281 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:59.539274 24174 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:17:59.419785 26284 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.567294 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1519) took 1112 ms. Trace:
I20260709 12:17:59.567800 24169 rpcz_store.cc:276] 0709 12:17:58.463219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.443897 (+980678us) service_pool.cc:224] Handling call
0709 12:17:59.567206 (+123309us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:17:59.527112 26338 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
I20260709 12:17:59.569954 24175 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:59.561730 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:17:59.563665 24100 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:17:59.565147 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1429) took 1239 ms. Trace:
I20260709 12:17:59.550514 24176 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:59.571105 24096 rpcz_store.cc:276] 0709 12:17:58.325623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.340737 (+ 15114us) service_pool.cc:224] Handling call
0709 12:17:58.341097 (+   360us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:58.341489 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:58.341516 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:58.342034 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:17:58.689517 (+347483us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:58.689559 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:58.689631 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:17:59.564887 (+875256us) raft_consensus.cc:1685] finished
0709 12:17:59.564915 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.565068 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1707,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":347047,"threads_started":1,"wal-append.queue_time_us":473545}
I20260709 12:17:59.566246 24170 raft_consensus.cc:1240] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
I20260709 12:17:59.400484 26327 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.576337 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:59.460635 26177 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.577116 24806 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:17:59.460417 26126 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 12:17:59.448117 26332 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 12:17:59.563158 26334 raft_consensus.cc:697] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:59.400781 26325 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.580806 26334 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.582270 26325 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:59.584537 26293 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:59.444347 26222 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.588642 24808 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:17:59.591163 26277 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:17:59.591481 26284 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.592329 26206 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:59.594182 26327 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:59.595639 24215 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:59.596678 26129 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:59.597090 26129 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.597427 26129 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:59.452359 26046 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.582904 26325 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:59.599725 26046 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:59.599550 26325 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.601825 26208 consensus_queue.cc:1059] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:17:59.602603 26325 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:59.603024 26208 raft_consensus.cc:3055] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:17:59.603403 26208 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:59.604322 26208 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.605211 26002 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.605967 26208 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.454947 26336 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:17:59.606693 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:17:59.608705 26336 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:59.609131 26336 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.611340 25971 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:17:59.613513 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:17:59.528925 26278 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:17:59.607694 24096 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:17:59.619693 24096 pending_rounds.cc:85] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 5
I20260709 12:17:59.619980 24096 pending_rounds.cc:107] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:17:59.620291 24096 raft_consensus.cc:2889] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:59.621479 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:59.622313 24096 raft_consensus.cc:2410] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:17:59.466609 26252 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:17:59.467764 26299 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.578750 26177 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:59.626958 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:59.628187 24096 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
W20260709 12:17:59.628135 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 314862us
I20260709 12:17:59.629343 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:59.630299 24096 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
W20260709 12:17:59.623955 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.634196 24096 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:17:59.625092 26031 consensus_meta.cc:287] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.830s	user 0.011s	sys 0.001s
I20260709 12:17:59.638357 24171 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:17:59.637984 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 365541us
W20260709 12:17:59.646893 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.647796 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:17:59.654485 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 339915us
I20260709 12:17:59.655063 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:59.655794 24096 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
W20260709 12:17:59.656577 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 404376us
I20260709 12:17:59.636718 26171 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.661942 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:59.664565 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:17:59.662165 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:59.667966 24066 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:59.681751 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:59.660252 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:17:59.705956 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49982.4us
I20260709 12:17:59.686233 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:59.689729 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:59.662799 26281 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:17:59.687227 26206 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:59.653576 26031 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.717885 26345 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.717885 26344 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.012s
I20260709 12:17:59.728482 26344 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:17:59.688211 26084 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:17:59.683573 26171 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.710916 26343 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:17:59.725435 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1107) took 1141 ms. Trace:
I20260709 12:17:59.781287 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:59.771227 24067 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:17:59.783725 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.783420 24172 rpcz_store.cc:276] 0709 12:17:58.583408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.456710 (+873302us) service_pool.cc:224] Handling call
0709 12:17:59.457135 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.457427 (+   292us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:17:59.661824 (+204397us) log.cc:844] Serialized 14 byte log entry
0709 12:17:59.723166 (+ 61342us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:59.723489 (+   323us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:59.723749 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.724526 (+   777us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.725127 (+   601us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":273914,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":241,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"thread_start_us":264066,"threads_started":2,"wal-append.queue_time_us":111795}
I20260709 12:17:59.772099 26084 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.789969 26084 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:59.795578 26352 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:59.796134 26352 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:59.796540 26352 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.764429 25772 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:59.798913 26084 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.802556 26224 raft_consensus.cc:3055] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:59.803057 26224 raft_consensus.cc:740] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:17:59.804069 26224 consensus_queue.cc:260] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.805227 26224 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:17:59.782020 26337 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.099s	user 0.001s	sys 0.001s
I20260709 12:17:59.809721 26271 raft_consensus.cc:3055] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:17:59.794925 26129 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.810151 26271 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:17:59.812280 26129 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:17:59.814419 24249 pending_rounds.cc:85] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 1
I20260709 12:17:59.814759 24249 pending_rounds.cc:107] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:17:59.816329 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:17:59.816946 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1098) took 1347 ms. Trace:
I20260709 12:17:59.817147 24808 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:17:59.817402 24171 rpcz_store.cc:276] 0709 12:17:58.469028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.453561 (+984533us) service_pool.cc:224] Handling call
0709 12:17:59.460220 (+  6659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.639390 (+179170us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.816675 (+177285us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54003f7854. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:59.816872 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":408719616}
I20260709 12:17:59.804039 26171 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:17:59.836812 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47062.5us
I20260709 12:17:59.837136 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1436) took 1134 ms. Trace:
I20260709 12:17:59.827522 24249 raft_consensus.cc:2889] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:17:59.825583 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1581) took 1817 ms. Trace:
I20260709 12:17:59.838479 24093 rpcz_store.cc:276] 0709 12:17:58.008277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.010675 (+  2398us) service_pool.cc:224] Handling call
0709 12:17:58.016922 (+  6247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.243022 (+1226100us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.825302 (+582280us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b54001f4fd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:59.825505 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2818159872}
I20260709 12:17:59.840452 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:17:59.840696 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:17:59.837584 24097 rpcz_store.cc:276] 0709 12:17:58.703028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.762955 (+ 59927us) service_pool.cc:224] Handling call
0709 12:17:58.763323 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.813077 (+1049754us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:59.813113 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:17:59.813160 (+    47us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:17:59.813195 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.814930 (+  1735us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540037e454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:17:59.814975 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:17:59.837069 (+ 22094us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2413708032}
I20260709 12:17:59.837790 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:59.843310 24067 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:59.845592 24067 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:59.848664 24067 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:59.761250 26353 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:59.850558 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:17:59.729954 26344 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:17:59.763880 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:59.851459 24093 raft_consensus.cc:2393] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:17:59.770692 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:59.859885 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:59.850081 25772 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.857786 26333 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:17:59.871013 26333 raft_consensus.cc:697] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:17:59.871064 26031 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:17:59.872108 26333 consensus_queue.cc:237] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.857585 25999 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:17:59.878772 24067 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:17:59.878840 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:17:59.880175 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:59.760577 26200 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.877239 24808 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:17:59.719631 26206 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.896673 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:59.896955 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:59.858424 26332 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:59.881055 24243 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:17:59.794525 26300 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.884784 25772 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:59.863732 26353 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:17:59.888087 24248 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:59.746380 26342 consensus_queue.cc:1059] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:17:59.726729 26345 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.900107 24215 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:17:59.822907 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:17:59.814460 26129 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:17:59.904639 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:17:59.900794 26031 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:59.823315 26271 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.913219 26224 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:17:59.958645 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 63026.9us
I20260709 12:17:59.958566 24241 raft_consensus.cc:2393] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:17:59.787398 26343 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.895418 25999 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.888604 26280 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:17:59.899803 24067 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:17:59.966164 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66421.9us
I20260709 12:17:59.972159 24094 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:17:59.914469 26355 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:17:59.967110 24092 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:17:59.964946 26208 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:59.962524 26344 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:17:59.959471 26169 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:17:59.967331 26224 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.889012 26336 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:17:59.910122 26295 raft_consensus.cc:3055] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:17:59.977901 26269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.517s	user 0.004s	sys 0.029s
I20260709 12:17:59.984273 26343 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:17:59.972705 26171 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:17:59.989455 26352 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:17:59.967294 24244 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:17:59.910657 25772 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:17:59.911160 26347 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:00.009367 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 238788us
I20260709 12:18:00.038945 26295 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:00.033499 26084 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:00.061036 26345 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:00.058595 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.067272 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:17:59.971638 26281 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:17:59.966965 26353 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.035316 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:00.037187 26271 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:17:59.999859 26342 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:00.011659 26208 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:00.039574 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 72305.6us
I20260709 12:18:00.075436 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:17:59.910369 26332 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.054586 25772 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.038443 26344 raft_consensus.cc:697] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:00.027149 26361 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:00.095498 26355 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:00.077783 26281 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:00.040246 26269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.579s	user 0.005s	sys 0.029s
I20260709 12:18:00.081899 24243 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
W20260709 12:18:00.096567 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 104553us
I20260709 12:18:00.092896 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.082949 26084 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:00.079110 26206 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.082556 26129 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:00.087325 26345 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.036638 26169 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.053136 26171 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.094362 26342 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.107479 26300 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.111330 26361 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:00.133378 26350 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260709 12:18:00.134966 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1591) took 1415 ms. Trace:
I20260709 12:18:00.136245 26224 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.115263 26281 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.135466 24101 rpcz_store.cc:276] 0709 12:17:58.719268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.564028 (+844760us) service_pool.cc:224] Handling call
0709 12:17:59.595349 (+ 31321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:59.595738 (+   389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:17:59.595771 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:17:59.596348 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:17:59.678556 (+ 82208us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:17:59.678601 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:17:59.678669 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:00.134686 (+456017us) raft_consensus.cc:1685] finished
0709 12:18:00.134714 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:00.134887 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1846,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"thread_start_us":81775,"threads_started":1,"wal-append.queue_time_us":176967}
I20260709 12:18:00.110850 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:00.139854 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.151187 25772 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.153214 25772 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.155905 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.156641 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.058609 26295 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.157455 24101 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
W20260709 12:18:00.140832 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48079.1us
I20260709 12:18:00.158924 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:00.128132 26129 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:00.096225 26358 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:18:00.142397 26341 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.163399 26129 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:00.169405 26330 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 1.283s	user 0.004s	sys 0.007s
I20260709 12:18:00.148073 26352 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.143699 26171 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.144212 26084 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:00.145912 26208 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:00.137835 26345 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.149744 26332 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.156045 26284 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:00.139460 26344 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.162220 24779 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:00.182008 26332 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:00.183025 26002 consensus_meta.cc:287] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.577s	user 0.010s	sys 0.005s
I20260709 12:18:00.185662 26361 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:00.186363 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.172518 26269 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.191941 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:00.192659 24812 raft_consensus.cc:1813] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Handling vote request from an unknown peer fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:00.193241 24812 raft_consensus.cc:2410] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:18:00.148073 26169 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:00.196729 24216 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.200146 26342 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.201782 24242 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:00.204507 26012 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.205117 26345 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.205514 24099 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:00.205138 24098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50598 (request call id 170) took 2468 ms (client timeout 1582 ms). Trace:
W20260709 12:18:00.206745 24098 rpcz_store.cc:269] 0709 12:17:57.737231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.737436 (+   205us) service_pool.cc:224] Handling call
0709 12:18:00.204879 (+2467443us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54003becd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:00.205051 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1391678848}
I20260709 12:18:00.198311 24779 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:18:00.208299 24173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1499) took 1801 ms (client timeout 1624 ms). Trace:
W20260709 12:18:00.208792 24173 rpcz_store.cc:269] 0709 12:17:58.406814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.408062 (+  1248us) service_pool.cc:224] Handling call
0709 12:18:00.208092 (+1800030us) spinlock_profiling.cc:243] Waited 409 ms on lock 0x7b54003f7354. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:00.208212 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":940745984}
I20260709 12:18:00.212004 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1536) took 1744 ms. Trace:
I20260709 12:18:00.212430 24174 rpcz_store.cc:276] 0709 12:17:58.467490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.446922 (+979432us) service_pool.cc:224] Handling call
0709 12:17:59.538898 (+ 91976us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.566933 (+ 28035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.211783 (+644850us) spinlock_profiling.cc:243] Waited 91.6 ms on lock 0x7b5400210550. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:00.211931 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":210773248}
I20260709 12:18:00.215056 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.219595 24216 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.216485 26343 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:00.223276 26084 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.221549 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:00.230533 26366 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:18:00.233940 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.224591 26169 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:00.225230 26269 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:00.225315 26361 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.239120 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1393) took 2406 ms. Trace:
I20260709 12:18:00.243692 24250 rpcz_store.cc:276] 0709 12:17:57.832757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.847754 (+ 14997us) service_pool.cc:224] Handling call
0709 12:18:00.238841 (+2391087us) spinlock_profiling.cc:243] Waited 808 ms on lock 0x7b54000c6554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:00.239024 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1859388800}
I20260709 12:18:00.231868 26343 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:00.246912 24098 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:00.245721 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:00.250378 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:00.269824 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.251214 24174 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:00.236976 26169 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:00.236636 26284 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:18:00.287389 26208 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.288132 26208 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.275951 26206 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.272578 26300 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:00.292733 26300 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.273420 26269 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:18:00.294031 26169 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.244798 26360 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:18:00.295464 26360 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:00.295876 26360 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.295869 24101 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:00.277542 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:00.298488 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.256369 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.302955 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.300145 24093 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
W20260709 12:18:00.305416 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49216us
I20260709 12:18:00.307243 26280 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:00.307822 26323 log.cc:927] Time spent T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 1.481s	user 0.007s	sys 0.004s
I20260709 12:18:00.303915 24097 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:00.245074 26345 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.310004 24066 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:00.306269 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.316169 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:00.314132 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 76557us
I20260709 12:18:00.317510 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:00.318205 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.302704 26300 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:00.309078 26344 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:00.311745 26171 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.339442 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:00.310830 25999 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:00.313516 26303 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.325170 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:00.371420 24812 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:00.244153 26336 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:00.322046 26002 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:00.304296 26012 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:18:00.331305 24807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 310) took 2137 ms. Trace:
I20260709 12:18:00.368557 26149 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:00.323742 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.321727 25772 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:00.382972 26336 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:00.391247 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67586.1us
I20260709 12:18:00.382429 24214 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:00.339704 26361 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:00.403968 26361 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:00.404424 26361 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.404803 26361 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:00.407433 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.381407 26002 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:00.408658 26002 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.312810 26332 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:00.391793 26149 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.419173 26280 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.419791 26280 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.421681 26149 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.421847 26200 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.423816 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:00.428282 26129 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.413908 26344 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:18:00.437423 26324 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 1.613s	user 0.003s	sys 0.018s
I20260709 12:18:00.430814 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:00.440524 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:00.414556 25772 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:00.442305 25772 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.421970 26280 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.449432 26325 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:00.449963 26325 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:00.451436 26136 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:00.451923 26136 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:00.382581 26281 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.452785 26136 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.453850 26136 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.346644 26208 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:00.463086 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 93145.8us
I20260709 12:18:00.380699 26303 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.462458 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.373030 24066 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:18:00.474431 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 101497us
I20260709 12:18:00.321020 26206 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:00.385578 26284 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:18:00.385226 24807 rpcz_store.cc:276] 0709 12:17:58.194148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.194363 (+   215us) service_pool.cc:224] Handling call
0709 12:17:58.194781 (+   418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.304705 (+1109924us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.330927 (+1026222us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b540067fcd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:00.331219 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1255355136}
I20260709 12:18:00.375180 26171 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.415042 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:00.412478 24250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:00.430701 26129 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:00.321336 26345 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.478915 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:00.493490 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:00.455050 26281 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.482169 26206 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.482762 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:00.472697 26341 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:00.492465 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.532573 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:00.534004 26002 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.535857 25772 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:00.536139 26344 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:00.536566 25772 raft_consensus.cc:697] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:00.536907 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:00.537035 26361 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.537937 24806 raft_consensus.cc:2393] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 5: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:00.537675 25772 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.539870 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1587) took 2370 ms. Trace:
I20260709 12:18:00.540409 24100 rpcz_store.cc:276] 0709 12:17:58.169928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.172364 (+  2436us) service_pool.cc:224] Handling call
0709 12:17:58.172760 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.570697 (+1397937us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.539548 (+968851us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54001f59d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:00.539785 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3198309632}
I20260709 12:18:00.541944 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.544472 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:00.546131 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.549502 24246 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.552246 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:00.553113 24248 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:00.548738 24214 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:00.555358 24214 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:00.557139 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.534052 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:00.542755 24100 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
W20260709 12:18:00.495374 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 80507.3us
I20260709 12:18:00.465855 26277 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.480077 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:00.500130 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:00.502223 26171 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.504710 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:00.592905 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 88286.2us
I20260709 12:18:00.499962 26206 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.511811 26303 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.480940 26280 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:00.463716 26332 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.512308 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1437) took 1806 ms. Trace:
I20260709 12:18:00.607450 24095 rpcz_store.cc:276] 0709 12:17:58.705483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.764040 (+ 58557us) service_pool.cc:224] Handling call
0709 12:17:58.783640 (+ 19600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:17:59.411688 (+628048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.512002 (+1100314us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54002d6ed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:00.512226 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442829056}
I20260709 12:18:00.428282 26353 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.497681 26269 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:00.517345 26360 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.639261 26002 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:00.595193 26373 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:00.520352 24247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1126) took 2751 ms (client timeout 3371 ms). Trace:
W20260709 12:18:00.640697 24247 rpcz_store.cc:269] 0709 12:17:57.769273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:57.770131 (+   858us) service_pool.cc:224] Handling call
0709 12:18:00.520124 (+2749993us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b5400341f54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:00.520277 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4019945728}
I20260709 12:18:00.521097 23998 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 4, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 4 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:00.644169 23998 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.596342 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:00.647194 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 71068.4us
I20260709 12:18:00.642418 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:00.640262 26373 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:00.648840 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.523747 26222 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.526196 26169 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.526701 26354 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:00.457698 26325 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.531785 24244 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:00.492492 24250 raft_consensus.cc:606] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:00.591365 24096 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:00.594264 26168 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.596372 26277 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.597314 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:00.598716 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 98659.5us
I20260709 12:18:00.647095 23998 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 4, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 4 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.597196 24067 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:00.603734 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:00.609118 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:00.636137 26342 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.595278 26344 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:00.667411 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:00.658759 24250 raft_consensus.cc:614] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:00.603065 26281 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:00.595407 26341 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
W20260709 12:18:00.667804 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.672227 24095 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.657508 26373 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.672112 24248 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.670186 24066 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:00.668536 23998 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.609905 26303 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.606966 26280 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:00.648099 24216 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:00.649058 26002 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:00.658951 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 139832us
I20260709 12:18:00.688145 24249 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:00.673012 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 75922us
I20260709 12:18:00.608155 26171 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:18:00.690928 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:00.733253 24250 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:00.659126 26354 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:00.692158 23998 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 3 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:00.693856 26281 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.676540 26361 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:00.709172 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.720860 24095 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:00.743212 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:00.744724 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:00.721900 24248 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:00.684837 26333 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:00.687100 26325 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.735502 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:00.689043 26340 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:00.740509 23998 catalog_manager.cc:5697] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.756814 24100 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:00.756884 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:00.757117 23998 catalog_manager.cc:5697] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.717280 26360 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:00.711216 26280 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:00.710636 26140 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.710173 26200 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:00.758332 24100 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:00.745383 24095 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:00.759402 26389 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:00.782321 26277 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:00.782855 26378 log.cc:927] Time spent T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:18:00.717646 26303 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.783372 26354 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.784384 26169 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.784647 26354 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:00.785053 26303 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.762077 26281 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.756402 26340 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:00.787195 26345 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.787530 26340 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.788491 26353 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.778337 26385 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.789561 26385 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.682063 26342 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.770103 26381 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.791514 26381 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.792433 26342 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:00.792654 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:00.794023 26381 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.794788 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1580) took 2787 ms. Trace:
I20260709 12:18:00.795401 26341 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:00.795189 24099 rpcz_store.cc:276] 0709 12:17:58.007891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:58.010083 (+  2192us) service_pool.cc:224] Handling call
0709 12:18:00.205266 (+2195183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:00.206020 (+   754us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:00.794585 (+588565us) spinlock_profiling.cc:243] Waited 2.19 s on lock 0x7b54003becd0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:00.794721 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5047447808}
I20260709 12:18:00.795902 26341 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:00.796772 26341 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.797425 26340 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.798045 26341 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:00.799489 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 151476us
I20260709 12:18:00.800609 26002 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:00.802294 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:00.751657 26363 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:18:00.794281 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 106609us
I20260709 12:18:00.810181 24214 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:00.832671 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:00.817332 26129 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:00.836805 26340 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.778395 26200 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:00.840029 26200 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.841746 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:00.842505 24170 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:00.828668 24244 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:00.828428 26332 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.852032 24170 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:00.852916 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:00.859908 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:00.860751 24171 raft_consensus.cc:2376] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6. Re-sending same reply.
I20260709 12:18:00.861584 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:00.861825 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:00.862499 24174 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:00.817847 26385 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.873538 26149 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:00.874284 26149 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:00.875177 26206 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.879050 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:00.880888 26206 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:00.876024 24815 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:18:00.876910 26388 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:18:00.854161 26129 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:18:00.859449 26361 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:00.857147 26381 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:18:00.905018 26361 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:00.919831 26381 consensus_queue.cc:1243] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:18:00.895545 26373 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.938197 26361 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.946518 26373 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:00.759222 23998 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:00.988219 23998 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:00.993285 23998 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 5 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:00.995841 23998 catalog_manager.cc:5697] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:00.999356 23998 catalog_manager.cc:5697] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 2, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.002667 23998 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.005365 23998 catalog_manager.cc:5697] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.008765 23998 catalog_manager.cc:5697] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:01.015374 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 324298us
I20260709 12:18:01.011811 23998 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 3 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:01.026512 23998 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.029573 23998 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:01.034113 24101 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.014s	sys 0.027s
W20260709 12:18:01.034770 24101 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.015s	sys 0.028s
I20260709 12:18:01.043453 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.045151 24171 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:01.047698 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:01.047714 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:01.048797 24170 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.049467 24169 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.059800 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.060340 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.061455 24167 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:01.062433 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:01.063107 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:01.063623 24174 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.063853 24176 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 2. Current term is 3. Ops: []
I20260709 12:18:01.062414 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:01.072347 24173 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:18:01.075043 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.075917 24173 raft_consensus.cc:3055] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:01.076592 24172 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:01.076726 24173 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:01.079623 24173 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.088863 24173 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.082355 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.091499 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:01.092017 24167 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:01.092667 24172 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.093228 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.086483 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.095422 24176 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:18:01.096596 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:01.096674 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 208592us
I20260709 12:18:01.099260 24176 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:01.100454 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:01.101313 24095 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.061477 24171 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:01.094786 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:01.104339 24167 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.033165 23998 catalog_manager.cc:5697] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:01.106477 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.108736 23998 catalog_manager.cc:5697] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.114658 24241 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:01.118543 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.118615 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.124579 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:01.124989 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:01.125550 24171 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.126410 24246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:01.126900 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.127501 24246 raft_consensus.cc:606] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:01.128038 24246 raft_consensus.cc:614] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:01.127912 24244 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:01.133945 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.135301 24247 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:01.136745 26117 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:01.139508 26002 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.140851 24809 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:01.142249 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:01.144142 26117 consensus_queue.cc:1059] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:01.140580 26002 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.146379 26117 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:01.150653 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:00.932114 26344 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:01.159406 26136 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:01.160094 26273 raft_consensus.cc:3055] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:01.160668 26273 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:01.160573 26289 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:01.198308 24169 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:01.206331 24174 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:01.151775 24244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:01.112565 23998 catalog_manager.cc:5697] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:01.154588 25999 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:01.231252 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:01.232419 24247 raft_consensus.cc:2393] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:01.152748 26117 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.154069 26200 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:00.903191 26333 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:01.240020 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:01.270416 24172 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:01.234508 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:01.233919 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:01.238763 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 379950us
I20260709 12:18:01.233260 24809 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:01.278492 24170 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
W20260709 12:18:01.283454 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.239697 25772 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.126s
I20260709 12:18:01.244608 26280 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.289680 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.290052 26280 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:01.290740 24247 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 3.
I20260709 12:18:01.263305 26002 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:01.245507 24244 raft_consensus.cc:606] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:01.242069 26381 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:01.302168 24244 raft_consensus.cc:614] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:01.302439 24141 leader_election.cc:400] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:18:01.303256 24100 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:01.305068 26149 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:01.299121 26386 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:01.240365 26278 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.239403 26273 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.300454 24171 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:01.304965 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:01.313203 24095 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:01.325033 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:01.330904 26273 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.332494 24173 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:18:01.336943 26353 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:01.339293 23998 catalog_manager.cc:5697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:01.330698 25772 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:01.342782 25772 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:01.343225 26169 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.343853 26278 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.344151 26169 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.344754 25772 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.347892 26333 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.343494 24093 raft_consensus.cc:2393] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:01.338042 26353 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.333000 24173 pending_rounds.cc:85] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 2
I20260709 12:18:01.342104 23998 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 3 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:01.359222 24173 pending_rounds.cc:107] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:18:01.353147 25772 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.378211 24173 raft_consensus.cc:2889] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:01.393615 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1442) took 2686 ms. Trace:
I20260709 12:18:01.395327 24099 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:01.400127 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.401502 24244 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 4: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:01.350972 26278 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:01.402010 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:01.403640 23998 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.412417 24243 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.394474 24092 rpcz_store.cc:276] 0709 12:17:58.707277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:59.320265 (+612988us) service_pool.cc:224] Handling call
0709 12:17:59.420762 (+100497us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:17:59.982765 (+562003us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.392641 (+1409876us) spinlock_profiling.cc:243] Waited 467 ms on lock 0x7b54001f40d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:01.393255 (+   614us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1073298816}
I20260709 12:18:01.403707 24094 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:01.422605 26367 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:18:01.416793 26353 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:01.424276 24100 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:01.416365 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 215485us
W20260709 12:18:01.435868 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 58589.4us
W20260709 12:18:01.440812 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 111669us
I20260709 12:18:01.424635 26169 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:01.456543 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.457605 26298 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:18:01.458374 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.459364 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.460043 24246 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:01.460201 24249 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:01.461411 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.462065 26295 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.461449 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.464108 24241 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:01.464231 24246 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:01.465721 24242 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:01.466082 26361 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.466565 26084 consensus_queue.cc:1059] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:01.458202 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.465714 24246 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:01.483122 24243 raft_consensus.cc:2410] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:01.467767 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.406868 23998 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:01.458220 26298 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:01.470223 24214 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:01.470118 24097 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:01.479602 24140 leader_election.cc:400] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4.
I20260709 12:18:01.501600 24140 leader_election.cc:403] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:18:01.507458 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1169) took 1021 ms. Trace:
I20260709 12:18:01.508165 24243 rpcz_store.cc:276] 0709 12:18:00.478010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.480837 (+  2827us) service_pool.cc:224] Handling call
0709 12:18:01.401586 (+920749us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:01.498883 (+ 97297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6604160}
I20260709 12:18:01.512447 24167 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:01.467339 26129 consensus_queue.cc:1059] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
W20260709 12:18:01.518635 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48790.6us
I20260709 12:18:01.500892 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:01.466744 26361 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.514614 26273 raft_consensus.cc:3055] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:01.531813 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.532943 26273 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:01.538393 26298 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.539492 26273 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.540369 26298 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:01.541217 26273 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.543363 26284 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:01.547086 26381 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4.
I20260709 12:18:01.553151 26117 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:01.554242 26284 raft_consensus.cc:697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:01.555799 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:01.555902 26284 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 5.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.570762 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.571532 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.572101 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.572486 24173 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:18:01.573704 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.576148 24781 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:01.576764 26206 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.577541 26206 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.578188 26149 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:01.578687 26149 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.578876 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1610) took 1160 ms. Trace:
I20260709 12:18:01.579145 26149 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.579404 24096 rpcz_store.cc:276] 0709 12:18:00.418810 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.462048 (+ 43238us) service_pool.cc:224] Handling call
0709 12:18:01.578424 (+1116376us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540028b754. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:01.578631 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":269873408}
I20260709 12:18:01.572480 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:01.580706 24246 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.528332 23998 catalog_manager.cc:5697] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:01.584456 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1609) took 1166 ms. Trace:
I20260709 12:18:01.584225 23998 catalog_manager.cc:5697] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 2, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.584903 24101 rpcz_store.cc:276] 0709 12:18:00.418347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.422188 (+  3841us) service_pool.cc:224] Handling call
0709 12:18:00.519121 (+ 96933us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:00.519598 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:00.519642 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:00.520273 (+   631us) log.cc:844] Serialized 26 byte log entry
0709 12:18:01.035471 (+515198us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:01.036067 (+   596us) log.cc:844] Serialized 14 byte log entry
0709 12:18:01.036408 (+   341us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.036491 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:01.036556 (+    65us) raft_consensus.cc:1685] finished
0709 12:18:01.036567 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:01.584196 (+547629us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b54002d64d0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:01.584356 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165009,"prepare.run_cpu_time_us":152,"prepare.run_wall_time_us":37764,"raft.queue_time_us":161597,"raft.run_cpu_time_us":489,"raft.run_wall_time_us":33606,"spinlock_wait_cycles":221908864,"thread_start_us":514560,"threads_started":1,"wal-append.queue_time_us":324782}
I20260709 12:18:01.589859 26361 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:01.590250 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.591347 24248 raft_consensus.cc:2393] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:01.591475 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.592623 24241 raft_consensus.cc:2410] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:01.592939 24248 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:01.594113 24241 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: [3.2-5.3]
I20260709 12:18:01.532361 26200 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:01.596755 24242 raft_consensus.cc:2410] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:18:01.598150 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:01.599572 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 120362us
I20260709 12:18:01.601619 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.574692 24244 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:01.602460 24243 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:01.590067 26206 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:01.603344 24249 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:01.594712 24248 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:01.586371 23998 catalog_manager.cc:5697] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:01.608209 23998 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:01.609325 26084 raft_consensus.cc:3055] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:01.614821 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:01.615259 26084 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:01.616506 26084 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.610860 24250 raft_consensus.cc:2410] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:18:01.610415 26354 consensus_meta.cc:287] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.825s	user 0.007s	sys 0.014s
I20260709 12:18:01.611783 26206 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:01.610200 23998 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:01.628834 24245 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
W20260709 12:18:01.632984 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.636597 24248 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:18:01.637239 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.638334 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.637790 23998 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:01.640368 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:01.641553 24246 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:01.641937 24812 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:01.629297 26084 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.644349 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.645792 24249 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:01.646646 26381 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.663995 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:01.665999 24248 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.667872 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:01.672049 24241 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.675015 24246 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:01.674036 24176 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:01.685920 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:01.687320 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1177) took 1202 ms. Trace:
I20260709 12:18:01.669014 26361 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:18:01.687791 24245 rpcz_store.cc:276] 0709 12:18:00.484812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.533734 (+ 48922us) service_pool.cc:224] Handling call
0709 12:18:01.687015 (+1153281us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540008cfd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:01.687200 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2442277632}
I20260709 12:18:01.675599 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.692109 24246 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:01.655615 26206 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.693774 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:01.669409 26117 consensus_queue.cc:1059] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
W20260709 12:18:01.696792 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 110636us
I20260709 12:18:01.700520 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.701320 24243 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:01.702092 24250 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:01.691222 26298 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.676256 26149 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.703279 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:01.711218 24214 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:01.714059 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46667.1us
I20260709 12:18:01.716328 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.718400 25772 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:01.719120 25772 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:01.719520 26342 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:01.720454 25772 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.721201 26200 consensus_queue.cc:1059] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:01.721701 26342 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:01.722204 26342 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:01.723452 26342 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.733788 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.694587 26333 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:18:01.693348 26126 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
W20260709 12:18:01.750718 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.752027 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:01.753814 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.695392 26381 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.763319 26381 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:01.767800 26169 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:01.771118 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 73590.1us
I20260709 12:18:01.748785 26355 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:01.788297 25999 raft_consensus.cc:3055] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:18:01.788837 25999 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:01.788942 26206 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:01.790118 25999 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.791257 26149 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:01.791767 25999 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:01.759939 26342 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:01.797155 26410 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:18:01.802830 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:01.804191 26208 raft_consensus.cc:3055] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:01.804275 26397 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:01.804818 26208 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:01.806025 26208 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.806743 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:01.807472 26416 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260709 12:18:01.811152 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.733762 26298 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.819152 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:01.817296 24241 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:01.829208 24140 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:01.833756 24248 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
W20260709 12:18:01.834429 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 75012.1us
I20260709 12:18:01.769240 26400 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.170s
I20260709 12:18:01.841358 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:01.842029 24176 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:01.836062 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49846.1us
I20260709 12:18:01.786338 26289 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:01.760521 26353 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:01.809763 24806 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:18:01.785341 26355 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:01.851686 24246 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:01.857699 24095 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:01.768543 26169 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.859766 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:01.850596 26289 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.864606 24241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:01.850260 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:01.849586 26171 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:01.872218 24247 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:18:01.861761 26340 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:01.861057 26208 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.862033 26273 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:01.879096 26391 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:01.879602 26413 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:18:01.869474 26289 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:01.893000 26397 consensus_queue.cc:1243] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:18:01.893327 26387 consensus_queue.cc:1059] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:01.893764 26397 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:01.894568 26397 consensus_queue.cc:1243] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:01.894748 26387 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:01.895102 26397 raft_consensus.cc:3055] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:01.895233 26387 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:01.895609 26397 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:01.896487 26387 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.896752 26397 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:01.897835 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 91408.8us
I20260709 12:18:01.897956 26387 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:01.899245 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 138660us
I20260709 12:18:01.898514 26303 raft_consensus.cc:3055] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:01.898488 26381 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:18:01.875638 24244 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:01.906596 24806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 317) took 1182 ms. Trace:
I20260709 12:18:01.909354 26298 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:01.909045 26289 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.910833 26271 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:01.911684 26333 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:01.877084 26340 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:01.862491 26353 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.927423 24066 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:01.876572 26284 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:18:01.929950 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:01.954125 24241 raft_consensus.cc:606] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:01.954579 24241 raft_consensus.cc:614] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:01.954520 24095 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:01.929129 26391 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:01.946066 26355 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:01.927135 26303 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:18:01.957239 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 65216.1us
I20260709 12:18:01.957967 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:02.168334 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 217238us
W20260709 12:18:02.048861 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 91257.1us
I20260709 12:18:02.170888 26400 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:02.171451 26400 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.171883 26400 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:02.171576 26149 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:02.017803 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.045662 24244 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:01.943208 26171 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.120s
I20260709 12:18:02.173815 26171 consensus_queue.cc:1243] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:18:02.174396 26171 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:02.174760 26171 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:18:02.176079 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 158375us
I20260709 12:18:02.176781 26284 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:02.177196 26284 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.177565 26284 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.178241 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:02.180856 24095 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:02.143003 24176 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:02.182477 26386 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:02.101394 26397 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.185410 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.187032 26386 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:02.187455 26386 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.187835 26386 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:02.008356 26419 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:02.010103 26353 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.159125 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:01.956106 26271 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.160725 26206 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:02.162318 26333 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:02.197367 24781 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:02.005579 24140 leader_election.cc:400] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:18:02.201829 24140 leader_election.cc:403] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:18:02.006512 26355 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.044713 26169 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.043459 26289 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:02.004374 26303 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.163285 25999 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:02.216739 25999 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.217167 25999 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:02.164090 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.038694 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:01.952114 26340 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:02.221971 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.222653 24067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.770s (SENT) [suppressed 28 similar messages]
I20260709 12:18:02.222805 26200 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.223729 26200 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.008759 26391 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.216341 26387 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5.
I20260709 12:18:02.167068 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:02.023275 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.176209 26418 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:02.175841 26171 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.083782 26002 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:01.934792 24806 rpcz_store.cc:276] 0709 12:18:00.723951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:00.731619 (+  7668us) service_pool.cc:224] Handling call
0709 12:18:01.421465 (+689846us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:01.809232 (+387767us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:01.857172 (+ 47940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:01.906305 (+ 49133us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b540070f650. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:01.906497 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927457280}
I20260709 12:18:02.204757 26149 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:02.262492 26002 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:02.263047 26149 raft_consensus.cc:697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:02.263636 26002 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.264874 26002 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.265018 26271 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:02.212692 24780 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:02.267926 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.215492 26381 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:02.268361 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:02.268827 26169 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:02.269166 24097 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
W20260709 12:18:02.216115 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 264089us
I20260709 12:18:02.269516 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:02.255270 26208 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.270548 26208 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.271082 26381 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:02.271529 26381 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.271881 26381 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.256974 24244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:02.273152 24244 raft_consensus.cc:606] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:02.273583 24244 raft_consensus.cc:614] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:02.263120 26084 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:18:02.229581 26418 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:02.278184 26418 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.263049 26171 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:02.279711 26418 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:02.280221 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 67633.2us
I20260709 12:18:02.281121 24780 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:02.282109 26169 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:02.282543 26169 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:02.282943 26169 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.285465 26208 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:02.286715 26385 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:02.287523 26385 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:02.288508 26385 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.289305 26387 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:18:02.289930 26385 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.257172 26400 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.258484 24100 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:18:02.259214 24098 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
W20260709 12:18:02.260350 24067 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.207s (SENT)
I20260709 12:18:02.261768 26303 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:02.264307 26149 consensus_queue.cc:237] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.200300 24175 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:02.282745 26386 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:02.326020 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 163149us
I20260709 12:18:02.307530 26397 consensus_queue.cc:1059] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:18:02.290848 26284 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:02.361729 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.367750 24214 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.370163 26403 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:02.360961 25999 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.370646 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:02.371868 26400 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.361493 26354 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:02.367463 26342 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:02.375876 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 115604us
I20260709 12:18:02.371873 26386 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:02.385039 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 104058us
W20260709 12:18:02.385810 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 115600us
I20260709 12:18:02.383162 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:02.395768 24094 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
W20260709 12:18:02.397507 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.391990 24066 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.361248 26391 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:02.390419 26084 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:02.407402 24092 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:02.404436 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:02.390511 26354 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:02.394325 26200 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.396998 25772 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:02.408478 26381 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.437029 26381 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:02.440375 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 243091us
I20260709 12:18:02.429477 24214 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:02.429358 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 54004us
I20260709 12:18:02.442153 24781 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:02.439603 26200 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:02.410190 26084 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:02.445870 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.398821 26353 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.409476 26400 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:18:02.453249 26333 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.457852 26333 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.460214 26333 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.446295 26354 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:02.461793 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.401777 26289 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:18:02.449019 26084 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:02.440732 25772 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.449158 26271 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:02.474969 26169 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.480247 25999 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.461155 26200 raft_consensus.cc:697] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:02.483196 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:02.488638 26284 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:02.490795 26340 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.409354 26342 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:02.513954 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 62665.1us
W20260709 12:18:02.517082 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 121389us
I20260709 12:18:02.432647 26391 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:02.522666 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 143652us
I20260709 12:18:02.533751 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:02.534502 26340 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:02.534861 24100 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.520659 26426 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:18:02.535398 26340 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:02.536255 26340 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:02.536607 26340 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.536931 26340 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:02.539633 26284 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.539161 26200 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.540151 26284 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.540505 25999 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:02.541180 25999 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.539254 26400 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:02.544050 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:02.505821 26271 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.542726 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:02.542855 26284 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:02.551961 26169 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.557430 25772 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.567268 24100 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:02.568828 26340 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.571345 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:02.572113 26340 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.559348 26271 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:02.528635 26386 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:02.579460 26386 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:02.580648 26342 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.580498 26386 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.581925 26386 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.495024 26353 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.584719 26353 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.586706 26391 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.590975 25999 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:02.597684 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 204354us
W20260709 12:18:02.602414 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 203399us
I20260709 12:18:02.531956 26403 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:02.602495 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.549996 24066 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.611567 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:02.616639 24216 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.621s (SENT)
I20260709 12:18:02.616640 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:02.604054 26397 consensus_queue.cc:1243] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:18:02.623281 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 81578.9us
I20260709 12:18:02.625692 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:02.612581 26284 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:02.613456 26400 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:02.639973 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.647482 24216 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.624s (SENT)
I20260709 12:18:02.647730 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:02.648711 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 125289us
I20260709 12:18:02.665154 26427 raft_consensus.cc:3055] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:02.635149 26284 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:02.629944 26149 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:02.642527 26434 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.665778 26427 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:02.680342 26434 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.681033 26427 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.2, Last appended by leader: 2, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.682477 26427 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:02.669390 26418 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:02.666530 24066 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.667094 26397 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:18:02.668851 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:02.623855 26354 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.682919 26434 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.683390 26418 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.684190 26284 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.706943 26418 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.690497 26084 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.699779 26354 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.703604 26427 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:02.713326 26427 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:02.713716 26427 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:02.703696 26397 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:02.716549 26397 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.684099 24066 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.686213 26200 raft_consensus.cc:2764] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:02.722131 26354 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:02.695264 26403 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.724869 26354 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:02.667320 26171 raft_consensus.cc:2764] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:02.728091 26354 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:02.739470 26437 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.002s
I20260709 12:18:02.723541 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:02.740460 24098 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
W20260709 12:18:02.748031 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.751907 26200 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:02.752559 26200 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.756731 26298 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:02.757332 26298 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.758268 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:02.758939 24094 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:02.760360 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 144896us
W20260709 12:18:02.767796 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 120514us
W20260709 12:18:02.772148 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.776613 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 334547us
I20260709 12:18:02.790235 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:02.791790 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.792405 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.798416 24241 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:02.802755 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:02.803489 24095 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:02.803399 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:02.805931 24247 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:02.811580 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.812016 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:02.812363 24244 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:02.756639 26438 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:02.818645 24246 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:18:02.820891 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.821471 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:02.821673 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.822152 24250 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:02.823064 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.823740 24248 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:02.821683 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:02.826329 24175 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:02.829439 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.822391 24249 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:02.786638 26418 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:02.821702 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:02.831949 24243 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:02.836161 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:02.836809 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:02.845186 24066 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:02.847242 26438 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:02.848440 26438 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.851681 26298 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:02.852782 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.853739 24809 raft_consensus.cc:2368] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7.
I20260709 12:18:02.843876 26425 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:02.854471 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.855108 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.855419 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.855942 24808 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:02.856318 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.857242 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.858212 24811 raft_consensus.cc:2393] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:02.857856 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.856386 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:02.859565 24815 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:02.857259 24813 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:02.860544 26303 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:02.861156 26303 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.866067 24250 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:02.866737 26429 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:02.867125 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:02.867551 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:02.868039 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 56150.2us
I20260709 12:18:02.868247 24168 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:02.868476 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.869065 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.869541 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:02.869716 24806 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:02.870445 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.871763 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.872589 24807 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:02.854772 26425 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.875094 26387 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.875460 26208 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.875932 26387 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.876649 24812 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:02.876081 26208 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.878260 26387 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:02.879148 26269 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.867506 26429 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.879592 26208 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.879833 26269 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:02.881430 26429 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.881814 26425 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:02.871814 24781 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:02.883199 26425 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:02.883715 26425 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:02.890290 24250 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:02.892737 24247 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
W20260709 12:18:02.903498 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 58411.4us
I20260709 12:18:02.908095 24243 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:02.894469 24095 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:02.871932 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.812754 26385 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:02.878796 26387 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:02.909571 24094 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:02.912365 24175 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:02.913537 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.909665 24241 raft_consensus.cc:2393] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:02.914412 24247 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:18:02.915917 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:02.919509 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.920437 24243 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:02.923781 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:02.865988 26149 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:02.927803 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:02.903168 24242 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:02.928258 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.875982 26439 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:02.928874 24066 leader_election.cc:400] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7.
I20260709 12:18:02.931283 24250 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:02.936882 24066 leader_election.cc:403] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:02.932961 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.937706 24245 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:02.882853 26269 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.903347 26425 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:02.939996 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70530.3us
I20260709 12:18:02.942816 26354 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7.
I20260709 12:18:02.944209 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:02.968222 24098 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:02.941968 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:02.943257 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:02.947491 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:02.970364 24244 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:02.948504 26418 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:02.914041 26429 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:02.949036 26303 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:02.949505 26442 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:18:02.950492 24175 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:18:02.952540 26084 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:02.996109 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:02.954763 26430 consensus_queue.cc:1059] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:18:02.955397 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:03.001173 24248 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: [3.3-5.4]
I20260709 12:18:02.961095 26200 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:02.959589 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:02.960496 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:02.925824 26387 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.886508 26427 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.902827 26271 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:02.996562 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:02.938354 26385 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:02.999434 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.001696 24094 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:02.931205 25999 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:02.935956 26171 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:03.006042 24096 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:18:02.990110 25772 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:02.993505 26208 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:03.005439 24093 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:02.993396 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:03.004745 24215 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:03.012136 24247 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 5: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:18:03.156956 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.162107 24248 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:03.152213 24250 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:02.990602 26340 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:03.000808 26418 raft_consensus.cc:697] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:03.000672 26429 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:18:03.169950 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 176628us
I20260709 12:18:03.166487 26439 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.025528 24807 raft_consensus.cc:2393] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:03.172729 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:03.009370 26303 raft_consensus.cc:3055] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:03.183825 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:03.181469 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 176851us
I20260709 12:18:03.183490 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:03.000349 26354 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 12:18:03.196141 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.039558 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:03.038170 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:03.160264 25772 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:03.163559 26269 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.041790 26271 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:03.188488 26442 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:18:03.174378 25999 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:03.023634 26149 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.183s
W20260709 12:18:03.215466 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.195254 26386 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.175020 26443 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:03.210753 25772 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.195395 26434 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.188902 26303 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:03.201787 26200 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.203263 26002 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.224548 24808 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:03.207573 26438 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.241495 24094 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:03.236335 24214 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.197120 26439 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.245074 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:03.217022 26381 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:03.229823 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.178125 26340 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.265354 24140 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:03.216890 26435 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:03.236341 26354 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.224524 24811 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:03.166152 26208 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.235344 26298 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:03.277614 24096 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.276099 26438 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.224809 26269 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.268610 26200 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.271591 26271 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:03.291319 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 80654.4us
W20260709 12:18:03.283011 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 46692.7us
I20260709 12:18:03.258821 26386 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.249059 26443 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.260565 26434 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.282541 26429 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.285426 26171 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:18:03.279670 26381 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.339213 26381 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.340602 26386 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:03.332535 25999 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.328229 26200 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.354795 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:03.363433 26427 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:03.333137 26271 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:03.365518 26444 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.537s	user 0.006s	sys 0.008s
I20260709 12:18:03.288321 26284 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:03.329401 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.301028 26208 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:03.329350 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.295019 26435 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:03.279961 26002 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:03.336745 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.338663 26449 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
W20260709 12:18:03.390903 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 218192us
W20260709 12:18:03.316978 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.392028 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 62787.8us
I20260709 12:18:03.382503 24096 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:18:03.334172 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 150767us
I20260709 12:18:03.304884 26397 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.392843 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.304847 26438 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:03.388990 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.393033 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.396942 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:03.398077 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:03.398722 24245 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.294723 26354 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.401341 24066 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:03.383812 26284 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.402259 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:03.305104 26298 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.386108 26289 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:03.409317 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:03.410594 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:03.411028 24248 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 5: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:03.386294 26387 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:03.292660 26418 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.417788 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.388911 26456 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:03.435876 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:03.402606 26427 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:03.407665 26355 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.402769 26385 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:03.407095 26284 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:03.443715 24242 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:03.447221 26462 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.410003 26289 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.451418 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.451293 26435 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.407166 26432 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:03.456972 24067 leader_election.cc:336] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.660s (SENT)
W20260709 12:18:03.474920 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.488301 24093 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:03.383934 26303 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.548415 24066 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.549661 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:03.551462 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.552700 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:03.493297 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 99677.5us
I20260709 12:18:03.553663 24067 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:03.559034 24094 raft_consensus.cc:2393] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:03.419735 26458 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:03.436363 26434 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:03.555858 26425 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.000s
I20260709 12:18:03.555430 26002 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:03.575814 26269 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:03.576584 26271 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:03.500708 26289 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.485793 26427 raft_consensus.cc:697] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:03.485442 26462 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:03.551061 26432 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:03.582449 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.590399 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:03.558724 26340 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:03.631861 26354 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:03.591811 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:03.633123 24241 raft_consensus.cc:2393] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:03.592523 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:03.634485 24815 raft_consensus.cc:2410] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:18:03.593856 26457 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:18:03.595031 25772 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.638350 25772 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:03.598577 26355 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:03.578035 26200 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.641034 26200 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:03.603147 26461 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.604974 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:03.645884 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.606856 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:03.619659 25999 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:03.655354 26461 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.655828 26461 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.657225 24781 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:03.620812 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:03.621582 26427 consensus_queue.cc:237] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.587916 26271 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.582618 26425 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.625022 26439 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:03.627888 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.629727 26387 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:03.602317 26298 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:03.573791 26458 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:03.639251 26355 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.625041 24245 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
W20260709 12:18:03.643817 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 52375.3us
I20260709 12:18:03.645979 24246 raft_consensus.cc:2410] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:03.607637 24243 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:03.649407 24092 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:03.666460 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:03.668083 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47550.5us
I20260709 12:18:03.669746 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:03.673328 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.587965 26462 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.673944 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.675904 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:03.676534 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:03.690033 24098 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.639238 26397 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:03.686002 24095 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.691046 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.688944 24093 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:03.678207 24214 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.658166 26456 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.625110 26432 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.681659 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:03.693929 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:03.677277 26340 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:03.738701 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44870.7us
I20260709 12:18:03.715833 24214 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.717202 24814 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:03.739701 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:03.707406 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.699437 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:03.734126 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.741255 24093 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:03.733477 24092 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:03.643610 26381 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:03.745841 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46509.2us
I20260709 12:18:03.746404 24094 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:03.750180 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.761799 24092 raft_consensus.cc:1217] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[5.2-5.2]   Dedup: 5.2->[]
I20260709 12:18:03.762706 24092 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: [5.2-5.2]
I20260709 12:18:03.751223 24099 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
W20260709 12:18:03.772075 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 315160us
I20260709 12:18:03.739049 26298 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:03.675292 26271 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.747802 26200 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:03.780964 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.781244 24095 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:03.785185 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:03.737597 26387 consensus_queue.cc:1243] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:18:03.787369 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.767730 26084 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:03.771178 26418 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:03.767338 25999 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.855450 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.856880 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.852604 26397 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:03.869797 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.825918 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47700us
I20260709 12:18:03.790999 26200 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:03.847934 26431 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.863315 26084 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:03.783196 25772 consensus_queue.cc:1059] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:18:03.869653 26381 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:03.743598 26386 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:18:03.859930 26458 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.951700 26397 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.953661 25772 raft_consensus.cc:3055] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:03.869369 26465 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:18:03.839452 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:03.958724 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.738045 26456 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.962704 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:03.963351 24242 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.965050 26456 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:03.862447 26429 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:03.861593 26289 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:03.855762 24094 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:18:03.873991 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:03.844988 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:03.926867 24099 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:03.934909 24214 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.944567 26431 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:03.968286 26431 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.968541 24095 raft_consensus.cc:2410] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:03.969789 26475 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.970324 26475 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:03.970672 26475 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.954115 25772 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:03.972818 25772 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.974254 25772 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:03.974404 26303 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.975294 26381 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.975574 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:03.976298 24815 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:03.976733 26465 consensus_queue.cc:1243] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:18:03.979565 26084 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.915210 26430 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.968637 24214 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.919736 26418 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:03.919113 26387 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:03.949280 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 171247us
I20260709 12:18:03.945114 26200 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:03.932035 25999 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:03.943745 26298 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:03.989918 24242 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:03.976039 26385 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:03.968184 26289 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:03.807529 26453 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.151s
I20260709 12:18:04.003332 24214 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:03.976104 26381 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.998646 25999 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.020349 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:04.019258 24098 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:04.025993 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:04.026363 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.026652 24095 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:04.027827 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:04.026952 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.011504 26269 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:03.997917 26387 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.019681 26400 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.061127 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:04.012923 26354 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:18:04.047943 26436 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.031481 26289 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:04.052600 26462 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.055313 26454 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.059209 26425 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:04.013207 26385 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:03.994015 26430 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.032004 26269 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:04.088389 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.121080 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 249534us
W20260709 12:18:04.124804 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.032269 26478 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:04.046604 26458 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:04.172660 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.125675 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 117468us
I20260709 12:18:04.046645 26397 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:04.182669 24216 leader_election.cc:336] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.514s (SENT)
W20260709 12:18:04.177925 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.186589 24247 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:04.189595 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:04.126114 26386 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.220371 24245 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.222710 24815 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:18:04.224799 26284 consensus_meta.cc:287] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.003s
I20260709 12:18:04.120201 26289 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.225504 24248 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:18:04.247787 24244 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:04.249686 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:04.250487 24100 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:04.228793 24215 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:04.235769 24214 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:04.247848 24168 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:04.231436 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:04.232882 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:04.259720 24245 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:04.243182 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:04.192330 24241 pending_rounds.cc:85] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 1
I20260709 12:18:04.223858 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:04.261075 24243 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:18:04.262283 26453 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:04.262885 26453 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:04.263350 26453 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:04.251374 26438 consensus_meta.cc:287] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.844s	user 0.013s	sys 0.001s
I20260709 12:18:04.267228 26002 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:04.267802 26438 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.268980 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:04.269827 24176 raft_consensus.cc:2376] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4. Re-sending same reply.
I20260709 12:18:04.270354 26438 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:04.271072 26386 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.272572 24175 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:04.273547 26386 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:04.170849 26269 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:04.271296 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:04.180799 26439 raft_consensus.cc:3055] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:04.268144 26002 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:04.259900 24249 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:04.278127 24241 pending_rounds.cc:107] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:18:04.280242 24246 raft_consensus.cc:2393] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:04.303862 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:04.122581 26436 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.302541 24098 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:18:04.267241 26461 consensus_meta.cc:287] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.611s	user 0.012s	sys 0.003s
I20260709 12:18:04.310089 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:04.067075 26418 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.274791 26289 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:04.340446 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.321671 26386 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.347844 26386 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.349838 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:04.350317 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:04.350520 24173 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:04.351377 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:04.352099 24176 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:04.356173 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:04.357084 24175 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:04.281386 26397 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:04.341178 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:04.280987 26439 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:04.227373 26458 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.218055 26431 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.400640 24175 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:18:04.370133 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:04.368937 24168 raft_consensus.cc:2368] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:18:04.401662 24167 raft_consensus.cc:2368] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6.
I20260709 12:18:04.402664 26462 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:04.403699 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 221093us
W20260709 12:18:04.404843 24216 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.519s (SENT)
I20260709 12:18:04.406627 26397 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.409297 26397 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:04.411237 26002 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.380008 26481 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.342509 26461 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.354720 26443 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:04.383366 26381 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:04.385856 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:04.387718 26387 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:04.389003 26458 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:04.391112 26084 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:04.360497 26340 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:04.392148 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:04.395130 26483 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:04.458405 26200 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.458724 26483 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.460999 26200 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:04.456151 26481 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.177728 26454 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.447989 26354 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 12:18:04.396826 26385 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:04.398224 26430 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:04.400772 26431 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:04.420755 24173 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
W20260709 12:18:04.422685 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 170083us
I20260709 12:18:04.277472 26284 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:04.406901 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.380224 26436 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:04.431443 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 125002us
I20260709 12:18:04.440901 24241 raft_consensus.cc:2889] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:04.446816 26432 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.680s	user 0.004s	sys 0.008s
I20260709 12:18:04.562004 26432 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.457351 24248 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:04.567236 24101 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:04.480645 24094 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:04.473563 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:04.487442 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:04.461105 26483 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:04.453135 26355 consensus_meta.cc:287] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.723s	user 0.014s	sys 0.000s
I20260709 12:18:04.280716 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:04.126859 26298 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.510970 26385 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:04.467294 26454 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:04.524652 26303 consensus_meta.cc:287] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.002s
I20260709 12:18:04.480321 26340 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:04.613844 24171 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:04.527757 26289 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.467836 26439 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.465454 26481 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:04.532271 26427 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:04.534380 26475 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.541s	user 0.008s	sys 0.004s
I20260709 12:18:04.536567 26434 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:04.538753 24814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 335) took 1387 ms. Trace:
W20260709 12:18:04.540499 25999 consensus_meta.cc:287] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.508s	user 0.010s	sys 0.000s
I20260709 12:18:04.612375 26340 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:04.544605 24067 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.600s (SENT)
W20260709 12:18:04.738869 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 428893us
I20260709 12:18:04.739264 24067 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:04.552028 24176 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:04.739812 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:04.571403 24175 raft_consensus.cc:2393] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:04.071192 26400 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.463033 26461 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:04.600963 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:04.753532 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 165856us
I20260709 12:18:04.605645 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:04.755115 24173 raft_consensus.cc:2368] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8.
W20260709 12:18:04.758909 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.760089 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:04.762776 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:04.763870 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:04.764634 24095 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:04.766467 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:04.768464 24092 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:04.690732 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 336548us
I20260709 12:18:04.770615 24781 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:04.704883 24248 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:04.684901 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:04.772641 24171 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
I20260709 12:18:04.773681 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:04.774309 24171 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:04.733444 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:04.690167 26465 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.009s	sys 0.009s
I20260709 12:18:04.737402 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:04.541416 24168 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:18:04.728755 24814 rpcz_store.cc:276] 0709 12:18:03.151398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.161570 (+ 10172us) service_pool.cc:224] Handling call
0709 12:18:03.189560 (+ 27990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:03.740381 (+550821us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:04.538392 (+798011us) spinlock_profiling.cc:243] Waited 512 ms on lock 0x7b540070f654. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:04.538659 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177387264}
I20260709 12:18:04.742198 24094 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:04.775061 24172 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:04.783023 25772 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:18:04.784153 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 239581us
W20260709 12:18:04.785017 24067 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.713s (SENT)
I20260709 12:18:04.785398 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:04.786461 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:04.662850 26431 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.791803 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:04.604851 26355 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.843482 26431 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:04.783182 26465 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.010s	sys 0.010s
I20260709 12:18:04.845100 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:04.832015 24244 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:04.791524 26303 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:05.059072 26500 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:04.755712 25999 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:05.419571 24216 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.668s (SENT)
I20260709 12:18:05.825453 24216 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:05.839954 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1227) took 1583 ms. Trace:
I20260709 12:18:04.830278 26497 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:04.882318 24169 raft_consensus.cc:2410] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:04.844808 26289 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:05.513365 24241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.006s	sys 0.002s
W20260709 12:18:05.842878 24241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.012s	sys 0.003s
I20260709 12:18:05.060627 26502 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:04.878640 26269 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.558s	user 0.000s	sys 0.012s
I20260709 12:18:04.833348 25772 raft_consensus.cc:3055] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:05.848580 24242 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:05.848896 25772 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:05.629511 26459 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.658003 26271 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:04.783367 26443 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:04.738670 26486 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:05.450251 24811 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:04.662446 26453 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.613327 26385 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.730020 26475 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:04.886544 26084 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.531s
W20260709 12:18:04.915745 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 129452us
I20260709 12:18:04.845973 26284 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:04.949779 26454 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:04.743221 26439 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:05.272941 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1467) took 1596 ms. Trace:
I20260709 12:18:04.778317 26485 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.664477 26427 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:04.841694 26456 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:04.886123 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:04.779129 26200 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:04.839957 26490 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:18:04.841060 26494 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:04.835561 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:04.913525 26461 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:05.723327 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.790884 24215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.008s	sys 0.016s
W20260709 12:18:05.998636 24215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.008s	sys 0.019s
W20260709 12:18:05.680696 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.805699 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 1.02064e+06us
W20260709 12:18:05.999699 24067 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.762s (SENT)
I20260709 12:18:06.000253 24067 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:06.000546 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 581023us
W20260709 12:18:05.559248 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 161854us
I20260709 12:18:05.807499 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:04.874853 24171 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:18:05.812252 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 414534us
W20260709 12:18:06.001402 24216 leader_election.cc:336] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.686s (SENT)
I20260709 12:18:06.001580 24781 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:05.720801 26512 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:18:05.619165 26340 consensus_meta.cc:287] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.771s	user 0.012s	sys 0.001s
W20260709 12:18:05.726972 26492 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.289s	user 0.000s	sys 0.001s
I20260709 12:18:05.799774 26400 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:05.726485 26436 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.999706 26485 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.017482 26436 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.018296 26465 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:05.850039 25772 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.019716 25772 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.019912 24214 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:06.021029 24176 raft_consensus.cc:2410] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:04.949108 26354 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:18:05.783883 26468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.005s	sys 0.006s
I20260709 12:18:05.847926 24814 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:05.713475 26387 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:04.782379 26432 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:06.013587 26273 raft_consensus.cc:3055] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:05.861763 26269 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:05.726737 26483 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.719985 24813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 325) took 2741 ms. Trace:
W20260709 12:18:05.811185 26469 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.889s	user 0.002s	sys 0.017s
W20260709 12:18:06.082512 26469 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.002s	sys 0.018s
I20260709 12:18:06.080566 26084 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:18:06.080567 24813 rpcz_store.cc:276] 0709 12:18:02.978535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:02.979132 (+   597us) service_pool.cc:224] Handling call
0709 12:18:02.999875 (+ 20743us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:03.336049 (+336174us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:03.584346 (+248297us) log.cc:844] Serialized 14 byte log entry
0709 12:18:03.998519 (+414173us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:04.012023 (+ 13504us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:04.014275 (+  2252us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.679755 (+1665480us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b540067fcd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:05.679847 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.719820 (+ 39973us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":301395,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":2225,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":10503,"spinlock_wait_cycles":698597120,"thread_start_us":512099,"threads_started":2,"wal-append.queue_time_us":428242,"wal-append.run_cpu_time_us":1429,"wal-append.run_wall_time_us":1019750}
I20260709 12:18:06.084581 26475 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:06.021313 26461 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.085427 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:06.086195 24813 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:06.025039 26340 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.087241 26483 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:06.088910 26519 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
I20260709 12:18:06.089138 26385 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:06.089653 26483 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:05.862210 26502 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.090713 26436 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.091126 26453 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:05.992370 26479 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.076s
I20260709 12:18:06.091976 26502 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:05.864009 24093 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:06.092268 26340 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:05.981741 26454 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:05.941162 25999 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:05.966193 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 83623.6us
I20260709 12:18:06.095610 26454 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:06.095679 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:05.863137 24807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.021s	sys 0.022s
I20260709 12:18:05.965934 24096 rpcz_store.cc:276] 0709 12:18:03.676070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:03.676286 (+   216us) service_pool.cc:224] Handling call
0709 12:18:03.700308 (+ 24022us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:03.770723 (+ 70415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:03.770758 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:04.182150 (+411392us) spinlock_profiling.cc:243] Waited 4.26 ms on lock 0x7b2c000014c8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2
0709 12:18:04.182677 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:18:04.690287 (+507610us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:05.040565 (+350278us) log.cc:844] Serialized 14 byte log entry
0709 12:18:05.040959 (+   394us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.041069 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:05.041164 (+    95us) raft_consensus.cc:1685] finished
0709 12:18:05.272534 (+231370us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.272839 (+   305us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":377231,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":60,"raft.queue_time_us":18305,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":26259,"spinlock_wait_cycles":9794304,"thread_start_us":777352,"threads_started":2,"wal-append.queue_time_us":647471}
W20260709 12:18:06.096429 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 96773.4us
I20260709 12:18:05.982029 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1557) took 1209 ms. Trace:
I20260709 12:18:06.097065 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:06.097263 24067 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.789s (SENT)
I20260709 12:18:05.557873 26386 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.098479 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1698) took 1519 ms. Trace:
I20260709 12:18:05.840505 24247 rpcz_store.cc:276] 0709 12:18:04.228631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.229721 (+  1090us) service_pool.cc:224] Handling call
0709 12:18:04.230171 (+   450us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:04.230501 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:04.691668 (+461167us) log.cc:844] Serialized 14 byte log entry
0709 12:18:05.811653 (+1119985us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:05.811718 (+    65us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:05.811776 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.811856 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.812008 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":912682,"prepare.queue_time_us":701253,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":73,"raft.queue_time_us":865637,"thread_start_us":630017,"threads_started":2}
I20260709 12:18:05.873464 26289 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:05.998060 24167 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:05.992834 26284 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:05.965943 26458 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:06.105001 26284 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:05.965682 26481 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.106081 26481 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:05.999527 26456 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.067617 26273 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:06.108325 26481 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:06.108079 26273 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.097095 25999 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:06.109231 25999 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:06.109818 26289 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.098337 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:05.992853 26494 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.117399 26494 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.117498 26284 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:06.116597 26456 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.119789 26517 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:06.019294 26485 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:06.048213 24810 raft_consensus.cc:2368] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
W20260709 12:18:06.120900 24810 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 220) took 1370 ms (client timeout 1564 ms). Trace:
W20260709 12:18:06.121384 24810 rpcz_store.cc:269] 0709 12:18:04.750065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.752887 (+  2822us) service_pool.cc:224] Handling call
0709 12:18:06.120797 (+1367910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:06.115180 26387 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:06.122035 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:05.860373 24779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.010s	sys 0.030s
I20260709 12:18:05.864315 26459 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.056062 26002 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:06.048949 26468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.207s	user 0.005s	sys 0.010s
I20260709 12:18:06.079571 26443 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:06.087576 26461 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.096493 26427 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:06.015246 24216 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.756s (SENT)
I20260709 12:18:06.127696 24216 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:06.129040 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 113831us
W20260709 12:18:06.123055 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.132587 24093 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:06.013036 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1563) took 1242 ms. Trace:
I20260709 12:18:05.881542 26476 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:06.056772 26354 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.142918 26271 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.143126 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.143501 26271 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.144066 24244 raft_consensus.cc:2410] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:06.105103 26458 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.146054 26478 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.146476 24813 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:06.146623 26458 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:06.146564 26478 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.148059 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:06.148432 26084 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:06.148836 24249 raft_consensus.cc:2368] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7.
I20260709 12:18:06.149034 26084 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.149722 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.150015 25772 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:05.966406 26486 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.016345 26498 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.098918 24101 rpcz_store.cc:276] 0709 12:18:04.578856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.594879 (+ 16023us) service_pool.cc:224] Handling call
0709 12:18:04.607588 (+ 12709us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:04.614865 (+  7277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.614914 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:04.640734 (+ 25820us) log.cc:844] Serialized 26 byte log entry
0709 12:18:05.050010 (+409276us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:05.050076 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.050192 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:06.098203 (+1048011us) raft_consensus.cc:1685] finished
0709 12:18:06.098225 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.098405 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6675,"raft.run_cpu_time_us":198,"raft.run_wall_time_us":42539,"thread_start_us":265100,"threads_started":1,"wal-append.queue_time_us":1227267}
I20260709 12:18:06.097306 24174 rpcz_store.cc:276] 0709 12:18:04.733668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.735337 (+  1669us) service_pool.cc:224] Handling call
0709 12:18:04.735847 (+   510us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:04.736543 (+   696us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 12:18:04.737019 (+   476us) log.cc:844] Serialized 14 byte log entry
0709 12:18:04.761841 (+ 24822us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:04.835120 (+ 73279us) log.cc:844] Serialized 26 byte log entry
0709 12:18:04.835319 (+   199us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:04.835582 (+   263us) log.cc:844] Serialized 14 byte log entry
0709 12:18:05.469682 (+634100us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b18003d0540. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:05.473109 (+  3427us) spinlock_profiling.cc:243] Waited 7.15 ms on lock 0x7b4800111e58. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0a4a4aa1 00007f4c0a49bb37 00007f4c0a49b9ca 00007f4c0a59326f 00007f4c0a592f37 00007f4c0a5a755c 00007f4c0a5a7508 00007f4c0a5a7488 00007f4c0a5a7443 00007f4c0a5a66ec 00007f4c094d0a96
0709 12:18:05.660219 (+187110us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b18003d0540. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02408c0a 00007f4c0bb48219 00007f4c02490a40 00007f4c0248b4e4 00007f4c0248b455 00007f4c05573060 00007f4c05585716 00007f4c05596287 00007f4c05596208
0709 12:18:05.660485 (+   266us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.660589 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:05.942961 (+282372us) raft_consensus.cc:1685] finished
0709 12:18:05.943000 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:05.943167 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1047651,"prepare.queue_time_us":2870,"prepare.run_cpu_time_us":113,"prepare.run_wall_time_us":119,"raft.queue_time_us":833250,"raft.run_cpu_time_us":3585,"raft.run_wall_time_us":740249,"spinlock_wait_cycles":188614144,"thread_start_us":24211,"threads_started":1,"wal-append.queue_time_us":1102532}
I20260709 12:18:06.151981 26498 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.153106 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:06.153409 26479 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:06.115135 26200 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:06.163180 26431 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.163440 26200 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:06.164610 26200 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.165560 24806 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:06.166329 24806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 329) took 2144 ms. Trace:
I20260709 12:18:06.163462 26469 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.168107 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:06.153930 26517 raft_consensus.cc:697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:06.110296 25999 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.170027 26517 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.171250 26479 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:05.943403 26303 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:06.173295 26303 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.173839 26479 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:06.171940 26478 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:06.116605 26273 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:06.176517 24813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 338) took 1297 ms (client timeout 1595 ms). Trace:
W20260709 12:18:06.176985 24813 rpcz_store.cc:269] 0709 12:18:04.879116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.085063 (+1205947us) service_pool.cc:224] Handling call
0709 12:18:06.176425 (+ 91362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:06.178279 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:06.103034 26432 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:06.179193 26432 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.122934 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:06.115869 26289 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:06.179730 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:06.136886 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.125816 26443 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.180771 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:06.180962 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:06.173941 24140 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59344 dropped due to backpressure: service queue is full with 50 items [suppressed 11 similar messages]
I20260709 12:18:06.123847 26387 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.135154 24171 rpcz_store.cc:276] 0709 12:18:04.759268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.773393 (+ 14125us) service_pool.cc:224] Handling call
0709 12:18:06.001648 (+1228255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:06.140224 24807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 218) took 1485 ms. Trace:
I20260709 12:18:06.142418 26485 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:06.143275 26354 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:06.182649 26443 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.156087 26461 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.141422 26476 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.183437 26461 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.185603 26476 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:06.185993 26461 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:06.104120 26510 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:18:06.182849 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:06.156469 26498 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.187784 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:06.188465 24171 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:06.188531 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1225) took 1997 ms. Trace:
I20260709 12:18:06.157037 26465 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:06.189796 26465 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.161187 26171 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.167872 26469 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.189445 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:06.191190 26171 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.192170 26465 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.179598 26432 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:06.125126 26459 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.181587 24810 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:18:06.123181 24779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.011s	sys 0.030s
I20260709 12:18:06.188946 24241 rpcz_store.cc:276] 0709 12:18:04.191497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.191629 (+   132us) service_pool.cc:224] Handling call
0709 12:18:04.192026 (+   397us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:04.604204 (+412178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:04.604251 (+    47us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:04.751819 (+147568us) log.cc:844] Serialized 78 byte log entry
0709 12:18:05.843561 (+1091742us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:05.858471 (+ 14910us) log.cc:844] Serialized 14 byte log entry
0709 12:18:05.873588 (+ 15117us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:05.873689 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:06.188248 (+314559us) raft_consensus.cc:1685] finished
0709 12:18:06.188271 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.188454 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61647,"raft.queue_time_us":24395,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":66809,"spinlock_wait_cycles":659840,"thread_start_us":931801,"threads_started":1,"wal-append.queue_time_us":1155034}
I20260709 12:18:06.213291 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.161329 26355 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:06.197392 24174 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:06.218294 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:06.157775 24066 leader_election.cc:400] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
I20260709 12:18:06.168783 24170 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:06.207173 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 87977.5us
I20260709 12:18:06.166657 24806 rpcz_store.cc:276] 0709 12:18:04.021513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.027993 (+  6480us) service_pool.cc:224] Handling call
0709 12:18:04.736822 (+708829us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:06.165099 (+1428277us) spinlock_profiling.cc:243] Waited 2.25 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456e9c 00007f4c02456a5b 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:06.165341 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.165997 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.166233 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7688320}
I20260709 12:18:06.209951 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.210858 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.182173 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:06.238912 24246 raft_consensus.cc:2410] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:18:06.213945 24241 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:06.194257 24140 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:59344 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1598)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1581)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1608)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1606)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1566)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1569)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1574)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 265)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 267)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1589)
I20260709 12:18:06.239022 24066 leader_election.cc:403] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:18:06.240868 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.242700 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.124977 26002 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:06.219921 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:06.245288 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 87667.2us
I20260709 12:18:06.248558 24171 raft_consensus.cc:2410] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:06.248886 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:06.249549 24100 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:06.250823 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.251513 24241 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:06.251806 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:06.252431 24092 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.252671 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:06.247574 24067 connection.cc:256] RPC call timeout handler was delayed by -1.5846264670001347s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2304s for a response
W20260709 12:18:06.255281 24067 connection.cc:256] RPC call timeout handler was delayed by -1.5825786460000018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260709 12:18:06.257838 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:06.258497 24100 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:06.259029 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:06.259749 24171 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:06.260247 24247 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:06.261808 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:06.262423 24810 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:06.262593 24101 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:06.264166 26494 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.260793 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:06.270133 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59344 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1566)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1569)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1574)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 265)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 267)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1148)
I20260709 12:18:06.274240 24171 raft_consensus.cc:2410] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:06.276832 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.277803 24092 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:06.277973 24246 raft_consensus.cc:2393] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 3: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:06.278070 26354 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.279273 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.291332 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.291752 24246 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:06.291980 24247 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:06.274645 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1582)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1566)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1569)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1574)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 265)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 267)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1148)
I20260709 12:18:06.283349 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:06.251730 26002 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.283865 26469 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.255437 26479 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.255576 26461 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
I20260709 12:18:06.285749 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.286598 24809 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:06.288977 26171 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.245555 26465 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:06.243898 26439 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:06.292956 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:06.297284 24169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1556) took 1564 ms (client timeout 1896 ms). Trace:
I20260709 12:18:06.313146 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:06.297806 24094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1695) took 2271 ms (client timeout 1816 ms). Trace:
I20260709 12:18:06.296314 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:06.308848 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:06.256228 24067 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.578s (SENT)
I20260709 12:18:06.318657 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:06.505807 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:18:06.308444 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:06.312232 24176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1560) took 1577 ms (client timeout 1686 ms). Trace:
I20260709 12:18:06.295326 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:06.376405 24093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1705) took 1610 ms (client timeout 1595 ms). Trace:
I20260709 12:18:06.311185 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:06.368546 24174 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:18:06.417922 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 61208.1us
W20260709 12:18:06.511201 24814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 331) took 1673 ms (client timeout 1897 ms). Trace:
W20260709 12:18:06.486825 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.616034 24247 raft_consensus.cc:2410] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:18:06.492820 24167 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1548) took 2078 ms (client timeout 1514 ms). Trace:
W20260709 12:18:06.318158 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 76992.4us
I20260709 12:18:06.616896 24812 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:06.612689 24101 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.609921 24092 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.535225 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:06.507045 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:06.298178 24140 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:59356 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1566)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1569)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1574)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 265)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 267)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1148)
I20260709 12:18:06.308751 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:06.630028 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.638481 24172 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:18:06.266805 26494 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:06.621762 24241 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:18:06.550915 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 292827us
I20260709 12:18:06.639838 24171 raft_consensus.cc:2410] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:18:06.614810 24094 rpcz_store.cc:269] 0709 12:18:04.025869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.027497 (+  1628us) service_pool.cc:224] Handling call
0709 12:18:06.297611 (+2270114us) spinlock_profiling.cc:243] Waited 452 ms on lock 0x7b54002d78d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:06.297723 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1039598464}
W20260709 12:18:06.613668 24093 rpcz_store.cc:269] 0709 12:18:04.765957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.766187 (+   230us) service_pool.cc:224] Handling call
0709 12:18:06.376058 (+1609871us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54002d64d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:06.376279 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2522541952}
I20260709 12:18:06.307826 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:06.632673 24173 raft_consensus.cc:1813] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Handling vote request from an unknown peer fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:06.612339 24176 rpcz_store.cc:269] 0709 12:18:04.734726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.740633 (+  5907us) service_pool.cc:224] Handling call
0709 12:18:06.311996 (+1571363us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b54003ea3d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:06.312157 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":44333824}
I20260709 12:18:06.642784 24173 raft_consensus.cc:2368] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
W20260709 12:18:06.643385 24173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1558) took 1909 ms (client timeout 2162 ms). Trace:
W20260709 12:18:06.633004 24814 rpcz_store.cc:269] 0709 12:18:04.837906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.844768 (+  6862us) service_pool.cc:224] Handling call
0709 12:18:06.510866 (+1666098us) spinlock_profiling.cc:243] Waited 35.8 ms on lock 0x7b540067f054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:06.511097 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82412928}
I20260709 12:18:06.643831 24095 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:18:06.610167 24169 rpcz_store.cc:269] 0709 12:18:04.733326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.737038 (+  3712us) service_pool.cc:224] Handling call
0709 12:18:06.297044 (+1560006us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54003b10d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:06.297213 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234679552}
I20260709 12:18:06.613945 24246 raft_consensus.cc:2368] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7.
I20260709 12:18:06.631718 24066 leader_election.cc:400] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7.
I20260709 12:18:06.644976 24066 leader_election.cc:403] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260709 12:18:06.642381 24243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1232) took 1887 ms (client timeout 1564 ms). Trace:
W20260709 12:18:06.646406 24243 rpcz_store.cc:269] 0709 12:18:04.754725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.307461 (+1552736us) service_pool.cc:224] Handling call
0709 12:18:06.642286 (+334825us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:06.631894 24167 rpcz_store.cc:269] 0709 12:18:04.414011 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.416003 (+  1992us) service_pool.cc:224] Handling call
0709 12:18:06.492506 (+2076503us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b54002aeed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:06.492696 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3282417536}
I20260709 12:18:06.291191 24813 raft_consensus.cc:2368] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7.
I20260709 12:18:06.659731 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:06.660400 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.661366 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:06.661520 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 405302us
I20260709 12:18:06.662317 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:06.662405 24067 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.608s (SENT)
W20260709 12:18:06.643741 24173 rpcz_store.cc:269] 0709 12:18:04.734016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.756022 (+ 22006us) service_pool.cc:224] Handling call
0709 12:18:06.311025 (+1555003us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:06.643288 (+332263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2874240}
I20260709 12:18:06.663084 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:06.659873 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:06.665544 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:06.666216 24096 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.668462 24100 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:06.668629 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:06.669399 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.669625 24243 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:06.672791 24247 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:18:06.680889 24815 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
W20260709 12:18:06.686260 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 54851.3us
I20260709 12:18:06.686834 24170 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
W20260709 12:18:06.687137 24067 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.768s (SENT)
W20260709 12:18:06.687505 24170 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1562) took 1943 ms (client timeout 2229 ms). Trace:
I20260709 12:18:06.687696 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:06.693464 24097 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:06.603977 26269 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:06.700172 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:06.703096 24812 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:06.683808 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:06.306015 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:06.700172 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:06.701239 24815 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 216) took 2027 ms (client timeout 1621 ms). Trace:
I20260709 12:18:06.707244 24241 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
W20260709 12:18:06.687963 24170 rpcz_store.cc:269] 0709 12:18:04.744639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.728112 (+983473us) service_pool.cc:224] Handling call
0709 12:18:06.167939 (+439827us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:06.687436 (+519497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":65743232}
W20260709 12:18:06.703682 24812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 219) took 2048 ms (client timeout 2669 ms). Trace:
I20260709 12:18:06.701036 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:06.700378 24215 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:06.705128 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:06.618624 26462 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:06.709865 24092 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:06.712040 24175 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
W20260709 12:18:06.712878 24175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1559) took 1978 ms (client timeout 2141 ms). Trace:
W20260709 12:18:06.709020 24812 rpcz_store.cc:269] 0709 12:18:04.655350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.655472 (+   122us) service_pool.cc:224] Handling call
0709 12:18:06.296124 (+1640652us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:06.703618 (+407494us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47346432}
W20260709 12:18:06.707369 24815 rpcz_store.cc:269] 0709 12:18:04.654105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.654262 (+   157us) service_pool.cc:224] Handling call
0709 12:18:06.505568 (+1851306us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:06.681647 (+176079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":55297792}
I20260709 12:18:06.718248 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:06.724050 24806 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:06.724804 25999 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:06.727741 26271 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:06.727626 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:06.729902 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.734762 26462 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.735766 26298 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:06.736536 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 352096us
I20260709 12:18:06.630255 26439 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:06.427608 26479 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:06.673305 26465 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:06.713464 24175 rpcz_store.cc:269] 0709 12:18:04.734395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.741126 (+  6731us) service_pool.cc:224] Handling call
0709 12:18:06.535042 (+1793916us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:06.712798 (+177756us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6274944}
W20260709 12:18:06.895962 26527 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:18:06.841763 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:06.845830 24101 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:07.384647 24173 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:07.384804 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1714) took 1073 ms. Trace:
I20260709 12:18:06.798135 26478 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:06.691752 26354 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:06.896050 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:07.388324 24812 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:06.703289 26469 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7.
I20260709 12:18:06.753198 24096 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:06.980341 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:06.998873 24811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 328) took 2978 ms. Trace:
I20260709 12:18:06.932911 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.398728 24170 raft_consensus.cc:2410] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:06.768600 24172 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3.
W20260709 12:18:06.832417 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 132114us
W20260709 12:18:07.399525 24172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1565) took 2607 ms (client timeout 2130 ms). Trace:
I20260709 12:18:07.400281 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:06.943171 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 86493.1us
I20260709 12:18:06.836968 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1229) took 2522 ms. Trace:
I20260709 12:18:06.850054 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:06.832818 26476 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:06.194118 24807 rpcz_store.cc:276] 0709 12:18:04.655023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.657658 (+  2635us) service_pool.cc:224] Handling call
0709 12:18:04.782575 (+124917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:04.836440 (+ 53865us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:05.350833 (+514393us) log.cc:844] Serialized 14 byte log entry
0709 12:18:06.139728 (+788895us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:06.139806 (+    78us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:06.139871 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.139957 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:06.140146 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26769,"prepare.queue_time_us":1010914,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":26896,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":983586,"threads_started":2,"wal-append.queue_time_us":748007}
W20260709 12:18:07.122848 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.172910 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:06.724840 24808 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:06.701207 26200 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:07.423879 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1240) took 1269 ms. Trace:
I20260709 12:18:07.352183 26462 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:07.424350 24244 rpcz_store.cc:276] 0709 12:18:06.154842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.174484 (+ 19642us) service_pool.cc:224] Handling call
0709 12:18:06.174860 (+   376us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:06.175302 (+   442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:06.175338 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:06.175878 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:18:06.237564 (+ 61686us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:06.237613 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.237702 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:07.423609 (+1185907us) raft_consensus.cc:1685] finished
0709 12:18:07.423633 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.423804 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":119,"thread_start_us":52610,"threads_started":1,"wal-append.queue_time_us":435042}
I20260709 12:18:07.429023 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:07.429636 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:07.430254 24241 raft_consensus.cc:2368] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7.
I20260709 12:18:07.354744 26517 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.357980 26432 consensus_meta.cc:287] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.127s	user 0.014s	sys 0.013s
I20260709 12:18:07.276482 24168 raft_consensus.cc:2410] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:18:07.362957 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.013s	sys 0.035s
W20260709 12:18:07.446465 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.014s	sys 0.035s
W20260709 12:18:07.446884 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 745828us
W20260709 12:18:07.447110 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 46943.3us
I20260709 12:18:06.695052 26521 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.448319 24215 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:07.449363 26521 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:07.372874 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.452046 26453 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:07.452982 24175 raft_consensus.cc:2410] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:07.452934 26453 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:07.453663 24175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1571) took 1598 ms (client timeout 2091 ms). Trace:
W20260709 12:18:07.454103 24175 rpcz_store.cc:269] 0709 12:18:05.855775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.372535 (+1516760us) service_pool.cc:224] Handling call
0709 12:18:07.453584 (+ 81049us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.363567 24141 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.777s (SENT) [suppressed 47 similar messages]
W20260709 12:18:07.385258 24173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1605) took 1213 ms (client timeout 1597 ms). Trace:
I20260709 12:18:07.385288 24101 rpcz_store.cc:276] 0709 12:18:06.311368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.312846 (+  1478us) service_pool.cc:224] Handling call
0709 12:18:07.384707 (+1071861us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.406322 24067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.007s	sys 0.025s
W20260709 12:18:07.364872 26269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.010s	sys 0.040s
I20260709 12:18:07.401567 24242 rpcz_store.cc:276] 0709 12:18:04.314410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.446338 (+131928us) service_pool.cc:224] Handling call
0709 12:18:04.446833 (+   495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.849070 (+1402237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.836549 (+987479us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54000604d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:06.836850 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3223226624}
W20260709 12:18:07.408849 24170 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1604) took 1236 ms (client timeout 1607 ms). Trace:
W20260709 12:18:07.400045 24172 rpcz_store.cc:269] 0709 12:18:04.792143 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.308365 (+1516222us) service_pool.cc:224] Handling call
0709 12:18:07.399430 (+1091065us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.408842 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1151) took 1139 ms. Trace:
I20260709 12:18:07.397639 26478 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:07.415026 26354 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:07.417774 24809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 330) took 2633 ms (client timeout 2826 ms). Trace:
W20260709 12:18:07.466224 24064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.009s
I20260709 12:18:07.459820 26432 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:07.466416 24809 rpcz_store.cc:269] 0709 12:18:04.783966 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.793170 (+  9204us) service_pool.cc:224] Handling call
0709 12:18:07.417477 (+2624307us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54002ef9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:07.417671 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":700705664}
I20260709 12:18:07.418704 24810 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:06.586834 24139 service_pool.cc:137] RequestConsensusVote request on kudu.consensus.ConsensusService from 127.0.0.1:44066 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1605)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1583)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1571)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1575)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1603)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1584)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1588)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1597)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1591)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 269)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1568)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 264)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1590)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1585)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1578)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1592)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1607)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1593)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1594)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1599)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1595)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1596)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1612)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1610)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1600)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 268)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1601)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1602)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1587)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1586)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1561)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1566)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1569)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1573)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1574)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 263)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 265)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 266)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 267)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1589)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1147)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1148)
I20260709 12:18:07.419207 26469 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.398020 24811 rpcz_store.cc:276] 0709 12:18:04.020682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.021782 (+  1100us) service_pool.cc:224] Handling call
0709 12:18:04.119819 (+ 98037us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:05.881204 (+1761385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.998496 (+1117292us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54005e01d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:06.998774 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3032829184}
I20260709 12:18:07.420540 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:07.477917 24098 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:07.437624 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:07.478892 24244 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:18:06.896888 26284 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.184s
I20260709 12:18:07.451483 26355 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:07.395840 26298 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:07.446166 26476 raft_consensus.cc:697] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:07.436318 24214 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:07.485016 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48855.9us
I20260709 12:18:07.455300 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:07.455618 24173 rpcz_store.cc:269] 0709 12:18:06.172260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.841425 (+669165us) service_pool.cc:224] Handling call
0709 12:18:07.385193 (+543768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.457315 24174 rpcz_store.cc:276] 0709 12:18:06.269414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.924819 (+655405us) service_pool.cc:224] Handling call
0709 12:18:07.408754 (+483935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.486269 24175 raft_consensus.cc:2376] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5. Re-sending same reply.
I20260709 12:18:07.486974 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1154) took 1189 ms. Trace:
I20260709 12:18:07.487419 24175 rpcz_store.cc:276] 0709 12:18:06.297262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.454945 (+1157683us) service_pool.cc:224] Handling call
0709 12:18:07.486894 (+ 31949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.455046 24812 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
W20260709 12:18:07.463706 24168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1564) took 2685 ms (client timeout 1519 ms). Trace:
W20260709 12:18:07.491426 24250 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.015s	sys 0.036s
I20260709 12:18:07.463851 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:07.455796 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 92400.3us
W20260709 12:18:07.492416 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.470402 24064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.574s	user 0.013s	sys 0.010s
W20260709 12:18:07.459249 26269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.010s	sys 0.040s
I20260709 12:18:07.469065 26432 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:07.491536 24168 rpcz_store.cc:269] 0709 12:18:04.778106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:05.421421 (+643315us) service_pool.cc:224] Handling call
0709 12:18:06.727393 (+1305972us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:07.463615 (+736222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3022592}
I20260709 12:18:07.476441 24066 leader_election.cc:400] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7.
I20260709 12:18:07.495641 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:07.381639 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1475) took 1113 ms. Trace:
I20260709 12:18:07.497108 24214 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:07.497231 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:07.498138 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:07.498445 24247 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:07.496510 24243 rpcz_store.cc:276] 0709 12:18:06.268365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.671306 (+402941us) service_pool.cc:224] Handling call
0709 12:18:06.705927 (+ 34621us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.706170 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:06.728523 (+ 22353us) log.cc:844] Serialized 14 byte log entry
0709 12:18:07.381051 (+652528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:07.381148 (+    97us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:07.381221 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.381346 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.381541 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":24347,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":44,"raft.queue_time_us":386306,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":8960,"thread_start_us":265683,"threads_started":1,"wal-append.queue_time_us":744111}
W20260709 12:18:07.380152 24216 connection.cc:256] RPC call timeout handler was delayed by -1.7687471860001551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1513s for a response
W20260709 12:18:07.456670 24170 rpcz_store.cc:269] 0709 12:18:06.171944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.932471 (+760527us) service_pool.cc:224] Handling call
0709 12:18:07.408754 (+476283us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.501220 24214 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:07.502095 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.503159 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1591) took 1344 ms. Trace:
I20260709 12:18:07.503571 24170 rpcz_store.cc:276] 0709 12:18:06.158647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.501760 (+1343113us) service_pool.cc:224] Handling call
0709 12:18:07.503074 (+  1314us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.504770 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.505666 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 269) took 1386 ms. Trace:
I20260709 12:18:07.506078 24170 rpcz_store.cc:276] 0709 12:18:06.119154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.504433 (+1385279us) service_pool.cc:224] Handling call
0709 12:18:07.505595 (+  1162us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.492300 24172 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
W20260709 12:18:07.507422 24172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1575) took 1627 ms (client timeout 2085 ms). Trace:
W20260709 12:18:07.507947 24172 rpcz_store.cc:269] 0709 12:18:05.880488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.463472 (+1582984us) service_pool.cc:224] Handling call
0709 12:18:07.507323 (+ 43851us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.470526 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:18:07.491923 24250 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.015s	sys 0.036s
W20260709 12:18:07.510833 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.511440 24216 connection.cc:256] RPC call timeout handler was delayed by -1.6900187470000674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20579999999999998s for a response
W20260709 12:18:07.512459 24216 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.871s (SENT)
I20260709 12:18:07.513283 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:07.472589 24067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.008s	sys 0.026s
W20260709 12:18:07.515151 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 827988us
W20260709 12:18:07.516305 24067 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.770s (SENT)
W20260709 12:18:07.517333 24067 connection.cc:256] RPC call timeout handler was delayed by -1.5213857270000517s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 12:18:07.518518 24249 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:07.520565 24067 leader_election.cc:336] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.836s (SENT)
I20260709 12:18:07.532940 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.533035 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.535204 24175 raft_consensus.cc:2410] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:07.535941 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1588) took 1378 ms. Trace:
I20260709 12:18:07.533946 24173 raft_consensus.cc:2376] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:07.536412 24175 rpcz_store.cc:276] 0709 12:18:06.157825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.494173 (+1336348us) service_pool.cc:224] Handling call
0709 12:18:07.535849 (+ 41676us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.536820 24173 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1603) took 1365 ms (client timeout 1819 ms). Trace:
W20260709 12:18:07.537370 24173 rpcz_store.cc:269] 0709 12:18:06.171658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.494199 (+1322541us) service_pool.cc:224] Handling call
0709 12:18:07.536731 (+ 42532us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.537842 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.538909 24175 raft_consensus.cc:2393] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:07.525136 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.542014 24170 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:07.542591 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1568) took 1742 ms. Trace:
I20260709 12:18:07.543045 24170 rpcz_store.cc:276] 0709 12:18:05.800456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.524759 (+1724303us) service_pool.cc:224] Handling call
0709 12:18:07.542502 (+ 17743us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.459612 26517 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:07.469344 26542 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:18:07.545522 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.556699 24168 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:07.557440 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1597) took 1397 ms. Trace:
I20260709 12:18:07.557857 24168 rpcz_store.cc:276] 0709 12:18:06.160344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.494172 (+1333828us) service_pool.cc:224] Handling call
0709 12:18:07.557346 (+ 63174us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.554683 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.560513 24171 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:07.561175 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1578) took 1556 ms. Trace:
I20260709 12:18:07.561553 24171 rpcz_store.cc:276] 0709 12:18:06.009903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.554332 (+1544429us) service_pool.cc:224] Handling call
0709 12:18:07.561099 (+  6767us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.568430 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:07.570621 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.550093 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1590) took 1391 ms. Trace:
I20260709 12:18:07.552026 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.572847 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 264) took 1524 ms. Trace:
I20260709 12:18:07.573338 24172 rpcz_store.cc:276] 0709 12:18:06.048558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.508797 (+1460239us) service_pool.cc:224] Handling call
0709 12:18:07.572736 (+ 63939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.552973 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.574757 24174 raft_consensus.cc:2376] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5. Re-sending same reply.
W20260709 12:18:07.575620 24174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1584) took 1419 ms (client timeout 1871 ms). Trace:
W20260709 12:18:07.576104 24174 rpcz_store.cc:269] 0709 12:18:06.156559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.494854 (+1338295us) service_pool.cc:224] Handling call
0709 12:18:07.575532 (+ 80678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.577222 24175 rpcz_store.cc:276] 0709 12:18:06.158375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.537458 (+1379083us) service_pool.cc:224] Handling call
0709 12:18:07.549939 (+ 12481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.562773 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.580222 24171 raft_consensus.cc:2410] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:07.524199 26271 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:07.496210 26453 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:07.474064 26354 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:07.480320 26469 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:07.586524 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1607) took 1413 ms. Trace:
I20260709 12:18:07.621629 24171 rpcz_store.cc:276] 0709 12:18:06.172922 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.562425 (+1389503us) service_pool.cc:224] Handling call
0709 12:18:07.586449 (+ 24024us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.622793 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.578619 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.588510 26547 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:07.624033 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1599) took 1463 ms. Trace:
I20260709 12:18:07.624392 24175 rpcz_store.cc:276] 0709 12:18:06.160858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.578226 (+1417368us) service_pool.cc:224] Handling call
0709 12:18:07.623964 (+ 45738us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.625301 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.625880 24175 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:07.595134 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 74621us
W20260709 12:18:07.523392 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 115136us
W20260709 12:18:07.627115 24067 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.933s (SENT)
I20260709 12:18:07.600661 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.627797 24170 raft_consensus.cc:1813] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Handling vote request from an unknown peer fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:07.628243 24170 raft_consensus.cc:2368] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:07.628628 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1595) took 1468 ms. Trace:
I20260709 12:18:07.628727 24215 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:07.604198 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.569602 24168 raft_consensus.cc:2376] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:07.629997 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1592) took 1471 ms. Trace:
I20260709 12:18:07.619577 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:07.628953 24170 rpcz_store.cc:276] 0709 12:18:06.159829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.600350 (+1440521us) service_pool.cc:224] Handling call
0709 12:18:07.628561 (+ 28211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.630416 24168 rpcz_store.cc:276] 0709 12:18:06.158972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.558764 (+1399792us) service_pool.cc:224] Handling call
0709 12:18:07.629928 (+ 71164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.601517 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:07.631412 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.629932 24173 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:07.521514 26200 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.632310 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1585) took 1475 ms. Trace:
I20260709 12:18:07.634683 24173 rpcz_store.cc:276] 0709 12:18:06.156942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.538232 (+1381290us) service_pool.cc:224] Handling call
0709 12:18:07.632232 (+ 94000us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.636059 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.636695 24173 raft_consensus.cc:2376] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:07.637142 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1600) took 1466 ms. Trace:
I20260709 12:18:07.637429 24173 rpcz_store.cc:276] 0709 12:18:06.170629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.635778 (+1465149us) service_pool.cc:224] Handling call
0709 12:18:07.637090 (+  1312us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.638342 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.638720 24098 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:07.639442 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.640071 24172 raft_consensus.cc:2376] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 3. Re-sending same reply.
I20260709 12:18:07.640604 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1593) took 1481 ms. Trace:
I20260709 12:18:07.640991 24172 rpcz_store.cc:276] 0709 12:18:06.159276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.574322 (+1415046us) service_pool.cc:224] Handling call
0709 12:18:07.640541 (+ 66219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.631413 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.525599 26273 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:07.641988 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.645743 24174 raft_consensus.cc:2376] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4. Re-sending same reply.
I20260709 12:18:07.642419 24170 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:07.646421 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1594) took 1486 ms. Trace:
I20260709 12:18:07.642879 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1596) took 1482 ms. Trace:
I20260709 12:18:07.646641 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1610) took 1379 ms. Trace:
I20260709 12:18:07.647224 24170 rpcz_store.cc:276] 0709 12:18:06.267333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.631072 (+1363739us) service_pool.cc:224] Handling call
0709 12:18:07.646574 (+ 15502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37120}
I20260709 12:18:07.648419 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:07.648974 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.649389 26284 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:07.649924 26284 raft_consensus.cc:697] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:07.650048 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1715) took 1336 ms. Trace:
I20260709 12:18:07.544818 26479 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:07.647162 24171 rpcz_store.cc:276] 0709 12:18:06.160091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.622457 (+1462366us) service_pool.cc:224] Handling call
0709 12:18:07.642799 (+ 20342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.652796 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.638917 24173 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:07.635141 24094 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:07.653537 24171 raft_consensus.cc:2368] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8.
I20260709 12:18:07.653350 24174 rpcz_store.cc:276] 0709 12:18:06.159542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.576996 (+1417454us) service_pool.cc:224] Handling call
0709 12:18:07.646345 (+ 69349us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.649011 24170 raft_consensus.cc:2376] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6. Re-sending same reply.
I20260709 12:18:07.659277 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.659966 24170 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:07.653995 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1609) took 1480 ms. Trace:
I20260709 12:18:07.660815 24173 rpcz_store.cc:276] 0709 12:18:06.173474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.638032 (+1464558us) service_pool.cc:224] Handling call
0709 12:18:07.653861 (+ 15829us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.640421 26002 consensus_meta.cc:287] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.976s	user 0.011s	sys 0.015s
I20260709 12:18:07.669534 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.670415 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 268) took 1555 ms. Trace:
I20260709 12:18:07.670854 24172 rpcz_store.cc:276] 0709 12:18:06.114900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.641648 (+1526748us) service_pool.cc:224] Handling call
0709 12:18:07.670331 (+ 28683us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.635532 26485 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:07.662832 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1601) took 1491 ms. Trace:
I20260709 12:18:07.633735 26547 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.650485 24099 rpcz_store.cc:276] 0709 12:18:06.313859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.313997 (+   138us) service_pool.cc:224] Handling call
0709 12:18:06.314407 (+   410us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:06.314877 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:06.314907 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:06.315680 (+   773us) log.cc:844] Serialized 52 byte log entry
0709 12:18:06.664711 (+349031us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:06.664759 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.664843 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:07.649790 (+984947us) raft_consensus.cc:1685] finished
0709 12:18:07.649814 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.649979 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46785,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":53926,"thread_start_us":348562,"threads_started":1,"wal-append.queue_time_us":1275759}
I20260709 12:18:07.672641 24171 rpcz_store.cc:276] 0709 12:18:06.171017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.652509 (+1481492us) service_pool.cc:224] Handling call
0709 12:18:07.662741 (+ 10232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.673916 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.674678 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.674865 24174 raft_consensus.cc:2368] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8.
I20260709 12:18:07.675328 24171 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:07.675626 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.667688 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1716) took 1353 ms. Trace:
I20260709 12:18:07.676267 24173 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:07.677052 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1150) took 1407 ms. Trace:
I20260709 12:18:07.640741 26453 raft_consensus.cc:697] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:07.678846 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1602) took 1507 ms. Trace:
I20260709 12:18:07.676241 24098 rpcz_store.cc:276] 0709 12:18:06.314188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.317592 (+  3404us) service_pool.cc:224] Handling call
0709 12:18:07.420338 (+1102746us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:07.667592 (+247254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6607616}
I20260709 12:18:07.679141 24173 rpcz_store.cc:276] 0709 12:18:06.269156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.661555 (+1392399us) service_pool.cc:224] Handling call
0709 12:18:07.676989 (+ 15434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.680241 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:07.691077 24174 rpcz_store.cc:276] 0709 12:18:06.171356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.655378 (+1484022us) service_pool.cc:224] Handling call
0709 12:18:07.678748 (+ 23370us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.694177 26469 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:07.671813 26538 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:18:07.685333 26084 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:07.650904 26284 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:07.687556 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:07.719285 24175 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:07.719537 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.719957 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1612) took 1452 ms. Trace:
I20260709 12:18:07.720362 24174 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:18:07.720323 24175 rpcz_store.cc:276] 0709 12:18:06.267981 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.625049 (+1357068us) service_pool.cc:224] Handling call
0709 12:18:07.719887 (+ 94838us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.688270 26465 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:07.688939 26355 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.689023 26439 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:07.684382 26478 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:07.695500 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 68434.8us
I20260709 12:18:07.700909 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:07.644979 26200 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:07.663326 26476 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:07.707381 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 197353us
I20260709 12:18:07.663664 26273 raft_consensus.cc:697] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:07.712953 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:07.735323 24781 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:07.739070 24098 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:07.739096 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:07.715646 24171 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:07.675226 26547 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:07.722740 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:07.730916 24173 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:07.731060 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:07.740685 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1586) took 1583 ms. Trace:
W20260709 12:18:07.730607 24067 leader_election.cc:336] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.936s (SENT)
I20260709 12:18:07.741072 24171 rpcz_store.cc:276] 0709 12:18:06.157245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.673440 (+1516195us) service_pool.cc:224] Handling call
0709 12:18:07.740600 (+ 67160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.741379 24067 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:07.742036 24096 raft_consensus.cc:2376] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7. Re-sending same reply.
I20260709 12:18:07.735354 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:07.736349 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:07.743620 24093 raft_consensus.cc:2410] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:07.675019 26002 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:07.745754 24214 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:07.757330 24170 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:07.761232 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1587) took 1603 ms. Trace:
I20260709 12:18:07.761855 24170 rpcz_store.cc:276] 0709 12:18:06.157541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.658969 (+1501428us) service_pool.cc:224] Handling call
0709 12:18:07.761072 (+102103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.764016 24170 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:18:07.764357 24170 pending_rounds.cc:85] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 3
I20260709 12:18:07.764622 24170 pending_rounds.cc:107] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:18:07.764946 24170 raft_consensus.cc:2889] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:07.766552 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1573) took 1895 ms. Trace:
I20260709 12:18:07.767354 24214 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:07.767081 24170 rpcz_store.cc:276] 0709 12:18:05.871278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.763299 (+1892021us) service_pool.cc:224] Handling call
0709 12:18:07.763636 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.766269 (+  2633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.766487 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.767105 24174 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:07.769455 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1566) took 2362 ms. Trace:
I20260709 12:18:07.769872 24174 rpcz_store.cc:276] 0709 12:18:05.407188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.747444 (+2340256us) service_pool.cc:224] Handling call
0709 12:18:07.766900 (+ 19456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.769120 (+  2220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.769383 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.768214 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:07.777047 24170 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:18:07.777940 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1574) took 1900 ms. Trace:
I20260709 12:18:07.778379 24170 rpcz_store.cc:276] 0709 12:18:05.877352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.769413 (+1892061us) service_pool.cc:224] Handling call
0709 12:18:07.776609 (+  7196us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.777609 (+  1000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.777866 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.784925 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:07.786052 24169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1149) took 1517 ms (client timeout 1603 ms). Trace:
I20260709 12:18:07.787571 24248 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:18:07.786526 24169 rpcz_store.cc:269] 0709 12:18:06.268899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.763552 (+1494653us) service_pool.cc:224] Handling call
0709 12:18:07.785972 (+ 22420us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:07.791891 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:07.771308 24806 raft_consensus.cc:2393] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:07.761974 26208 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:07.730063 26355 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:07.771968 26478 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:07.798336 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 265) took 1742 ms. Trace:
I20260709 12:18:07.809705 24172 rpcz_store.cc:276] 0709 12:18:06.055769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.772034 (+1716265us) service_pool.cc:224] Handling call
0709 12:18:07.797825 (+ 25791us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.798024 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.798049 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:07.798092 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:07.798126 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.798176 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.798276 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:07.806381 24168 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:07.811906 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1152) took 1542 ms. Trace:
I20260709 12:18:07.812831 24168 rpcz_store.cc:276] 0709 12:18:06.269651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.631088 (+1361437us) service_pool.cc:224] Handling call
0709 12:18:07.811821 (+180733us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":39552}
I20260709 12:18:07.846282 24173 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
W20260709 12:18:07.862069 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:07.864689 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 129369us
I20260709 12:18:07.889148 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:07.903030 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:07.904376 24098 raft_consensus.cc:2410] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260709 12:18:07.906829 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 171606us
I20260709 12:18:07.799436 26469 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:07.803479 26478 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:07.829843 26479 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:07.797142 26550 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:07.797127 26485 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:07.796440 26271 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:07.920024 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:07.923571 24098 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:07.915575 24169 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:07.925952 24169 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:07.915782 24174 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:07.787607 26453 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:07.928412 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 164298us
I20260709 12:18:07.852869 26200 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:07.927547 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 263) took 1902 ms. Trace:
I20260709 12:18:07.929993 24174 rpcz_store.cc:276] 0709 12:18:06.024741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.770802 (+1746061us) service_pool.cc:224] Handling call
0709 12:18:07.915390 (+144588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.927299 (+ 11909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.927492 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64384}
W20260709 12:18:07.910663 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 180090us
I20260709 12:18:07.937260 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 266) took 1869 ms. Trace:
W20260709 12:18:07.939936 24067 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.946s (SENT)
I20260709 12:18:07.941309 24172 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:07.941421 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:07.926740 24169 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:07.942251 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1611) took 1674 ms. Trace:
I20260709 12:18:07.912423 26542 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:07.942839 24169 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:07.938270 24170 rpcz_store.cc:276] 0709 12:18:06.068236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.779889 (+1711653us) service_pool.cc:224] Handling call
0709 12:18:07.936518 (+156629us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.936783 (+   265us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.936823 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:07.936896 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:07.936948 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.937021 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:07.937173 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192512}
I20260709 12:18:07.943089 24172 rpcz_store.cc:276] 0709 12:18:06.267652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.911033 (+1643381us) service_pool.cc:224] Handling call
0709 12:18:07.936436 (+ 25403us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.941962 (+  5526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.942188 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23168}
I20260709 12:18:07.906457 24808 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:07.948312 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:07.967842 24176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1583) took 1887 ms (client timeout 1756 ms). Trace:
W20260709 12:18:07.968356 24176 rpcz_store.cc:269] 0709 12:18:06.080832 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.967582 (+1886750us) service_pool.cc:211] Skipping call since client already timed out
0709 12:18:07.967737 (+   155us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 12:18:07.959888 24174 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:07.961792 24098 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:07.923318 26550 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.928004 26552 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:07.975726 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:07.922343 26298 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:07.923015 26485 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:07.928272 26521 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:08.011668 26555 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:18:08.011994 24811 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:07.928874 26479 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:08.012871 26478 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:07.928015 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:07.922719 26273 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:08.014564 26553 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 12:18:08.014914 24808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 217) took 3353 ms (client timeout 3069 ms). Trace:
W20260709 12:18:08.079496 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 124596us
W20260709 12:18:08.133594 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 193727us
I20260709 12:18:07.969249 26560 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:08.080715 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 103292us
I20260709 12:18:08.163612 24169 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:18:08.083511 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1148) took 1814 ms. Trace:
I20260709 12:18:08.133765 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:08.132710 26515 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:08.164930 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1147) took 1896 ms. Trace:
W20260709 12:18:08.189185 24067 leader_election.cc:336] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.058s (SENT)
I20260709 12:18:08.210440 24067 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:08.196235 24169 pending_rounds.cc:85] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 7
I20260709 12:18:08.211561 24169 pending_rounds.cc:107] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:18:08.196950 24172 raft_consensus.cc:2376] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6. Re-sending same reply.
I20260709 12:18:08.211984 24169 raft_consensus.cc:2889] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:08.213551 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 267) took 2102 ms. Trace:
W20260709 12:18:08.180555 26555 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:18:08.164705 26486 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:08.032209 26550 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.077976 26485 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:08.227137 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.079399 26354 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:08.029613 26563 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:08.196830 24141 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:08.214129 24169 rpcz_store.cc:276] 0709 12:18:06.111334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.789302 (+1677968us) service_pool.cc:224] Handling call
0709 12:18:07.915390 (+126088us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.213087 (+297697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.213449 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32256}
I20260709 12:18:08.200707 24174 rpcz_store.cc:276] 0709 12:18:06.268283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.930962 (+1662679us) service_pool.cc:224] Handling call
0709 12:18:07.959435 (+ 28473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.969891 (+ 10456us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.164833 (+194942us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:08.197794 24170 rpcz_store.cc:276] 0709 12:18:06.268577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.951033 (+1682456us) service_pool.cc:224] Handling call
0709 12:18:08.056616 (+105583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.083011 (+ 26395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:08.083047 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:08.083111 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:08.083162 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.083240 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.083422 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:08.134068 26549 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:18:08.195745 26560 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:08.276659 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 87558us
I20260709 12:18:08.283032 26560 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:08.285554 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 88940.9us
I20260709 12:18:08.286827 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:08.287307 24067 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.121s (SENT)
I20260709 12:18:08.080266 26552 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:08.301141 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1234) took 3471 ms. Trace:
I20260709 12:18:08.303711 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:08.301612 24250 rpcz_store.cc:276] 0709 12:18:04.830081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.854489 (+ 24408us) service_pool.cc:224] Handling call
0709 12:18:04.857748 (+  3259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:04.934386 (+ 76638us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:06.477330 (+1542944us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b1800390d00. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:06.985813 (+508483us) spinlock_profiling.cc:243] Waited 5.36 ms on lock 0x7b1800390d00. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c08f733c7 00007f4c055859a7 00007f4c055950bf 00007f4c05595038
0709 12:18:07.509318 (+523505us) log.cc:844] Serialized 14 byte log entry
0709 12:18:07.748430 (+239112us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:07.759819 (+ 11389us) log.cc:844] Serialized 26 byte log entry
0709 12:18:07.760002 (+   183us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:07.760036 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:07.760130 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:08.300906 (+540776us) raft_consensus.cc:1685] finished
0709 12:18:08.300928 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.301069 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12665,"prepare.queue_time_us":90600,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":22001,"raft.queue_time_us":35768,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":21933,"spinlock_wait_cycles":26335872,"thread_start_us":618799,"threads_started":2,"wal-append.queue_time_us":312666}
I20260709 12:18:08.308355 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:08.308269 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 126997us
I20260709 12:18:08.309893 24172 raft_consensus.cc:2376] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6. Re-sending same reply.
I20260709 12:18:08.278268 26515 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:08.180526 24808 rpcz_store.cc:269] 0709 12:18:04.654619 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:04.663159 (+  8540us) service_pool.cc:224] Handling call
0709 12:18:06.305771 (+1642612us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:08.008248 (+1702477us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4686720}
I20260709 12:18:08.291631 26465 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:08.319995 24247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 185) took 1599 ms (client timeout 1829 ms). Trace:
W20260709 12:18:08.321753 24247 rpcz_store.cc:269] 0709 12:18:06.720298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.729606 (+  9308us) service_pool.cc:224] Handling call
0709 12:18:08.319812 (+1590206us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b54003598d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:08.319925 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":511227264}
I20260709 12:18:08.300323 26403 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:08.323922 26561 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:18:08.180646 26271 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:08.330883 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49628.1us
I20260709 12:18:08.306787 26565 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:08.362777 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.313058 26542 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:18:08.400384 26573 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:18:08.399192 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 85524.1us
I20260709 12:18:08.456853 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.314481 26568 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:08.331952 26515 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:08.376067 26565 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:08.465790 24170 raft_consensus.cc:2368] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7.
I20260709 12:18:08.325558 26403 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:08.401252 26566 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:18:08.383996 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:08.434808 26465 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:08.333966 26494 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:08.503010 24067 leader_election.cc:336] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.139s (SENT)
I20260709 12:18:08.645285 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:08.505177 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:08.503618 26530 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 1.086s	user 0.010s	sys 0.000s
I20260709 12:18:08.585691 26552 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:08.513382 26565 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:08.586827 26479 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:08.587911 26562 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:18:08.588923 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.605744 24168 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:18:08.605185 26550 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:08.606249 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.655081 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.656023 24174 raft_consensus.cc:2376] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6. Re-sending same reply.
W20260709 12:18:08.611720 26569 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 12:18:08.613325 26580 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:08.506395 24806 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:08.627027 24167 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:08.629313 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:08.631767 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:08.633234 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 128346us
I20260709 12:18:08.704695 24244 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:08.512529 26403 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:08.578671 24172 raft_consensus.cc:2376] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5. Re-sending same reply.
I20260709 12:18:08.637784 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:08.638787 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:08.638441 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:08.640487 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.627955 26559 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:08.651765 24176 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:08.651652 24168 pending_rounds.cc:85] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 2
I20260709 12:18:08.661120 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:08.639304 26539 consensus_queue.cc:1059] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:18:08.705098 24141 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:08.710121 24243 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:08.710443 24241 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:08.712203 24168 pending_rounds.cc:107] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:18:08.712247 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1569) took 2904 ms. Trace:
I20260709 12:18:08.712628 24168 raft_consensus.cc:2889] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:08.712709 24171 rpcz_store.cc:276] 0709 12:18:05.809175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.755415 (+1946240us) service_pool.cc:224] Handling call
0709 12:18:07.755736 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.762480 (+  6744us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.762517 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:07.763091 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 12:18:08.119181 (+356090us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:08.209853 (+ 90672us) log.cc:844] Serialized 14 byte log entry
0709 12:18:08.219431 (+  9578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.219561 (+   130us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:08.710824 (+491263us) raft_consensus.cc:1685] finished
0709 12:18:08.710846 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:08.710974 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17788,"prepare.queue_time_us":80958,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":48,"raft.queue_time_us":165509,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":55812,"spinlock_wait_cycles":5161216,"thread_start_us":254273,"threads_started":1,"wal-append.queue_time_us":411964}
I20260709 12:18:08.705924 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:08.710273 24170 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:08.721951 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.722460 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1589) took 2564 ms. Trace:
I20260709 12:18:08.722797 24168 rpcz_store.cc:276] 0709 12:18:06.158113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.815515 (+1657402us) service_pool.cc:224] Handling call
0709 12:18:08.604819 (+789304us) spinlock_profiling.cc:243] Waited 4.63 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:08.605168 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.722182 (+117014us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.722395 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10638720}
I20260709 12:18:08.724066 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:08.725059 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.725621 24176 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:08.650028 26494 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:08.760865 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:08.760876 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:08.761936 24171 raft_consensus.cc:2368] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
I20260709 12:18:08.762352 24243 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:08.735783 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:08.697284 26479 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:08.740361 24169 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:08.748594 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:08.724563 24250 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:08.768258 24242 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:08.749926 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.763549 24170 raft_consensus.cc:2368] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6.
I20260709 12:18:08.769467 24176 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:18:08.749313 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 291221us
I20260709 12:18:08.766287 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:08.766863 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.771260 24174 raft_consensus.cc:2368] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6.
I20260709 12:18:08.651321 26465 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:08.781530 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.780831 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.782964 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:08.783021 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.788757 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.791152 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.792613 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:08.793623 24169 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:08.758510 26584 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260709 12:18:08.767467 26574 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
I20260709 12:18:08.731343 26568 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:08.778682 26581 consensus_queue.cc:1059] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:18:08.652607 26542 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:08.810555 24241 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:08.811625 26581 raft_consensus.cc:3055] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:08.803337 26584 raft_consensus.cc:3055] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:08.804984 24171 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:08.818081 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:08.822414 24172 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:08.824162 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:08.824815 24174 raft_consensus.cc:2376] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6. Re-sending same reply.
I20260709 12:18:08.824891 24170 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:08.810599 24243 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
W20260709 12:18:08.835224 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 80346.9us
W20260709 12:18:08.838867 24141 connection.cc:256] RPC call timeout handler was delayed by -1.1528480040001341s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15480000000000002s for a response
I20260709 12:18:08.804601 26568 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:08.840721 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:08.721511 26559 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:08.842783 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1711) took 2538 ms. Trace:
I20260709 12:18:08.844043 26568 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:08.814850 26584 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:08.815296 26581 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:08.980425 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 183) took 2288 ms. Trace:
W20260709 12:18:08.863664 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:08.993451 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.981550 24246 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:08.896396 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:08.979347 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:09.020557 24174 raft_consensus.cc:2376] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5. Re-sending same reply.
I20260709 12:18:08.842375 24241 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:08.872901 24172 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:18:08.978178 24216 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.434s	user 0.035s	sys 0.015s
W20260709 12:18:09.022195 24216 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.478s	user 0.042s	sys 0.015s
I20260709 12:18:08.880944 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:09.022189 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:08.950451 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:09.024210 24171 raft_consensus.cc:2368] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6.
I20260709 12:18:09.024309 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:08.913350 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 142925us
W20260709 12:18:09.025398 24067 connection.cc:256] RPC call timeout handler was delayed by -1.417729030999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1787s for a response
W20260709 12:18:09.026793 24067 connection.cc:256] RPC call timeout handler was delayed by -1.3890290840001853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1665s for a response
I20260709 12:18:09.028685 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.029717 24093 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:18:09.030807 24067 connection.cc:256] RPC call timeout handler was delayed by -1.3889303830001154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 12:18:09.035936 24067 connection.cc:256] RPC call timeout handler was delayed by -1.1990290310000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
I20260709 12:18:09.016810 24095 rpcz_store.cc:276] 0709 12:18:06.303957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.306263 (+  2306us) service_pool.cc:224] Handling call
0709 12:18:06.306633 (+   370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:06.644299 (+337666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.842518 (+2198219us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b54002d78d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:08.842705 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":774620544}
I20260709 12:18:09.018549 24249 rpcz_store.cc:276] 0709 12:18:06.691616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.691765 (+   149us) service_pool.cc:224] Handling call
0709 12:18:06.692120 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.519891 (+827771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.980108 (+1460217us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b5400061b54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:08.980344 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1899302656}
I20260709 12:18:08.983533 24781 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:09.040928 24067 connection.cc:256] RPC call timeout handler was delayed by -1.1253494640002373s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3211s for a response
W20260709 12:18:09.042503 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 59074.2us
W20260709 12:18:09.043491 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 441639us
W20260709 12:18:09.043983 24248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1459) took 2870 ms (client timeout 1777 ms). Trace:
W20260709 12:18:09.051080 24067 connection.cc:256] RPC call timeout handler was delayed by -1.0230264670001361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2928s for a response
W20260709 12:18:08.859513 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 62253.1us
W20260709 12:18:08.972656 26560 consensus_meta.cc:287] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.689s	user 0.015s	sys 0.000s
W20260709 12:18:09.050402 24248 rpcz_store.cc:269] 0709 12:18:06.142702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.193973 (+ 51271us) service_pool.cc:224] Handling call
0709 12:18:08.994904 (+2800931us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54002fa154. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:09.012612 (+ 17708us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3546978688}
I20260709 12:18:08.869824 26515 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:09.123648 24067 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.603s (SENT)
W20260709 12:18:09.125227 24067 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.665s (SENT)
I20260709 12:18:09.125782 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:08.883340 26583 log.cc:927] Time spent T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 12:18:08.849625 26485 consensus_meta.cc:287] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.562s	user 0.011s	sys 0.004s
I20260709 12:18:08.916576 26549 raft_consensus.cc:3055] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:18:09.129511 24780 leader_election.cc:336] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.773s (SENT)
W20260709 12:18:09.044546 26526 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.625s	user 0.004s	sys 0.006s
I20260709 12:18:09.138720 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:08.916868 26585 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:18:09.062517 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:08.880942 26547 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 1.119s	user 0.010s	sys 0.006s
W20260709 12:18:09.134723 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 122832us
I20260709 12:18:08.948645 26550 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:08.931680 26465 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:09.128636 26462 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:09.138077 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:09.147334 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 84977us
W20260709 12:18:08.884047 26582 log.cc:927] Time spent T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:08.945928 24810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 222) took 2800 ms. Trace:
W20260709 12:18:09.143254 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 1.63075e+06us
I20260709 12:18:08.860419 26539 consensus_queue.cc:1059] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.280s
I20260709 12:18:09.122321 24811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 225) took 1467 ms. Trace:
I20260709 12:18:08.883046 26494 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:09.123436 26576 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.145655 26432 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:09.148756 24214 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:08.982754 26564 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.161s
I20260709 12:18:09.137019 26593 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.139863 26549 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:09.093894 26565 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:09.163657 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.166039 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:09.150183 26552 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:09.153959 26550 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:09.146427 26547 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:09.139717 26485 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.137427 26579 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:18:09.155622 26462 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:09.130621 26560 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:09.175871 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.184377 24169 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:09.165724 26284 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:09.166469 26559 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:09.193699 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:09.194535 24174 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:09.195268 24812 raft_consensus.cc:2368] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8.
I20260709 12:18:09.196288 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:09.197446 24174 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:09.152386 24811 rpcz_store.cc:276] 0709 12:18:07.602224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.604941 (+  2717us) service_pool.cc:224] Handling call
0709 12:18:07.975808 (+370867us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.162962 (+187154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.990903 (+827941us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b54005d7fd0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:09.069084 (+ 78181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":643980928}
I20260709 12:18:09.202032 26549 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.204066 26549 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:09.205871 26534 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 1.800s	user 0.002s	sys 0.003s
I20260709 12:18:09.209910 26560 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:09.161509 26581 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:09.212759 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.213909 26547 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:09.216593 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.217312 26517 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:09.223304 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:09.224321 24174 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:18:09.151222 24810 rpcz_store.cc:276] 0709 12:18:06.145917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.263575 (+117658us) service_pool.cc:224] Handling call
0709 12:18:07.418456 (+1154881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:07.468057 (+ 49601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.945622 (+1477565us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002ef9d0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:08.945834 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2655051008}
I20260709 12:18:09.233074 26462 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:09.235693 26535 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 1.851s	user 0.005s	sys 0.000s
I20260709 12:18:09.240444 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:09.241600 24172 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:09.245177 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:09.246944 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:09.257427 24173 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:09.249759 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1231) took 4495 ms. Trace:
I20260709 12:18:09.258261 24245 rpcz_store.cc:276] 0709 12:18:04.754398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.302581 (+1548183us) service_pool.cc:224] Handling call
0709 12:18:06.302959 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:06.303526 (+   567us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:06.303569 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:06.304216 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 12:18:06.630663 (+326447us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:18:06.630711 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:06.630787 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:09.234884 (+2604097us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:09.249398 (+ 14514us) raft_consensus.cc:1685] finished
0709 12:18:09.249426 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.249687 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17529,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":58563,"spinlock_wait_cycles":152569088,"thread_start_us":308462,"threads_started":1,"wal-append.queue_time_us":647005}
I20260709 12:18:09.248728 24171 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:09.264127 24171 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:09.265514 24171 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:09.268568 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:09.242719 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:09.269429 24174 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:09.271102 24174 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:18:09.254254 26582 log.cc:927] Time spent T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:18:09.228374 26284 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:09.165690 26593 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.164746 26576 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:09.307369 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.305107 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 154481us
W20260709 12:18:09.311450 24140 connection.cc:256] RPC call timeout handler was delayed by -4.1098030810001092s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 12:18:09.311928 24140 connection.cc:256] RPC call timeout handler was delayed by -4.0846030810000684s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1746s for a response
W20260709 12:18:09.312251 24140 connection.cc:256] RPC call timeout handler was delayed by -4.052203081000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260709 12:18:09.312562 24140 connection.cc:256] RPC call timeout handler was delayed by -4.0324030810002114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1804s for a response
W20260709 12:18:09.312950 24140 connection.cc:256] RPC call timeout handler was delayed by -3.9856030810001357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260709 12:18:09.313875 24216 connection.cc:256] RPC call timeout handler was delayed by -1.6165356870001233s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 12:18:09.314517 24216 connection.cc:256] RPC call timeout handler was delayed by -1.5805356870000651s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1936s for a response
W20260709 12:18:09.316100 24216 connection.cc:256] RPC call timeout handler was delayed by -1.5229356870001993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
I20260709 12:18:09.317966 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1561) took 4583 ms. Trace:
W20260709 12:18:09.313318 24140 connection.cc:256] RPC call timeout handler was delayed by -3.8983030809999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19530000000000003s for a response
I20260709 12:18:09.318528 24175 rpcz_store.cc:276] 0709 12:18:04.740959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.728710 (+2987751us) service_pool.cc:224] Handling call
0709 12:18:07.729095 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.923076 (+193981us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.923108 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:07.923738 (+   630us) log.cc:844] Serialized 26 byte log entry
0709 12:18:08.635736 (+711998us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:08.643773 (+  8037us) log.cc:844] Serialized 14 byte log entry
0709 12:18:08.644024 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.644103 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:08.942793 (+298690us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b1800435fa0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:09.314443 (+371650us) raft_consensus.cc:1685] finished
0709 12:18:09.317680 (+  3237us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.317884 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3304,"prepare.queue_time_us":7831,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":167237,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":12921,"spinlock_wait_cycles":7107968,"thread_start_us":666683,"threads_started":2,"wal-append.queue_time_us":751011}
W20260709 12:18:09.320515 24140 connection.cc:256] RPC call timeout handler was delayed by -3.8326030810001157s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2026s for a response
W20260709 12:18:09.324036 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 194571us
W20260709 12:18:09.319214 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.335464 24216 connection.cc:256] RPC call timeout handler was delayed by -1.4522059690000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1905s for a response
W20260709 12:18:09.333523 24140 connection.cc:256] RPC call timeout handler was delayed by -3.723703081000167s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2147s for a response
W20260709 12:18:09.335984 24216 connection.cc:256] RPC call timeout handler was delayed by -1.4425352950001979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 12:18:09.336252 24140 connection.cc:256] RPC call timeout handler was delayed by -3.6994030810001277s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 12:18:09.336382 24216 connection.cc:256] RPC call timeout handler was delayed by -1.4356356870000582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2097s for a response
W20260709 12:18:09.336643 24140 connection.cc:256] RPC call timeout handler was delayed by -3.5122030810000524s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23820000000000002s for a response
W20260709 12:18:09.337031 24140 connection.cc:256] RPC call timeout handler was delayed by -3.407803081000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24980000000000002s for a response
I20260709 12:18:09.337369 26461 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:09.336714 24216 connection.cc:256] RPC call timeout handler was delayed by -1.4059356870002375s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.213s for a response
I20260709 12:18:09.313601 26580 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.338824 26461 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.314999 26271 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.339552 26580 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.340379 26271 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:09.339063 24216 connection.cc:256] RPC call timeout handler was delayed by -1.3960356870002215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260709 12:18:09.341574 24216 connection.cc:256] RPC call timeout handler was delayed by -1.377135687000191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2162s for a response
I20260709 12:18:09.341777 26461 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:09.325094 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 159366us
I20260709 12:18:09.347991 24807 raft_consensus.cc:1240] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:09.348941 26479 raft_consensus.cc:3055] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:09.349669 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:09.350845 24807 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 5: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:09.351471 26565 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:09.349082 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:09.354805 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:09.355881 26273 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:09.356693 26273 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.359194 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.341985 26580 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:09.342573 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 217380us
W20260709 12:18:09.380105 24067 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.787s (SENT)
W20260709 12:18:09.343171 24216 connection.cc:256] RPC call timeout handler was delayed by -1.3636356870001691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2177s for a response
W20260709 12:18:09.381554 24216 connection.cc:256] RPC call timeout handler was delayed by -1.3216701970000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
W20260709 12:18:09.381927 24216 connection.cc:256] RPC call timeout handler was delayed by -1.3157859800001006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1607s for a response
W20260709 12:18:09.382248 24216 connection.cc:256] RPC call timeout handler was delayed by -1.2886187470001005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2504s for a response
W20260709 12:18:09.382537 24216 connection.cc:256] RPC call timeout handler was delayed by -1.1410352950001652s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2154s for a response
W20260709 12:18:09.382834 24216 connection.cc:256] RPC call timeout handler was delayed by -1.0735352950000561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22290000000000001s for a response
W20260709 12:18:09.383203 24216 connection.cc:256] RPC call timeout handler was delayed by -1.0384187470001507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2782s for a response
I20260709 12:18:09.384817 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.385414 26485 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:09.385492 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.386093 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.386255 26485 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:09.387295 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.347019 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:09.388432 24809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 226) took 1767 ms. Trace:
I20260709 12:18:09.388829 24809 rpcz_store.cc:276] 0709 12:18:07.621216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.635223 (+ 14007us) service_pool.cc:224] Handling call
0709 12:18:09.346780 (+1711557us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:09.388351 (+ 41571us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8463616}
I20260709 12:18:09.366289 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.366518 24811 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:09.387352 24247 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260709 12:18:09.390929 26002 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:09.367522 26598 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:18:09.392078 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.368057 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.393229 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:09.370309 26576 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:09.394191 24092 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:09.372278 26593 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:09.344766 26284 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.394935 24241 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:18:09.395666 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.396735 24092 raft_consensus.cc:2410] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260709 12:18:09.393296 26572 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.767s	user 0.001s	sys 0.002s
I20260709 12:18:09.399000 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.399839 24095 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:09.400180 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1735) took 1667 ms. Trace:
I20260709 12:18:09.401113 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.400576 24099 rpcz_store.cc:276] 0709 12:18:07.733200 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.733417 (+   217us) service_pool.cc:224] Handling call
0709 12:18:07.757728 (+ 24311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.772756 (+ 15028us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.772794 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:07.773984 (+  1190us) log.cc:844] Serialized 26 byte log entry
0709 12:18:08.118386 (+344402us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:08.118453 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:08.118628 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:09.392636 (+1274008us) spinlock_profiling.cc:243] Waited 4.52 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:09.399857 (+  7221us) raft_consensus.cc:1685] finished
0709 12:18:09.399884 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.400105 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97703,"raft.queue_time_us":9260,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":24469,"spinlock_wait_cycles":11516928,"thread_start_us":207020,"threads_started":1,"wal-append.queue_time_us":494075}
I20260709 12:18:09.401819 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.402810 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.386853 26485 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:09.405076 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.406351 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:09.337369 24140 connection.cc:256] RPC call timeout handler was delayed by -2.7337030810001579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3247s for a response
W20260709 12:18:09.407241 24140 connection.cc:256] RPC call timeout handler was delayed by -2.5447030810000797s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3457s for a response
I20260709 12:18:09.407419 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:09.407644 24140 connection.cc:256] RPC call timeout handler was delayed by -2.2549030810000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3779s for a response
I20260709 12:18:09.349395 26479 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:09.377935 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.408218 24095 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:09.407994 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:09.408900 24245 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:09.409349 24067 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.030s (SENT)
I20260709 12:18:09.380864 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:09.409832 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:09.410071 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:09.407990 24140 connection.cc:256] RPC call timeout handler was delayed by -1.7482030810001561s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4342s for a response
W20260709 12:18:09.421478 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 62327.1us
I20260709 12:18:09.418291 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:09.421653 24140 connection.cc:256] RPC call timeout handler was delayed by -1.4881030810001903s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.46310000000000007s for a response
I20260709 12:18:09.423141 24140 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:09.423820 24067 leader_election.cc:336] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.151s (SENT)
I20260709 12:18:09.425449 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:09.431768 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:09.432744 24241 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:09.357622 26273 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:09.436533 24067 connection.cc:256] RPC call timeout handler was delayed by -2.203712104999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2562s for a response
W20260709 12:18:09.442119 24216 connection.cc:256] RPC call timeout handler was delayed by -2.6814185389998784s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20850000000000002s for a response
W20260709 12:18:09.443693 24216 connection.cc:256] RPC call timeout handler was delayed by -2.5383185389998744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
I20260709 12:18:09.443173 24245 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
W20260709 12:18:09.445299 24216 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.571s (SENT)
I20260709 12:18:09.418321 26485 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:09.449399 24216 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.597s (SENT)
I20260709 12:18:09.451669 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.457713 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:09.465384 24095 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.465605 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:09.466038 24216 leader_election.cc:336] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.607s (SENT)
I20260709 12:18:09.467962 24099 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:09.470317 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 276) took 1143 ms. Trace:
I20260709 12:18:09.470767 24167 rpcz_store.cc:276] 0709 12:18:08.326704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.326904 (+   200us) service_pool.cc:224] Handling call
0709 12:18:08.371613 (+ 44709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:08.704332 (+332719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.470042 (+765710us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54002562d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:09.470234 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":571263360}
I20260709 12:18:09.472468 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1468) took 3242 ms. Trace:
I20260709 12:18:09.472916 24246 rpcz_store.cc:276] 0709 12:18:06.230148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:06.669034 (+438886us) service_pool.cc:224] Handling call
0709 12:18:08.981312 (+2312278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:09.038143 (+ 56831us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.472226 (+434083us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b5400061b50. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:09.472393 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5245428992}
I20260709 12:18:09.477103 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:09.429630 26465 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:09.426519 26543 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:09.479236 24097 raft_consensus.cc:1813] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Handling vote request from an unknown peer fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:09.482239 24066 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:09.485342 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:09.486276 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:09.481871 24049 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 2.066s	user 0.012s	sys 0.013s
W20260709 12:18:09.487296 24049 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 2.071s	user 0.013s	sys 0.013s
I20260709 12:18:09.489189 26515 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:09.493196 24099 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:09.496111 24097 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:09.505348 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.507635 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:09.449774 26403 consensus_meta.cc:287] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.719s	user 0.015s	sys 0.000s
I20260709 12:18:09.447270 26602 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:09.511744 24093 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:09.466562 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:09.526947 24095 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:09.433888 26486 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:18:09.507158 26539 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:09.507177 26432 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:09.506114 25999 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:09.510779 26588 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.434552 26002 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
W20260709 12:18:09.534386 24067 connection.cc:256] RPC call timeout handler was delayed by -1.1130039299998771s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1882s for a response
I20260709 12:18:09.511246 26271 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:09.535096 26552 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:09.513403 26602 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:09.452057 26462 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:18:09.541496 24241 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:09.504755 26465 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.543462 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.506930 26608 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:18:09.544206 26539 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:09.564270 24067 leader_election.cc:336] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.562s (SENT)
I20260709 12:18:09.573915 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:09.560456 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 70995us
I20260709 12:18:09.526604 26485 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
W20260709 12:18:09.568174 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48499.8us
I20260709 12:18:09.559352 26476 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:09.515379 26403 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.567073 26602 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.546036 25999 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:09.505766 26479 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:09.577283 24214 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:09.561652 26432 raft_consensus.cc:697] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:09.570674 26465 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.592378 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:09.574162 26608 consensus_queue.cc:1243] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer 5d0f174a97494d0cbf08ae81ec4c807a log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:09.577155 26539 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.596026 24811 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:09.594542 26271 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:09.624560 24170 pending_rounds.cc:85] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 6
I20260709 12:18:09.625039 24170 pending_rounds.cc:107] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:18:09.625329 24170 raft_consensus.cc:2889] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:09.568745 26588 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.612969 24176 raft_consensus.cc:2368] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6.
I20260709 12:18:09.605300 24101 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:09.628693 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.590915 25999 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:09.643296 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 220) took 1724 ms. Trace:
W20260709 12:18:09.647010 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 180975us
I20260709 12:18:09.643790 24100 rpcz_store.cc:276] 0709 12:18:07.919406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.920267 (+   861us) service_pool.cc:224] Handling call
0709 12:18:07.941288 (+ 21021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:07.949771 (+  8483us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:07.949825 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:08.585441 (+635616us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b4800120558. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0a4a4aa1 00007f4c0a49bb37 00007f4c0a49b9ca 00007f4c0a59326f 00007f4c0a592f37 00007f4c0a5a755c 00007f4c0a5a7508 00007f4c0a5a7488 00007f4c0a5a7443 00007f4c0a5a66ec 00007f4c094d0a96
0709 12:18:09.474211 (+888770us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b2c000014c8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2
0709 12:18:09.474903 (+   692us) log.cc:844] Serialized 26 byte log entry
0709 12:18:09.577731 (+102828us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:09.577770 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:09.577855 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:09.643051 (+ 65196us) raft_consensus.cc:1685] finished
0709 12:18:09.643074 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:09.643229 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7968,"raft.queue_time_us":10353,"raft.run_cpu_time_us":3327,"raft.run_wall_time_us":614377,"spinlock_wait_cycles":102651008,"thread_start_us":96834,"threads_started":1,"wal-append.queue_time_us":127404}
W20260709 12:18:09.647894 24216 leader_election.cc:336] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.819s (SENT)
I20260709 12:18:09.651820 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.655974 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:09.658999 24216 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.896s (SENT)
W20260709 12:18:09.641973 26568 consensus_meta.cc:287] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.007s
W20260709 12:18:09.663743 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.668653 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.634063 26271 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:09.637560 26355 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:09.627656 26515 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:09.633459 26559 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:18:09.687387 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.688210 24096 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:09.688935 26581 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.689136 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.689862 24096 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:18:09.691273 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.691430 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.692116 24094 raft_consensus.cc:2410] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:09.692520 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.692883 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.693900 24098 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:09.690721 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.695933 24096 raft_consensus.cc:2410] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:18:09.696657 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.678653 26432 consensus_queue.cc:237] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.734656 24169 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:18:09.738204 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 54551.5us
W20260709 12:18:09.739071 24216 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.000s (SENT)
I20260709 12:18:09.739539 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:09.742913 26608 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:09.743857 26624 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:09.744179 26462 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:09.679347 26568 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.685320 26554 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:18:09.767664 24171 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:09.769407 26584 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:09.770860 26584 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:09.776341 24216 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.091s (SENT)
I20260709 12:18:09.776566 26568 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:09.776791 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:09.777395 24216 leader_election.cc:336] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.097s (SENT)
I20260709 12:18:09.777556 24168 raft_consensus.cc:2376] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5. Re-sending same reply.
I20260709 12:18:09.778155 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1170) took 1187 ms. Trace:
W20260709 12:18:09.778430 24216 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.130s (SENT)
W20260709 12:18:09.779595 26625 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:09.764322 26486 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:09.791255 26271 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.792557 26354 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:09.794507 26564 raft_consensus.cc:3055] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:09.794929 26564 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:09.796626 26273 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.778466 24168 rpcz_store.cc:276] 0709 12:18:08.590909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.749510 (+158601us) service_pool.cc:224] Handling call
0709 12:18:09.776643 (+1027133us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:09.778089 (+  1446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31710208}
I20260709 12:18:09.805244 26564 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:09.808772 25999 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.809289 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1172) took 1169 ms. Trace:
I20260709 12:18:09.809662 24176 rpcz_store.cc:276] 0709 12:18:08.640066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:08.782710 (+142644us) service_pool.cc:224] Handling call
0709 12:18:09.809030 (+1026320us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b54003ea3d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:09.809174 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906592512}
I20260709 12:18:09.814675 26403 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:09.816380 26588 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:09.817562 24215 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:09.818524 26554 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:09.820528 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 466196us
W20260709 12:18:09.822068 24812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 227) took 2157 ms (client timeout 1621 ms). Trace:
W20260709 12:18:09.822499 24812 rpcz_store.cc:269] 0709 12:18:07.664721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:07.664905 (+   184us) service_pool.cc:224] Handling call
0709 12:18:09.821850 (+2156945us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54001a90d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:09.821987 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3458061056}
W20260709 12:18:09.826256 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 403239us
W20260709 12:18:09.827483 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.827944 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.828096 26479 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.830798 26561 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:09.778901 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:09.835788 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 209989us
I20260709 12:18:09.834885 24140 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:09.838814 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.840154 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:09.851689 24066 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Timed out: RequestConsensusVote RPC to 127.22.93.196:44187 timed out after 1.621s (SENT)
I20260709 12:18:09.852298 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:09.830026 26564 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:09.882531 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:09.902105 24247 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:09.902873 24812 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:09.907019 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 79987.8us
I20260709 12:18:09.908067 24140 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:09.878746 24242 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:09.914619 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.927333 24097 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:09.854063 26626 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:09.942248 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.859514 26552 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:18:09.870594 23996 catalog_manager.cc:5697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 3 to 5, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 3 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:09.955178 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:09.955524 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:09.950520 24140 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:09.869375 24806 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:09.953200 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 174787us
I20260709 12:18:09.856688 26629 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:09.967490 24216 leader_election.cc:336] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.141s (SENT)
I20260709 12:18:09.966867 23996 catalog_manager.cc:5697] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 2 to 3, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 3 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.968009 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:09.969681 24216 leader_election.cc:336] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.162s (SENT)
I20260709 12:18:09.970129 26602 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:09.971266 26605 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:09.976187 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:09.976882 26439 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:09.977506 24098 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:09.977931 24098 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:09.978761 24098 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:09.979507 23998 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 190) took 18553 ms (client timeout 15000 ms). Trace:
I20260709 12:18:09.979761 24098 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:09.980949 24100 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:09.957795 26560 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:09.959097 26626 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.982326 26273 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:09.984457 26626 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:09.976925 24096 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:09.873236 26580 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:09.763895 26515 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:09.868384 26565 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:18:09.969938 23996 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 2 to 3, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 3 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:09.911039 25999 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:09.970767 24216 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.177s (SENT)
I20260709 12:18:09.998795 24098 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
I20260709 12:18:10.008653 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:10.035527 24098 pending_rounds.cc:85] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 7
I20260709 12:18:10.004688 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.035903 24098 pending_rounds.cc:107] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 5.8
W20260709 12:18:10.015863 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.017206 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 66816us
I20260709 12:18:09.869568 26403 consensus_queue.cc:1059] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.095s
I20260709 12:18:10.042011 26403 raft_consensus.cc:3055] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:10.042476 26403 raft_consensus.cc:740] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:10.043614 26403 consensus_queue.cc:260] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:10.024614 24097 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:09.868614 26607 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.127s
I20260709 12:18:10.026960 24092 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:10.033573 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 270861us
I20260709 12:18:10.036232 24098 raft_consensus.cc:2889] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:10.039484 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.053699 24066 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:10.051820 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:10.045701 26403 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:10.066318 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:09.979938 23998 rpcz_store.cc:269] 0709 12:17:51.426080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:51.466121 (+ 40041us) service_pool.cc:224] Handling call
0709 12:18:09.979378 (+18513257us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:02.169253 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:02.170152 (+   899us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:02.200750 (+ 30598us) write_op.cc:435] Acquired schema lock
0709 12:18:02.212713 (+ 11963us) tablet.cc:662] Decoding operations
0709 12:18:02.248671 (+ 35958us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:02.248786 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:02.248827 (+    41us) tablet.cc:685] Acquiring locks for 31 operations
0709 12:18:02.368580 (+119753us) tablet.cc:701] Row locks acquired
0709 12:18:02.368638 (+    58us) write_op.cc:260] PREPARE: finished
0709 12:18:02.368820 (+   182us) write_op.cc:270] Start()
0709 12:18:02.368999 (+   179us) write_op.cc:276] Timestamp: P: 1783599482368750 usec, L: 0
0709 12:18:02.369042 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:18:02.370012 (+   970us) log.cc:844] Serialized 12152 byte log entry
0709 12:18:02.973215 (+603203us) op_driver.cc:464] REPLICATION: finished
0709 12:18:03.194961 (+221746us) write_op.cc:301] APPLY: starting
0709 12:18:03.209871 (+ 14910us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:03.301120 (+ 91249us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:03.322365 (+ 21245us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:03.611559 (+289194us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:03.612111 (+   552us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=31
0709 12:18:03.612164 (+    53us) write_op.cc:312] APPLY: finished
0709 12:18:03.612900 (+   736us) log.cc:844] Serialized 205 byte log entry
0709 12:18:03.613117 (+   217us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:03.613449 (+   332us) write_op.cc:454] Released schema lock
0709 12:18:03.613543 (+    94us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:03.614024 (+   481us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:03.614058 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":51902,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":221295,"apply.run_cpu_time_us":11045,"apply.run_wall_time_us":419093,"num_ops":31,"prepare.queue_time_us":134243,"prepare.run_cpu_time_us":19961,"prepare.run_wall_time_us":358827,"raft.queue_time_us":171019,"raft.run_cpu_time_us":15023,"raft.run_wall_time_us":179688,"replication_time_us":603955,"spinlock_wait_cycles":56064,"thread_start_us":460907,"threads_started":4,"wal-append.queue_time_us":223915,"wal-append.run_cpu_time_us":79260,"wal-append.run_wall_time_us":1996315}]]}
I20260709 12:18:10.081791 24167 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:10.057329 26629 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.082717 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:10.085194 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45819.1us
I20260709 12:18:10.083333 24098 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:10.097672 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:10.026423 26631 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:18:10.063109 26552 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:10.101411 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 130671us
I20260709 12:18:10.035717 26539 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:10.101624 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.114101 24140 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.095005 26580 raft_consensus.cc:2764] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:10.096788 26459 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:10.115497 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.115644 24216 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.229s (SENT)
I20260709 12:18:10.125720 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:10.124064 24098 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:10.128089 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.131201 26354 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:18:10.134276 26565 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:10.135237 26565 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.136626 24140 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.137437 26561 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:10.138648 24140 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.140486 26561 raft_consensus.cc:2764] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:18:10.142422 24140 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.146209 24099 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:10.147622 24241 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.103935 26560 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:10.153846 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:10.062588 26626 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:18:10.162166 24241 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:10.101027 26634 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:10.164304 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.169448 24140 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.174031 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.123726 26636 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.119329 26568 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.183075 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.159606 26561 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.143189 26459 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:10.161046 26560 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:10.187098 26439 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.188788 26459 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:10.189874 26635 log.cc:927] Time spent T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:18:10.188242 23996 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 2 to 3, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 3 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:10.196157 26632 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:18:10.206070 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48089.2us
I20260709 12:18:10.169471 26634 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:10.173262 26273 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.208293 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:10.183382 26465 consensus_meta.cc:287] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.564s	user 0.011s	sys 0.002s
I20260709 12:18:10.175561 26607 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:10.217525 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 111339us
W20260709 12:18:10.231880 24216 leader_election.cc:336] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.336s (SENT)
I20260709 12:18:10.226428 23996 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:10.184788 26580 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:10.239650 24140 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.241528 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:10.243940 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 186684us
I20260709 12:18:10.245617 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:18:10.246011 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.245617 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:10.248708 24216 leader_election.cc:336] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.340s (SENT)
I20260709 12:18:10.249396 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:10.220382 26633 log.cc:927] Time spent T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
W20260709 12:18:10.218475 26581 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.006s
I20260709 12:18:10.253963 24140 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:10.228231 26461 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.006s	sys 0.014s
I20260709 12:18:10.217015 26634 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.238839 26568 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.244638 26561 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.252247 26549 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:10.262504 26461 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.015s
I20260709 12:18:10.257761 26439 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:10.187757 26636 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:10.257975 26565 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.267323 26602 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:10.268539 26607 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.237416 26478 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 12:18:10.272927 26552 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:10.252403 26355 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:18:10.246712 26465 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:10.362237 24172 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
W20260709 12:18:10.348297 26632 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:18:10.403563 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 154908us
W20260709 12:18:10.404217 24216 leader_election.cc:336] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.472s (SENT)
W20260709 12:18:10.400776 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 155210us
I20260709 12:18:10.404719 24810 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:10.429896 24780 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.829s (SENT)
I20260709 12:18:10.430403 24097 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:10.279166 26560 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:10.437074 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 192671us
W20260709 12:18:10.437187 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 183224us
I20260709 12:18:10.398691 26581 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:10.440814 24216 connection.cc:256] RPC call timeout handler was delayed by -1.2257642139998097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16180000000000003s for a response
W20260709 12:18:10.441243 24216 connection.cc:256] RPC call timeout handler was delayed by -1.0457642139999734s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 12:18:10.441946 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.390744 26608 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:18:10.450250 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.452011 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.418709 26647 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.454005 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.467195 26634 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:10.470475 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:18:10.473109 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.473914 26607 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.444068 26539 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:10.490319 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:10.456905 26439 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.469928 26634 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:10.519869 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.458352 26647 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:10.515900 26560 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.444779 26581 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:10.516711 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:10.516851 26638 log.cc:927] Time spent T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:18:10.526671 26647 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.456050 26485 consensus_queue.cc:1059] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:18:10.509883 26561 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:10.537277 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 282) took 1225 ms. Trace:
I20260709 12:18:10.539779 26636 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:10.506965 26565 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:10.541088 26643 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:10.543422 24174 rpcz_store.cc:276] 0709 12:18:09.311623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.335132 (+ 23509us) service_pool.cc:224] Handling call
0709 12:18:09.361022 (+ 25890us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.824217 (+463195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.824261 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.824869 (+   608us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.058821 (+233952us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:10.058862 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.058934 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.537005 (+478071us) raft_consensus.cc:1685] finished
0709 12:18:10.537030 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.537198 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":458675,"raft.queue_time_us":459548,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":92,"thread_start_us":233548,"threads_started":1,"wal-append.queue_time_us":418794}
W20260709 12:18:10.539999 26642 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:18:10.547415 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1196) took 1560 ms. Trace:
I20260709 12:18:10.550117 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.562610 24172 rpcz_store.cc:276] 0709 12:18:08.987408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.242357 (+254949us) service_pool.cc:224] Handling call
0709 12:18:10.547158 (+1304801us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b5400256cd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:10.547324 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2328455936}
I20260709 12:18:10.563629 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.520884 26355 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.043s
W20260709 12:18:10.566270 26554 consensus_meta.cc:287] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.747s	user 0.012s	sys 0.000s
I20260709 12:18:10.566787 26554 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:10.565019 26646 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:18:10.565469 26584 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:10.567803 26640 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260709 12:18:10.568405 26584 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:10.569216 26564 consensus_meta.cc:287] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.004s
W20260709 12:18:10.569741 26637 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 12:18:10.571061 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.572151 24140 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:10.505105 26462 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:18:10.506657 26002 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:18:10.576476 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.580402 24175 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:10.580749 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.581394 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.582041 24175 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:10.582316 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.577824 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:10.578533 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:10.586122 24097 raft_consensus.cc:606] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:10.586185 24173 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:10.586417 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:10.543381 26561 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:10.587949 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:10.589540 24169 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:10.590454 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.570264 26584 consensus_queue.cc:1059] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:18:10.582877 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.597388 24097 raft_consensus.cc:614] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:10.599639 26584 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:10.600353 26584 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:10.601365 26584 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:10.602795 26584 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:10.604441 26581 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:10.605371 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.559129 26439 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:10.606700 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:10.594544 26561 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:10.609148 26479 consensus_meta.cc:287] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.781s	user 0.016s	sys 0.000s
I20260709 12:18:10.609517 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:10.628334 24098 pending_rounds.cc:85] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 2
W20260709 12:18:10.599586 26641 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
I20260709 12:18:10.594074 26355 raft_consensus.cc:3055] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:10.594945 26634 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 12:18:10.612228 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:10.614748 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 103878us
I20260709 12:18:10.620414 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:10.620563 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:10.588007 26568 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:18:10.625533 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:10.628671 24098 pending_rounds.cc:107] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:18:10.629248 24173 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:10.648255 24097 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:10.651870 24098 raft_consensus.cc:2889] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:10.652372 24098 pending_rounds.cc:107] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:18:10.652644 24098 raft_consensus.cc:2889] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:10.571460 26652 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:18:10.659601 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.660571 24173 raft_consensus.cc:2393] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:10.612241 26564 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:10.665643 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 285) took 1042 ms. Trace:
I20260709 12:18:10.666736 24172 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:10.673305 24097 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:10.681253 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.672959 24170 rpcz_store.cc:276] 0709 12:18:09.623686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.623882 (+   196us) service_pool.cc:224] Handling call
0709 12:18:09.624306 (+   424us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:09.833593 (+209287us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.833628 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:09.834363 (+   735us) log.cc:844] Serialized 52 byte log entry
0709 12:18:10.116182 (+281819us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:10.116258 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.116361 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.665375 (+549014us) raft_consensus.cc:1685] finished
0709 12:18:10.665404 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.665575 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":206837,"raft.queue_time_us":203673,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6237,"thread_start_us":255448,"threads_started":1,"wal-append.queue_time_us":544964}
I20260709 12:18:10.683014 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.690150 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.691598 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:10.626452 26602 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:18:10.631621 26593 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:18:10.654676 26654 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.632987 26355 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:10.694974 24216 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:10.702102 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 113439us
I20260709 12:18:10.693117 26485 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:18:10.691941 24173 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:18:10.698973 24067 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.646s (SENT)
I20260709 12:18:10.655535 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:10.671439 26608 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:10.681818 26465 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:10.707242 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.692745 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:10.710429 24101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:10.712255 24101 raft_consensus.cc:606] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:10.712750 24101 raft_consensus.cc:614] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:10.712808 24173 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:10.632040 26629 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.069s
I20260709 12:18:10.717582 26653 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
W20260709 12:18:10.722419 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:10.686189 26564 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:10.688774 26554 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:18:10.751482 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 284) took 1268 ms. Trace:
I20260709 12:18:10.752019 24167 rpcz_store.cc:276] 0709 12:18:09.483049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.483229 (+   180us) service_pool.cc:224] Handling call
0709 12:18:09.511272 (+ 28043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.098715 (+587443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.751180 (+652465us) spinlock_profiling.cc:243] Waited 570 ms on lock 0x7b540037ad54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:10.751400 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1310807936}
I20260709 12:18:10.754624 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:10.755442 24806 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:10.710338 26002 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:10.724952 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:10.694028 26539 consensus_queue.cc:1059] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:18:10.725461 26608 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:18:10.736107 26644 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.349s	user 0.004s	sys 0.000s
I20260709 12:18:10.781523 24215 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:10.742338 26659 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:10.693811 26543 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.040s
W20260709 12:18:10.727036 26403 consensus_meta.cc:287] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.647s	user 0.008s	sys 0.007s
W20260709 12:18:10.771536 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46684.5us
I20260709 12:18:10.803944 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:10.804572 24101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:10.784502 24097 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:10.805361 24101 raft_consensus.cc:606] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:10.805747 24101 raft_consensus.cc:614] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:10.736661 26628 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:18:10.797549 24096 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:10.814136 24168 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:10.770753 26002 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:10.816799 26002 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:10.817239 26459 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.002s
I20260709 12:18:10.817721 26459 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:10.818842 24807 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:10.819581 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:10.812038 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:10.792522 26355 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:10.821925 26355 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:10.819630 26549 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:10.823171 26284 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:10.823621 26284 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:10.824023 26284 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:10.827955 24242 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:10.772291 26605 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:10.834146 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:10.815493 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:10.835191 24249 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:10.794610 26476 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:10.797461 24810 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:10.831823 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:10.830380 24245 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:10.862463 24247 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:10.863283 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:10.864807 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:10.866482 24245 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:10.839620 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:10.841264 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:10.840447 24171 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:10.791100 26659 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:10.863507 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:10.838240 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:10.871623 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:10.883553 24242 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:10.888484 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1268) took 1012 ms. Trace:
I20260709 12:18:10.889786 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:10.889021 24243 rpcz_store.cc:276] 0709 12:18:09.876358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.876512 (+   154us) service_pool.cc:224] Handling call
0709 12:18:09.876899 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:09.885516 (+  8617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:09.885551 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:09.911623 (+ 26072us) log.cc:844] Serialized 26 byte log entry
0709 12:18:10.165091 (+253468us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:10.165138 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:10.165211 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:10.735369 (+570158us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:10.865543 (+130174us) raft_consensus.cc:1685] finished
0709 12:18:10.865578 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:10.888369 (+ 22791us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8873,"raft.queue_time_us":22890,"raft.run_cpu_time_us":186,"raft.run_wall_time_us":20788,"spinlock_wait_cycles":8250752,"thread_start_us":198734,"threads_started":1,"wal-append.queue_time_us":337873}
W20260709 12:18:10.935374 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:10.951349 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 166221us
I20260709 12:18:10.807615 26665 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:18:10.863409 26476 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:10.879557 26633 log.cc:927] Time spent T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:18:10.991165 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 225090us
W20260709 12:18:11.004365 24780 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.586s (SENT)
W20260709 12:18:11.005365 24067 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.814s (SENT)
I20260709 12:18:11.005100 24780 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:11.015487 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.006888 26660 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:18:11.037106 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:11.050364 24101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:11.074414 24101 raft_consensus.cc:606] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:11.074854 24101 raft_consensus.cc:614] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:11.003854 26476 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:11.077490 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1273) took 1026 ms. Trace:
I20260709 12:18:11.076261 24242 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:11.077998 24241 rpcz_store.cc:276] 0709 12:18:10.051371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.051519 (+   148us) service_pool.cc:224] Handling call
0709 12:18:11.077273 (+1025754us) spinlock_profiling.cc:243] Waited 45.5 ms on lock 0x7b54000c6554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:11.077416 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":104610176}
W20260709 12:18:11.084528 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47565.4us
I20260709 12:18:11.088739 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:11.065764 26543 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.086650 26564 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:10.975172 26608 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.095243 26654 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:11.143563 26661 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:11.145648 26459 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:11.148032 26666 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:18:11.170518 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 166185us
I20260709 12:18:11.119730 26403 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:11.178974 24243 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:11.174723 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:11.165906 26638 log.cc:927] Time spent T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:18:11.195824 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:11.197736 24067 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.912s (SENT)
I20260709 12:18:11.198416 24067 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:11.201494 24243 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:11.210073 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:11.213393 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:11.214072 24241 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:11.218317 24067 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.994s (SENT)
W20260709 12:18:11.241715 24067 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.126s (SENT)
W20260709 12:18:11.220140 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 218062us
I20260709 12:18:11.243120 24241 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:11.244962 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:11.245728 24093 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:11.180586 26654 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:11.257265 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:11.258196 24092 raft_consensus.cc:606] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:11.181970 26354 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:11.260766 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.254199 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:11.261457 24250 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:11.252928 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:11.277288 26670 log.cc:927] Time spent T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
W20260709 12:18:11.279347 26678 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:18:11.220206 26539 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:11.292335 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:11.104486 26659 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.169816 26002 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.255508 26626 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:11.177417 26543 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:11.292716 26671 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.245s	user 0.000s	sys 0.001s
I20260709 12:18:11.319279 26462 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:11.340401 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.341310 24171 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:11.343081 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.343879 24171 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:11.343959 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.346923 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.347661 24168 raft_consensus.cc:2376] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6. Re-sending same reply.
I20260709 12:18:11.347553 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:11.348516 24248 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:11.350587 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.351820 24168 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:11.354094 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.354787 24168 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:11.357209 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.360283 24168 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:18:11.360615 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 188516us
I20260709 12:18:11.361573 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.273042 26354 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.362376 24176 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.362567 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.364100 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.364444 24250 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:11.368414 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.338356 26462 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.369782 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.320498 26661 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:18:11.337062 26626 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:11.367317 24168 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:11.371317 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:11.370237 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.377074 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.378829 24174 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:11.379702 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.378854 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.382666 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.383896 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.384521 24173 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:11.384917 24171 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:11.386003 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.386252 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:11.386688 24780 leader_election.cc:336] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.834s (SENT)
I20260709 12:18:11.386811 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.387046 24171 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:11.387248 24780 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:11.387555 24173 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:11.387964 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.388326 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.388759 24171 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:11.390034 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.362128 26403 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:11.391665 24171 raft_consensus.cc:2376] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4. Re-sending same reply.
I20260709 12:18:11.393611 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.404687 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.406528 24171 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:11.407186 24170 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:11.405725 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.374821 26462 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:11.417430 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.418437 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.419523 24174 raft_consensus.cc:2368] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6.
I20260709 12:18:11.420843 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.421809 24173 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:11.386499 26657 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:11.426837 24176 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
W20260709 12:18:11.396066 26683 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:18:11.396682 26667 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
W20260709 12:18:11.429414 24780 leader_election.cc:336] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.916s (SENT)
I20260709 12:18:11.390666 26680 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:11.424470 26584 consensus_meta.cc:287] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.814s	user 0.014s	sys 0.000s
I20260709 12:18:11.430680 24780 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:11.369964 26685 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:18:11.432144 26608 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:11.438202 26681 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:11.448061 26684 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:18:11.390936 26654 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.443557 26686 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.433923 26657 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.458206 26686 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:11.460232 26647 consensus_meta.cc:287] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.923s	user 0.003s	sys 0.010s
W20260709 12:18:11.460857 26580 consensus_meta.cc:287] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.205s	user 0.012s	sys 0.002s
I20260709 12:18:11.460765 26647 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.461391 26580 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:11.461521 26686 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:11.442530 26626 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.466514 26647 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:11.473405 26657 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:11.477151 26675 log.cc:927] Time spent T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.184s	user 0.002s	sys 0.000s
I20260709 12:18:11.507167 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:11.510648 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:11.522940 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:11.532959 24067 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.783s (SENT)
I20260709 12:18:11.533789 24067 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:11.541196 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:11.543854 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 214142us
I20260709 12:18:11.544200 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.544552 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.545429 24171 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:11.431116 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.548336 24168 raft_consensus.cc:2410] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:11.548784 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.550573 24170 raft_consensus.cc:2376] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6. Re-sending same reply.
I20260709 12:18:11.546622 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.559754 24176 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:11.563350 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.565222 24172 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:18:11.566592 24169 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:11.569375 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.569300 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:11.572852 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.687510 24170 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:11.582669 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:11.574625 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 561367us
I20260709 12:18:11.585397 24807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 346) took 1065 ms. Trace:
I20260709 12:18:11.600023 24811 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:11.632560 26560 consensus_meta.cc:287] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.103s	user 0.013s	sys 0.007s
I20260709 12:18:11.759729 26700 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:11.761060 26700 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.765942 26700 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:11.766887 26700 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:11.769313 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.618966 26354 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:11.776072 24175 raft_consensus.cc:2410] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:11.776328 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.592195 26002 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:11.777311 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:11.731506 24807 rpcz_store.cc:276] 0709 12:18:10.520052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.522643 (+  2591us) service_pool.cc:224] Handling call
0709 12:18:10.536331 (+ 13688us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:10.819299 (+282968us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.584469 (+765170us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b540067fcd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:11.585042 (+   573us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":649208192}
I20260709 12:18:11.777529 24172 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:11.613807 26539 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:11.623920 26469 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.155s
I20260709 12:18:11.780668 24141 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:11.621173 26543 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:11.612699 26461 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:11.793356 24174 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:11.793570 26462 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.797653 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.799600 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.802042 26657 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:11.802702 26657 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:11.803216 26657 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:11.806077 26476 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.711s	user 0.012s	sys 0.010s
I20260709 12:18:11.449098 26403 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:11.808743 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 286286us
I20260709 12:18:11.474946 26659 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:11.812673 26581 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.813578 26581 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.818105 26636 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.819080 26636 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.822564 26636 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:11.812594 26284 consensus_meta.cc:287] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.988s	user 0.010s	sys 0.009s
I20260709 12:18:11.784119 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:11.826896 24780 leader_election.cc:336] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 2.343s (SENT)
I20260709 12:18:11.827755 24176 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:11.827780 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:11.829083 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.829967 24176 raft_consensus.cc:2376] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7. Re-sending same reply.
I20260709 12:18:11.642923 26602 raft_consensus.cc:3055] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:11.813045 26560 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:18:11.800678 24168 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:11.782219 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.810905 24066 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:11.836871 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.831198 26602 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:11.845278 26461 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:11.830911 26459 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:11.854843 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.860827 24172 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:11.859706 24168 raft_consensus.cc:2376] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4. Re-sending same reply.
I20260709 12:18:11.863345 26543 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:11.866309 26543 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.868717 26560 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:11.869128 26543 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:11.869407 26560 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.871788 26543 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:11.837621 26284 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.872347 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1626) took 1289 ms. Trace:
I20260709 12:18:11.872839 24169 rpcz_store.cc:276] 0709 12:18:10.582708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.606410 (+ 23702us) service_pool.cc:224] Handling call
0709 12:18:11.872077 (+1265667us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54003b1854. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:11.872233 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2155586816}
W20260709 12:18:11.860918 26355 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.981s	user 0.011s	sys 0.009s
I20260709 12:18:11.874261 26284 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:11.875217 24811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 360) took 1080 ms. Trace:
I20260709 12:18:11.875418 24241 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:11.875780 24811 rpcz_store.cc:276] 0709 12:18:10.795229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.797525 (+  2296us) service_pool.cc:224] Handling call
0709 12:18:10.864017 (+ 66492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:11.776333 (+912316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:11.874791 (+ 98458us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b540068b854. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:11.875136 (+   345us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1674008192}
I20260709 12:18:11.879789 26580 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:11.880404 26580 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:11.874256 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.851565 26461 raft_consensus.cc:697] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:11.806813 26476 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.877007 26543 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.887427 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.901363 24169 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
W20260709 12:18:11.903710 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 68632.4us
I20260709 12:18:11.907922 24176 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:11.769379 26700 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.923457 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.931941 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:11.932237 24174 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:11.925998 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:11.939738 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1622) took 1358 ms. Trace:
I20260709 12:18:11.895468 26461 consensus_queue.cc:237] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:11.941526 24175 rpcz_store.cc:276] 0709 12:18:10.581683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.611707 (+ 30024us) service_pool.cc:224] Handling call
0709 12:18:11.923320 (+1311613us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54003f9b54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:11.939660 (+ 16340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577379200}
I20260709 12:18:11.881982 26580 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.965855 24246 raft_consensus.cc:2368] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 8.
I20260709 12:18:11.955416 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:11.974691 24100 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:11.977094 26581 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:11.987757 26561 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.351s	user 0.020s	sys 0.003s
W20260709 12:18:11.986810 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 382610us
I20260709 12:18:11.988400 26561 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.990269 26623 consensus_queue.cc:1059] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:11.991474 26623 raft_consensus.cc:3055] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:11.991834 26623 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:11.993136 26623 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:11.949692 26355 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:12.029424 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 496686us
I20260709 12:18:12.029680 24092 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:18:12.030849 24067 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.353s (SENT)
I20260709 12:18:12.030974 24167 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:12.014194 24780 leader_election.cc:336] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 2.484s (SENT)
I20260709 12:18:11.955868 26560 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:12.044385 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54439.4us
I20260709 12:18:12.052961 24170 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:12.058202 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 189) took 1249 ms. Trace:
I20260709 12:18:12.058779 24246 rpcz_store.cc:276] 0709 12:18:10.808871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.809027 (+   156us) service_pool.cc:224] Handling call
0709 12:18:12.057822 (+1248795us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54003ac354. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:12.058047 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2501829376}
I20260709 12:18:12.059881 24250 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:18:12.062089 24067 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.880s (SENT)
I20260709 12:18:12.065440 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 291) took 1271 ms. Trace:
I20260709 12:18:12.068555 26355 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.070924 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:12.071489 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:12.073434 24241 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:12.076011 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:12.077618 24244 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: [6.3-6.3]
I20260709 12:18:12.078655 26581 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:12.079463 26581 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.066164 24167 rpcz_store.cc:276] 0709 12:18:10.793658 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:10.793915 (+   257us) service_pool.cc:224] Handling call
0709 12:18:10.794233 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:12.035098 (+1240865us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.064872 (+ 29774us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003b1d54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:12.065302 (+   430us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2759940864}
I20260709 12:18:12.039642 26561 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:12.062753 24067 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:12.098629 26459 consensus_queue.cc:1059] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:12.100230 26459 raft_consensus.cc:3055] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:12.100672 26459 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:12.101907 26459 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:12.104419 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:12.105196 26580 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:12.105988 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:12.111860 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:12.129859 24243 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:12.134730 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.135550 24170 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:18:12.138336 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 173201us
I20260709 12:18:12.120909 26462 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:12.130082 26459 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:12.157157 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.149621 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:12.131896 26485 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 12:18:12.176429 26485 consensus_queue.cc:1243] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer 729aa4b1ccec48b588c14e67652c61e1 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:18:12.177701 26581 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:12.179575 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:12.162035 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:12.181690 26403 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.182380 26403 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.174003 26623 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.174002 26700 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:12.153416 26355 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:12.184994 26403 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:12.193136 24241 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:12.168154 26543 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:12.207149 26702 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:12.225693 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 163697us
W20260709 12:18:12.232841 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 277911us
I20260709 12:18:12.207275 26515 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:12.242208 26515 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:12.243592 26515 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:12.263053 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.186329 26602 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.287428 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:12.235910 26581 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:12.256733 26469 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:12.338131 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:12.294636 26702 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
W20260709 12:18:12.388625 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 250193us
I20260709 12:18:12.362602 26581 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:12.393220 26712 log.cc:927] Time spent T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
W20260709 12:18:12.407017 26719 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:18:12.401059 26561 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.355697 26403 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:12.397352 24092 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
W20260709 12:18:12.431064 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 85968.3us
W20260709 12:18:12.433249 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.436156 26355 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.436983 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:12.436880 26355 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.439599 26561 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.409888 26602 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:12.350656 26469 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.421911 26461 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:18:12.466573 24067 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.488s (SENT)
I20260709 12:18:12.482753 24067 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:12.502000 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:12.481490 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:12.467429 26581 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:12.508390 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:12.460528 26403 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:12.540519 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 53255.5us
I20260709 12:18:12.509428 26561 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:12.525321 26355 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:12.569239 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:12.578222 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.620064 24243 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:12.621639 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:12.622749 24807 raft_consensus.cc:2410] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:12.623194 26476 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:12.625803 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:12.627151 26703 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:12.628351 26720 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260709 12:18:12.629591 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 159506us
I20260709 12:18:12.630069 26469 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:12.631134 26659 consensus_meta.cc:287] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.763s	user 0.015s	sys 0.002s
I20260709 12:18:12.631399 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1236) took 1091 ms. Trace:
W20260709 12:18:12.631788 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 187493us
I20260709 12:18:12.651648 24176 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
W20260709 12:18:12.665048 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:12.627144 26652 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:12.677479 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 44215.6us
I20260709 12:18:12.705093 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:12.708851 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:12.696235 26462 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:12.743803 26731 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:18:12.744102 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:12.744454 26462 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:12.745391 26654 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.745131 24810 raft_consensus.cc:2393] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:12.746284 26702 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:12.746058 26654 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.748719 26629 raft_consensus.cc:3055] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:12.749229 26629 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:18:12.752506 26729 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:18:12.746902 26702 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:12.755465 26702 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.756919 26702 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:12.750367 26629 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.762508 26629 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:12.768111 26462 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:12.774621 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:12.775478 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:12.776134 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61425.5us
I20260709 12:18:12.776187 24175 raft_consensus.cc:2376] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:12.775512 24170 raft_consensus.cc:2376] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
W20260709 12:18:12.779634 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:12.799286 24067 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.882s (SENT)
I20260709 12:18:12.805370 24176 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:12.851346 26469 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:12.852114 26469 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.854393 24100 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:12.664115 24173 rpcz_store.cc:276] 0709 12:18:11.540377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.555352 (+ 14975us) service_pool.cc:224] Handling call
0709 12:18:11.556179 (+   827us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:11.557428 (+  1249us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:11.557472 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:11.558482 (+  1010us) log.cc:844] Serialized 26 byte log entry
0709 12:18:11.882519 (+324037us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b4800111e58. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0a4a4aa1 00007f4c0a49bb37 00007f4c0a49b9ca 00007f4c0a59326f 00007f4c0a592f37 00007f4c0a5a755c 00007f4c0a5a7508 00007f4c0a5a7488 00007f4c0a5a7443 00007f4c0a5a66ec 00007f4c094d0a96
0709 12:18:11.935220 (+ 52701us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:12.039872 (+104652us) log.cc:844] Serialized 14 byte log entry
0709 12:18:12.040382 (+   510us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.040574 (+   192us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.630869 (+590295us) raft_consensus.cc:1685] finished
0709 12:18:12.631029 (+   160us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.631170 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":412454,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":6098,"raft.queue_time_us":79875,"raft.run_cpu_time_us":2719,"raft.run_wall_time_us":294558,"spinlock_wait_cycles":392348416,"thread_start_us":451914,"threads_started":2,"wal-append.queue_time_us":1069311}
I20260709 12:18:12.863407 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:12.865892 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:12.866389 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67182.2us
I20260709 12:18:12.866730 24100 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:12.872413 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:12.873330 24170 raft_consensus.cc:2376] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:12.854766 26469 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:12.871387 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:12.783293 26659 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:12.894073 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:18:12.894337 26657 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.090s	user 0.013s	sys 0.007s
I20260709 12:18:12.894421 24173 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:12.894177 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:12.914443 26723 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 12:18:12.914573 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:12.921344 26654 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:12.922080 26654 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:12.923693 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1249) took 1357 ms. Trace:
I20260709 12:18:12.924175 24169 rpcz_store.cc:276] 0709 12:18:11.566075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.976855 (+410780us) service_pool.cc:224] Handling call
0709 12:18:11.977282 (+   427us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:11.993564 (+ 16282us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:18:12.241583 (+248019us) log.cc:844] Serialized 14 byte log entry
0709 12:18:12.516900 (+275317us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.548145 (+ 31245us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.548362 (+   217us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:12.548689 (+   327us) log.cc:844] Serialized 14 byte log entry
0709 12:18:12.555822 (+  7133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.555909 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.923431 (+367522us) raft_consensus.cc:1685] finished
0709 12:18:12.923455 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:12.923619 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22180,"prepare.queue_time_us":399260,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":4633,"raft.queue_time_us":41691,"raft.run_cpu_time_us":269,"raft.run_wall_time_us":9394,"thread_start_us":435736,"threads_started":2,"wal-append.queue_time_us":511040}
I20260709 12:18:12.928465 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:12.929270 24170 raft_consensus.cc:2376] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:12.934353 26552 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:12.935117 26552 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:12.937990 26552 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:12.938915 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:12.939828 24093 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:12.944521 24175 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 6. Ops: []
W20260709 12:18:12.902705 26623 consensus_meta.cc:287] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.719s	user 0.011s	sys 0.005s
I20260709 12:18:12.953612 26565 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:12.959498 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:12.960413 24170 raft_consensus.cc:2376] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7. Re-sending same reply.
I20260709 12:18:12.964821 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:12.969813 24249 raft_consensus.cc:2410] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:12.968184 24173 raft_consensus.cc:2376] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5. Re-sending same reply.
I20260709 12:18:12.955796 26654 raft_consensus.cc:3055] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:18:12.962867 24216 connection.cc:256] RPC call timeout handler was delayed by -1.3092583349998677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1636s for a response
W20260709 12:18:12.986950 24216 connection.cc:256] RPC call timeout handler was delayed by -1.1499583350000648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 12:18:12.987530 24216 connection.cc:256] RPC call timeout handler was delayed by -1.1058583349999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18620000000000003s for a response
W20260709 12:18:12.997936 24067 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.110s (SENT)
W20260709 12:18:13.005129 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 46207.5us
I20260709 12:18:12.951717 26659 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:12.948355 26657 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:12.961599 26565 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:13.065723 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.217061 24097 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 12:18:13.057579 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 211492us
I20260709 12:18:13.161306 24100 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
W20260709 12:18:13.091297 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 84362.9us
I20260709 12:18:12.978837 26654 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:18:13.194708 24780 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.601s (SENT) [suppressed 54 similar messages]
I20260709 12:18:13.088526 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:13.232837 26659 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:13.234164 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.237989 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:13.030977 26459 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.872s	user 0.016s	sys 0.000s
I20260709 12:18:13.008915 24809 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:13.027443 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:13.233493 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:13.005061 26580 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.239984 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 287808us
I20260709 12:18:13.237452 24806 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:13.206259 26355 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.242542 24172 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:13.243618 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:13.238651 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:13.249936 24097 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:13.250137 24093 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:13.255668 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:13.078560 26736 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.245s
I20260709 12:18:13.275214 24100 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:13.098918 26552 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.150s
I20260709 12:18:13.252561 26355 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:13.259177 26673 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.285861 26673 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:13.287226 26355 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:13.287325 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 125683us
I20260709 12:18:13.266098 24096 pending_rounds.cc:85] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 2
I20260709 12:18:13.292061 24812 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
W20260709 12:18:13.262382 26735 log.cc:927] Time spent T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260709 12:18:13.253964 26732 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:18:13.291028 24096 pending_rounds.cc:107] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:18:13.298497 24096 raft_consensus.cc:2889] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:13.302361 24097 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:13.304031 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:13.306779 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.292765 26462 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.310022 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:13.311340 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:13.255105 26580 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:13.315099 24101 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
W20260709 12:18:13.318550 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.297412 26459 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:13.322580 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.322463 26626 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:13.317636 26462 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:13.336951 26657 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:13.314798 26659 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:13.329903 26355 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:13.347313 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47444.6us
I20260709 12:18:13.351316 26659 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:13.352571 26659 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:13.355938 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:13.356698 24097 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:13.326490 26459 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:13.370456 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 145085us
W20260709 12:18:13.375368 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 180715us
I20260709 12:18:13.377172 24243 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:13.377323 24780 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.759s (SENT)
W20260709 12:18:13.379051 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 123100us
I20260709 12:18:13.380712 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:13.346975 26673 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:13.330185 26626 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:13.393218 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:13.380084 26629 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:13.418082 24241 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:13.407646 24243 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:13.406418 26476 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.398391 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:13.343636 26654 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:13.446871 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49501.8us
I20260709 12:18:13.395691 26733 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:18:13.456979 26673 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:13.467768 26673 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.479162 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:13.485146 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:13.486514 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:13.505553 24176 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:13.442867 26657 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.436172 26629 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:13.455484 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:13.514515 24175 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:13.515849 26552 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:13.449235 26560 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
I20260709 12:18:13.449512 26704 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.120s
W20260709 12:18:13.514572 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 77964.1us
W20260709 12:18:13.532296 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 155082us
I20260709 12:18:13.747889 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:13.604835 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:13.608845 26725 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.953s	user 0.007s	sys 0.014s
I20260709 12:18:13.754529 26552 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:13.528149 26476 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:13.538904 26580 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:13.755242 26552 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:13.551174 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:13.757015 26476 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:13.558388 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:13.540932 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 86085.4us
I20260709 12:18:13.551414 26739 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:13.748814 24175 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:13.489356 26654 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:13.610388 24172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 294) took 1715 ms (client timeout 2022 ms). Trace:
I20260709 12:18:13.762796 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:13.763442 24175 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:13.552018 24067 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:13.759809 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1245) took 2195 ms. Trace:
I20260709 12:18:13.752007 24170 raft_consensus.cc:2376] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:13.763540 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:13.745260 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 361471us
I20260709 12:18:13.513911 26673 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:13.516711 26602 consensus_meta.cc:287] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.035s	user 0.015s	sys 0.002s
I20260709 12:18:13.747177 26403 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:13.761718 26760 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:18:13.776013 26469 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.776229 26355 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:13.776729 26469 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:13.779528 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:13.602944 24806 raft_consensus.cc:2410] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:13.764465 24168 rpcz_store.cc:276] 0709 12:18:11.564498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.888299 (+323801us) service_pool.cc:224] Handling call
0709 12:18:11.897771 (+  9472us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:11.998110 (+100339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:11.998161 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:12.079362 (+ 81201us) log.cc:844] Serialized 52 byte log entry
0709 12:18:12.304331 (+224969us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:12.411664 (+107333us) log.cc:844] Serialized 14 byte log entry
0709 12:18:12.432320 (+ 20656us) log.cc:844] Serialized 14 byte log entry
0709 12:18:12.432614 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.432717 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:12.777760 (+345043us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b1800389e60. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:13.607911 (+830151us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:13.754776 (+146865us) raft_consensus.cc:1685] finished
0709 12:18:13.754802 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:13.759737 (+  4935us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19105,"prepare.queue_time_us":89519,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":99,"raft.queue_time_us":62448,"raft.run_cpu_time_us":457,"raft.run_wall_time_us":13832,"spinlock_wait_cycles":41894912,"thread_start_us":281870,"threads_started":2,"wal-append.queue_time_us":450724}
I20260709 12:18:13.782693 26739 raft_consensus.cc:697] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:13.785333 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:13.785467 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:13.786172 24812 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:13.786032 26739 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:13.762822 24172 rpcz_store.cc:269] 0709 12:18:11.895396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:11.915830 (+ 20434us) service_pool.cc:224] Handling call
0709 12:18:13.610088 (+1694258us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400256cd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:13.610301 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3003550464}
I20260709 12:18:13.757531 26552 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:13.552691 26746 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
W20260709 12:18:13.553720 26748 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260709 12:18:13.622328 26713 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.695s	user 0.007s	sys 0.015s
I20260709 12:18:13.765954 24176 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
W20260709 12:18:13.591171 26751 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
W20260709 12:18:13.553957 26747 log.cc:927] Time spent T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:18:13.788058 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.806622 26602 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:13.808650 26561 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:13.809119 26561 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:13.810163 26561 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:13.812356 24171 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:13.812536 24173 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:13.813536 26461 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:13.813709 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 61847.2us
I20260709 12:18:13.814529 26549 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:13.815263 26549 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:13.816648 26759 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:13.817835 26549 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:13.818928 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 348579us
I20260709 12:18:13.820144 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:13.800572 26552 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:13.822523 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 270684us
I20260709 12:18:13.823566 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:13.824347 26461 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:13.794759 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:13.624939 26462 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:13.795238 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:13.558240 26565 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:13.552543 26626 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:13.797501 24175 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:13.592087 26629 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:13.879819 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59795.9us
I20260709 12:18:13.798610 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:13.560460 26459 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:13.881119 24168 raft_consensus.cc:2376] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:13.798167 26736 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:13.891181 26626 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:13.891722 26736 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:13.826040 24215 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:13.551808 26657 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:13.825320 24176 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:18:13.825853 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:13.860409 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.883098 24169 raft_consensus.cc:2376] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
W20260709 12:18:13.799669 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:13.891499 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:13.801322 24214 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:13.894178 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:13.898581 24176 pending_rounds.cc:85] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 3
I20260709 12:18:13.909731 24243 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:13.879175 26403 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:18:13.943377 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 144130us
I20260709 12:18:13.893255 26561 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:13.938657 24176 pending_rounds.cc:107] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:18:13.947901 24176 raft_consensus.cc:2889] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:13.895183 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 69214.3us
I20260709 12:18:13.829867 26581 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:13.837816 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:13.911926 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:13.944459 24214 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:13.945255 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 165908us
I20260709 12:18:13.906795 24242 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:13.950850 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1298) took 1328 ms. Trace:
W20260709 12:18:13.912642 26730 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 1.248s	user 0.009s	sys 0.000s
I20260709 12:18:13.907151 26629 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.953625 24249 rpcz_store.cc:276] 0709 12:18:12.622301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.625486 (+  3185us) service_pool.cc:224] Handling call
0709 12:18:13.945088 (+1319602us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54003d7a54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:13.950769 (+  5681us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":752428800}
I20260709 12:18:13.910379 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:13.915145 26766 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:13.957887 24250 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:13.907503 26736 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:13.948923 26704 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:13.910244 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:13.954636 26759 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:13.948675 24809 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:13.973074 24141 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:13.966008 24140 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:13.978525 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:13.986364 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 104409us
I20260709 12:18:13.986865 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:13.959137 26766 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:13.961174 26355 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:13.962479 26580 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:13.999030 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:13.969854 26704 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.001116 24176 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:18:13.997484 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:14.006122 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:14.006906 24170 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 4.
I20260709 12:18:13.981743 26759 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:13.962077 26629 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.018460 24215 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:13.992928 26766 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:13.989709 26673 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:13.991039 26581 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:18:14.024734 24099 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:14.002755 26704 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:14.032814 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72270us
W20260709 12:18:14.029699 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 63812.4us
I20260709 12:18:13.998039 26736 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:14.033442 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:14.034157 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:14.014902 26759 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.041579 24170 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:14.126192 26767 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:14.116619 26705 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.105s	user 0.006s	sys 0.014s
I20260709 12:18:14.028977 26403 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:14.012290 26355 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:14.042578 26623 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:14.110517 24806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 363) took 1265 ms. Trace:
I20260709 12:18:14.117764 24168 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:14.174620 26702 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:14.116071 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 301) took 2215 ms. Trace:
I20260709 12:18:14.111478 24815 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:14.131778 26711 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 1.208s	user 0.011s	sys 0.013s
I20260709 12:18:14.130163 26761 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:14.244483 26761 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:14.245568 26761 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.045009 26765 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:18:14.044951 26476 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:14.247881 26769 log.cc:927] Time spent T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.300s	user 0.000s	sys 0.001s
I20260709 12:18:14.248353 26476 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.044693 26768 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:18:14.132443 26657 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.043154 24781 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:14.246735 26761 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:14.094645 26709 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.016s	sys 0.027s
I20260709 12:18:14.205051 26623 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.121356 26739 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:14.095644 26751 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260709 12:18:14.094455 24216 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:14.083441 26605 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:14.065565 26736 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.032189 26549 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:14.265949 26549 raft_consensus.cc:697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:14.256085 26733 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:14.267340 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1647) took 1325 ms. Trace:
I20260709 12:18:14.267449 26733 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.267977 26733 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.267823 24167 rpcz_store.cc:276] 0709 12:18:12.941707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.947540 (+  5833us) service_pool.cc:224] Handling call
0709 12:18:12.967992 (+ 20452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:13.163923 (+195931us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.163974 (+    51us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:13.240525 (+ 76551us) log.cc:844] Serialized 52 byte log entry
0709 12:18:13.383875 (+143350us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:13.449604 (+ 65729us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.468298 (+ 18694us) log.cc:844] Serialized 14 byte log entry
0709 12:18:13.592042 (+123744us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b180022e820. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:13.785260 (+193218us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b180022e820. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02408c0a 00007f4c0bb48219 00007f4c02490a40 00007f4c0248b4e4 00007f4c0248b455 00007f4c05573060 00007f4c05585716 00007f4c05596287 00007f4c05596208
0709 12:18:13.785467 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:13.785551 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:14.095291 (+309740us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b2400267e78. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023149c4 00007f4c02312acb 00007f4c024cddc9 00007f4c024cda55 00007f4c024cd09d 00007f4c050ff10e 00007f4c0511688c 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221
0709 12:18:14.267072 (+171781us) raft_consensus.cc:1685] finished
0709 12:18:14.267098 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.267262 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":495168,"prepare.queue_time_us":80403,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":113,"raft.queue_time_us":489928,"raft.run_cpu_time_us":532,"raft.run_wall_time_us":55637,"spinlock_wait_cycles":33152384,"thread_start_us":124600,"threads_started":1,"wal-append.queue_time_us":239648}
I20260709 12:18:14.005558 26580 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.119694 24140 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:14.198848 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 176107us
I20260709 12:18:14.205267 24806 rpcz_store.cc:276] 0709 12:18:12.863843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.880605 (+ 16762us) service_pool.cc:224] Handling call
0709 12:18:14.110193 (+1229588us) spinlock_profiling.cc:243] Waited 327 ms on lock 0x7b54005d7fd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:14.110401 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":751442816}
W20260709 12:18:14.229719 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 222376us
I20260709 12:18:14.272900 24067 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:14.231159 24174 rpcz_store.cc:276] 0709 12:18:11.900594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:12.310059 (+409465us) service_pool.cc:224] Handling call
0709 12:18:12.337856 (+ 27797us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:12.392891 (+ 55035us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:12.392934 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:12.393682 (+   748us) log.cc:844] Serialized 26 byte log entry
0709 12:18:12.429902 (+ 36220us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:12.429967 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:12.430057 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:13.911912 (+1481855us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:14.115661 (+203749us) raft_consensus.cc:1685] finished
0709 12:18:14.115695 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:14.115986 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":395,"raft.queue_time_us":14439,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":125,"spinlock_wait_cycles":58247424,"thread_start_us":35567,"threads_started":1,"wal-append.queue_time_us":123694}
I20260709 12:18:14.195640 26767 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:14.253018 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 209934us
I20260709 12:18:14.274731 24781 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:14.094234 26673 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.036909 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:14.250782 26476 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:14.203398 26403 raft_consensus.cc:697] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:18:14.256013 26709 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.328s	user 0.018s	sys 0.031s
I20260709 12:18:14.260052 26739 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.261765 26485 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:14.262069 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 167734us
I20260709 12:18:14.262733 26605 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.265180 26736 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.271684 26561 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:14.152611 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 119282us
W20260709 12:18:14.278821 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.259266 26623 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:14.396283 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:14.383132 24099 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:18:14.422936 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 90837.6us
I20260709 12:18:14.308151 24215 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:14.421859 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:14.483618 24066 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:14.314723 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.488480 26772 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:14.488935 26772 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:14.489323 26772 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:14.492085 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.492993 26760 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.493655 26760 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.493984 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:14.494618 24099 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:14.496042 26760 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.496601 26760 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:14.497077 26760 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.497956 26772 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:14.483911 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:14.500334 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 380742us
I20260709 12:18:14.275919 26767 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:14.501679 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 228931us
I20260709 12:18:14.508747 24099 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
W20260709 12:18:14.450968 26654 consensus_meta.cc:287] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.661s	user 0.008s	sys 0.004s
I20260709 12:18:14.272890 26580 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.519071 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:14.516845 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.520246 24249 raft_consensus.cc:2410] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:14.486222 26561 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:14.383633 26459 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:14.527458 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:14.527577 26459 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.528196 26568 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.528776 26552 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:14.529458 26552 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:14.529966 26459 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.530786 26561 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.531764 24241 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:18:14.309955 26602 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:14.441416 26774 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:14.296016 26755 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:14.535523 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:14.512418 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 224586us
I20260709 12:18:14.381487 26782 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.456707 26657 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.525885 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:14.539600 24250 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:14.526924 26654 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:14.518128 24095 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:14.486567 26485 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:14.514623 26736 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.552371 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:14.553860 24067 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:14.555666 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:14.559355 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:14.433154 26759 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.455832 26704 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.567178 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:14.572096 24093 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:14.538133 26755 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.551090 26485 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:14.535271 26775 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:14.287811 26355 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.539736 26580 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:14.549201 26766 consensus_meta.cc:287] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.514s	user 0.011s	sys 0.001s
I20260709 12:18:14.577688 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:14.540400 26602 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.307053 26549 consensus_queue.cc:237] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.561358 26771 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:14.567940 26774 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:14.581022 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:14.535562 26767 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:18:14.549656 26654 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.549480 26657 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.618933 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:14.620532 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:14.578639 26755 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:14.627422 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 319406us
I20260709 12:18:14.528784 26568 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.560174 26736 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.559433 26782 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.649463 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:14.650421 24241 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:14.652771 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:14.641443 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 134642us
W20260709 12:18:14.642925 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 87370.4us
W20260709 12:18:14.665108 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.667402 24167 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
W20260709 12:18:14.668496 24780 leader_election.cc:336] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 2.406s (SENT)
I20260709 12:18:14.669183 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:14.671644 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:14.674183 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 105042us
I20260709 12:18:14.625578 26605 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:14.676810 24174 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:18:14.680624 24098 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:14.682703 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 45737.2us
I20260709 12:18:14.683853 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:14.647615 26772 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.615401 26580 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.685942 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:14.712180 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:14.712474 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:14.713127 24168 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:14.714254 24067 leader_election.cc:400] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6.
I20260709 12:18:14.714708 24067 leader_election.cc:403] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:18:14.716886 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:14.619465 26766 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.724591 24092 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:18:14.724634 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 103900us
I20260709 12:18:14.681720 26469 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:14.730042 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 158458us
I20260709 12:18:14.651968 26403 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.708232 26802 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:14.623113 26775 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.744940 26659 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:14.745561 26659 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.680763 26794 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.178s
I20260709 12:18:14.748883 26794 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:14.684442 26789 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:14.683727 26581 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:14.733441 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:14.809384 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 76133.9us
W20260709 12:18:14.738380 26791 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:18:14.737897 26802 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.719228 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:14.740407 26657 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:14.735342 26739 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.741392 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:14.742039 26786 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:18:14.673951 26733 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:14.834226 26807 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:14.834933 26807 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:14.836195 26733 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.820309 26804 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:14.821714 24808 raft_consensus.cc:2368] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:18:14.837555 26804 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:14.838032 26804 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.840404 26782 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:14.841678 26807 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.818388 26629 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:14.845438 26766 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:14.850759 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 115178us
I20260709 12:18:14.822012 26806 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:14.825090 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:14.827934 24092 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:14.833500 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:14.939831 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 266234us
I20260709 12:18:14.759531 26789 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:14.983382 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:14.996919 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:14.997483 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:14.998088 24176 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:14.746892 26623 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.002315 24215 leader_election.cc:400] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:18:15.002727 24215 leader_election.cc:403] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:15.004297 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:15.005139 24810 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:14.987927 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 323885us
I20260709 12:18:14.939591 24094 raft_consensus.cc:2376] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8. Re-sending same reply.
W20260709 12:18:14.989035 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 260612us
I20260709 12:18:14.824576 26704 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:15.011693 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:15.009526 26623 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:14.996881 26789 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.114905 26485 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.116194 24242 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:14.817291 26581 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.120949 26581 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.009735 26657 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:15.078931 26783 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.301s	user 0.001s	sys 0.001s
I20260709 12:18:15.079965 26659 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.025111 26776 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:15.078810 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:15.087745 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:15.090420 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1654) took 1853 ms. Trace:
I20260709 12:18:15.042557 26759 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.091153 26764 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6.
W20260709 12:18:15.095309 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 79802.4us
I20260709 12:18:15.096040 26736 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.099524 26654 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.102605 26818 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.104142 26802 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.105223 26804 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.033810 26766 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.105863 26580 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.033608 26801 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:15.105226 26775 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.071425 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:15.078796 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.124703 24176 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
W20260709 12:18:15.128670 24093 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.000s
I20260709 12:18:15.126503 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.132848 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.136799 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:15.133811 24172 rpcz_store.cc:276] 0709 12:18:13.236969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.795877 (+558908us) service_pool.cc:224] Handling call
0709 12:18:13.802090 (+  6213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.837489 (+ 35399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.837527 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.860525 (+ 22998us) log.cc:844] Serialized 26 byte log entry
0709 12:18:14.027207 (+166682us) spinlock_profiling.cc:243] Waited 8.25 ms on lock 0x7b1800374080. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:18:14.441588 (+414381us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:14.578970 (+137382us) log.cc:844] Serialized 14 byte log entry
0709 12:18:14.618077 (+ 39107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.618193 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.090087 (+471894us) raft_consensus.cc:1685] finished
0709 12:18:15.090189 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.090349 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28746,"prepare.queue_time_us":273666,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2483,"raft.queue_time_us":123146,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":15398,"spinlock_wait_cycles":18980608,"thread_start_us":589724,"threads_started":3,"wal-append.queue_time_us":662647}
I20260709 12:18:15.139386 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:15.172923 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:15.181073 24093 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:15.180815 24092 raft_consensus.cc:2368] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:18:15.187777 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:15.173343 26561 consensus_meta.cc:287] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.642s	user 0.013s	sys 0.000s
W20260709 12:18:15.201789 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 73479.8us
I20260709 12:18:15.170284 26702 raft_consensus.cc:2764] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:18:15.205662 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:15.196781 26771 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 12:18:15.192665 26775 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:15.210384 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.133103 26657 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.210732 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.213466 24093 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:15.213660 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.200836 26549 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:15.213956 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1314) took 1265 ms. Trace:
W20260709 12:18:15.231737 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64730.5us
I20260709 12:18:15.240660 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:15.241858 24810 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:15.242153 24216 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:15.217617 24246 rpcz_store.cc:276] 0709 12:18:13.943497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.943710 (+   213us) service_pool.cc:224] Handling call
0709 12:18:13.955054 (+ 11344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:13.956729 (+  1675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:13.956759 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:13.993027 (+ 36268us) log.cc:844] Serialized 26 byte log entry
0709 12:18:14.276880 (+283853us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:14.276941 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:14.277045 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:15.208988 (+931943us) raft_consensus.cc:1685] finished
0709 12:18:15.209026 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.209234 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3985,"raft.queue_time_us":4366,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":20339,"thread_start_us":274284,"threads_started":1,"wal-append.queue_time_us":563111}
I20260709 12:18:15.206527 26561 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.216476 26771 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.244048 26804 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.244109 26810 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.244788 24099 raft_consensus.cc:2410] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:18:15.244915 26561 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.242218 26775 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:15.245831 26775 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:15.246227 26775 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.246546 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.247921 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.249109 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.217190 26799 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.251375 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.252178 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:15.256197 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 223087us
I20260709 12:18:15.257277 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:15.257562 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:15.263722 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.137070 26776 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.267414 24101 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:15.267452 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:15.268962 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.264741 24215 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:15.249841 26755 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.598s	user 0.001s	sys 0.008s
I20260709 12:18:15.277787 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:15.278932 26777 log.cc:927] Time spent T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:18:15.279754 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:15.276495 26552 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:15.281716 26552 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.282210 26810 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.276835 26755 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.283648 26485 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:15.272610 26804 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.218613 26549 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:15.285158 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:15.288616 24067 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.288779 26799 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:15.296140 26799 raft_consensus.cc:697] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:15.297529 26799 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.175581 26818 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.302276 26818 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.289378 26804 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:15.289873 26485 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:18:15.305356 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:15.306082 24100 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.306681 26485 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.307322 26485 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.285283 26755 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:15.285310 26549 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.249939 26789 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.311359 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:15.320935 26789 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:15.310946 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:15.314515 24140 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:15.315325 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.317943 26804 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:15.321873 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:15.290555 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:15.337538 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47078.7us
I20260709 12:18:15.322350 26766 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:18:15.327783 24092 raft_consensus.cc:2410] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260709 12:18:15.328244 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.330827 24100 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
W20260709 12:18:15.333063 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44538.2us
I20260709 12:18:15.333343 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.314102 26485 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:15.345094 24100 raft_consensus.cc:1240] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:15.314473 26801 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:15.349684 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:15.352452 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.353401 26759 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:15.353964 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.336203 26818 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:15.355196 26818 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.355192 26768 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:15.355480 26759 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.343973 26403 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.336586 26775 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.356458 26403 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.343276 26561 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.355885 24811 raft_consensus.cc:2368] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:15.359907 26561 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.360414 26775 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:15.361606 24215 leader_election.cc:400] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:15.361943 24215 leader_election.cc:403] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:18:15.362246 26561 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.362882 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:15.335250 26804 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.355857 26768 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.355669 26818 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:15.364346 24780 leader_election.cc:336] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.601s (SENT)
I20260709 12:18:15.371214 24780 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.341735 26789 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.376580 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:15.378083 24101 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.358889 26403 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:15.390021 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45500.1us
I20260709 12:18:15.369287 26804 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.371279 26768 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.375449 26810 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:15.381796 26755 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.401597 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:15.405452 24216 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:15.406066 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.406759 24216 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:15.408325 26478 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.399731 26810 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:15.419260 26810 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:15.421482 26776 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.414733 26771 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:18:15.423214 26469 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:15.423720 26469 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:15.425105 26568 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.424885 26469 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.426426 26469 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.430028 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.412328 24067 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.404533 26759 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:15.433804 26759 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.434223 26759 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.412817 26552 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:15.445614 24101 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:15.446514 24096 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:18:15.447944 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.414733 26766 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:15.481606 24779 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:15.481767 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:15.482733 24241 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:15.485716 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 73459.8us
I20260709 12:18:15.454530 26702 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:15.487082 24779 leader_election.cc:336] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.710s (SENT)
I20260709 12:18:15.486104 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:15.480834 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:15.492295 24780 leader_election.cc:336] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.710s (SENT)
I20260709 12:18:15.492800 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.491148 24250 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.490873 24100 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:15.464305 26797 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:15.464393 26760 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:15.521615 24241 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:15.513855 26659 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:15.532084 24101 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:15.413456 26801 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.490303 26702 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.466075 26549 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.496706 26766 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:15.544989 26766 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.489707 26788 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.047s
I20260709 12:18:15.514686 26797 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:15.548843 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 62394.6us
I20260709 12:18:15.489617 26828 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:15.535780 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47379.3us
I20260709 12:18:15.487308 26355 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 12:18:15.508311 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:15.543859 26549 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:15.554631 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.539372 26702 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.557072 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:15.562515 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:15.563437 26775 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:15.564030 26775 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:15.564882 26775 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.556371 26568 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:15.559459 26776 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.558303 26828 raft_consensus.cc:697] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:15.571692 26764 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:15.561019 26804 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.561800 26403 consensus_queue.cc:1059] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:18:15.578120 26568 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:15.599852 26830 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:18:15.605047 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55455.7us
I20260709 12:18:15.575829 26818 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.583393 26776 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.610155 26568 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:15.620597 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:15.610344 26549 raft_consensus.cc:3055] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:15.612305 24806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 358) took 1324 ms. Trace:
I20260709 12:18:15.643327 26828 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.643286 24806 rpcz_store.cc:276] 0709 12:18:14.287526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.335762 (+ 48236us) service_pool.cc:224] Handling call
0709 12:18:14.441564 (+105802us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.537858 (+ 96294us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:14.540212 (+  2354us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:14.550524 (+ 10312us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:14.555975 (+  5451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.612006 (+1056031us) spinlock_profiling.cc:243] Waited 91.1 ms on lock 0x7b54001a9d54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:15.612060 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:15.612230 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":209417472}
I20260709 12:18:15.588069 26764 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.630606 26775 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:15.645910 26764 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:15.646096 26775 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.648572 26775 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.621697 24067 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.630745 26580 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:15.631659 26403 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:15.631772 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50070.4us
I20260709 12:18:15.632416 26568 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:15.636336 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.638689 26478 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:15.638556 26811 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:15.642760 26818 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.642300 26803 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:18:15.658130 26776 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.680285 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.681147 24249 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:15.681071 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:15.682464 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67349.8us
I20260709 12:18:15.642266 26768 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.640542 26549 raft_consensus.cc:740] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:15.640242 26797 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:15.674172 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:15.687355 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:15.685031 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.688367 24242 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:15.665510 26469 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:15.692989 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.693358 26469 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.693647 24248 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:15.693806 26469 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.667618 26568 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:15.695261 24094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50598 (request call id 252) took 1705 ms (client timeout 1710 ms). Trace:
W20260709 12:18:15.695796 24094 rpcz_store.cc:269] 0709 12:18:13.984482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:13.984674 (+   192us) service_pool.cc:224] Handling call
0709 12:18:15.689814 (+1705140us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b54002d64d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:15.689970 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1489253120}
I20260709 12:18:15.697063 26568 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.699765 26549 consensus_queue.cc:260] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.691164 26784 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:15.729387 26784 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:15.730448 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.730324 26784 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.731585 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.732729 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.733561 24246 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:15.733167 26759 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.734766 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:15.735368 24092 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:15.736011 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:15.737810 26825 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:15.738330 26825 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:15.739502 26825 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.741184 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:15.701125 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.743067 24248 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:15.704741 26657 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.706852 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.666208 26355 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:18:15.707345 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:15.707612 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.751485 24101 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:15.708243 26602 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:15.708369 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:15.754215 24100 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:15.707621 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.754427 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:15.709151 26768 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.710632 24781 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:15.712410 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1821) took 1704 ms. Trace:
W20260709 12:18:15.755718 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45163.4us
I20260709 12:18:15.713848 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.665894 26403 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.751408 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.662501 26580 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.723850 26806 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.769798 24100 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:15.769556 26806 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.727602 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.728336 26810 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.692157 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.742565 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.705766 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.631673 26702 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:15.759135 24250 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:15.751912 26568 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:18:15.741189 26825 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.755543 24098 rpcz_store.cc:276] 0709 12:18:14.008290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.018203 (+  9913us) service_pool.cc:224] Handling call
0709 12:18:14.024293 (+  6090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:14.681075 (+656782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:15.712038 (+1030963us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54001f45d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:15.712300 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1289943808}
I20260709 12:18:15.720485 26804 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.757105 24094 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
W20260709 12:18:15.767966 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 60472us
I20260709 12:18:15.767833 23997 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 5, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 5 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:15.771975 24244 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:15.775935 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.786695 24242 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:15.786767 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.771296 26803 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:15.805972 24140 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:15.810528 24093 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:15.815359 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:15.816905 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:15.827735 26561 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:15.828132 26561 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:15.828507 26561 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.828507 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:18:15.829388 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.826699 26657 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:15.835306 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.831710 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.841092 24098 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:15.842003 24248 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:15.811184 26602 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:15.852208 24247 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:15.823789 26775 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:15.858431 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:15.870920 24169 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:15.865962 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:15.873652 24780 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.877902 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:15.879045 24174 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:15.881093 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.882339 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:15.884199 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:15.887642 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.832955 26803 raft_consensus.cc:697] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:15.891819 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.892885 24248 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:15.893867 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:15.894636 24171 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:15.895685 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:15.896570 24167 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:15.894610 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.901402 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:15.810120 26764 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:15.890601 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 199146us
I20260709 12:18:15.890592 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:15.909643 24168 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 8 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:18:15.889261 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 82092.3us
I20260709 12:18:15.910394 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.910616 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:15.902191 24173 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:15.912426 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.914232 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.917438 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:15.918184 24168 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.887457 26800 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:15.888974 26673 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:15.919934 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.886229 26806 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:15.921638 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 67102.3us
W20260709 12:18:15.924681 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:15.925277 24066 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:15.931465 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:15.931592 26847 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:15.931663 24244 raft_consensus.cc:1217] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Deduplicated request from leader. Original: 3.2->[6.3-6.3]   Dedup: 6.3->[]
I20260709 12:18:15.932332 24244 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: [6.3-6.3]
W20260709 12:18:15.932938 26841 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:18:15.933709 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.933969 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:15.935122 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.898550 26811 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:15.940205 26580 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:15.941339 26403 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.942932 26810 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:15.943930 26840 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:18:15.944629 24095 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:15.944988 26764 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.947575 26803 consensus_queue.cc:237] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:15.954028 24815 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:15.902961 26813 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:15.954133 26602 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.954752 26602 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.914105 26775 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:15.955359 26759 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.955431 26775 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:15.956027 26775 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:15.957182 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:15.957930 24176 raft_consensus.cc:2368] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:15.958860 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:15.959509 24176 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:15.959795 26702 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:15.960443 26702 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:15.960919 26702 raft_consensus.cc:697] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:15.932803 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.963168 24247 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:15.964381 24241 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:15.965713 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.966472 24243 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:15.985662 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.986557 24099 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:15.988026 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:15.880155 26733 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:18:15.989956 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:15.990207 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:16.016161 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.016809 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.016887 24098 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:15.998541 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:15.961213 26549 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:15.999526 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:15.999130 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:15.964468 26673 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:16.025276 24096 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:16.068815 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 158300us
I20260709 12:18:15.954154 26469 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.070267 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:16.073179 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:15.999073 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:15.989656 26767 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:18:16.082659 26469 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.084245 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.089553 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.085043 24246 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:15.997637 26764 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:16.016005 26759 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.122079 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:16.124783 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 54965.1us
I20260709 12:18:16.127712 24096 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:16.131611 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.017220 26580 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:16.135031 24101 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:16.140216 24094 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:15.961836 26702 consensus_queue.cc:237] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.105189 23997 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:16.084247 26673 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:16.144608 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 145589us
I20260709 12:18:16.145722 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:16.138633 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:16.110486 26806 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:16.160038 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.164641 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:16.161083 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.114216 26764 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:16.167246 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:16.165007 24243 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:16.179941 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.168252 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:16.187741 26848 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:18:16.174829 26818 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:16.189961 24094 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:16.136658 26759 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:16.157496 26568 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:16.211349 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.205606 24173 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:16.162670 26657 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:16.214222 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.178330 26764 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.174852 26804 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:16.190237 26629 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:16.234277 24100 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:16.236366 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.150056 26580 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:16.247450 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48076.7us
I20260709 12:18:16.189605 26818 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:16.216110 26568 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:16.215960 26657 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:16.175109 26806 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.164979 26850 consensus_queue.cc:1059] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 12:18:16.261516 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:16.239933 26849 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:18:16.234673 26629 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:16.279172 24100 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:16.283999 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.285486 24250 raft_consensus.cc:2410] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:16.260125 26568 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.258600 26657 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:16.240859 26804 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:16.282472 26629 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:16.359323 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.362944 24094 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:16.364540 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:16.291849 26852 raft_consensus.cc:3055] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:16.370859 24250 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:16.383061 24168 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:16.394002 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.435742 24173 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:16.438685 24141 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.854s (SENT)
I20260709 12:18:16.374080 26852 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:16.439396 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:16.375355 26850 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:18:16.462188 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.382659 26853 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:16.473203 24172 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:16.380028 26768 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:18:16.469923 26810 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:16.497723 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:16.494547 26810 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:16.499332 26860 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
I20260709 12:18:16.501556 26810 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:16.492559 26851 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:16.505736 26825 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.719s	user 0.004s	sys 0.009s
I20260709 12:18:16.533006 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:16.545217 24094 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:16.567559 26759 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:16.574110 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.555363 26850 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:16.484500 26853 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:16.578944 24140 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:16.581569 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:16.553406 26818 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:16.597097 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.610844 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.614094 24243 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:16.594496 26580 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.587613 26850 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:16.619050 26561 consensus_meta.cc:287] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.790s	user 0.013s	sys 0.003s
W20260709 12:18:16.623565 26862 log.cc:927] Time spent T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:18:16.624872 26549 consensus_meta.cc:287] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.004s
I20260709 12:18:16.527624 26852 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:16.550239 26851 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.635797 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.629778 26850 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:16.644364 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 205729us
I20260709 12:18:16.645793 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.630723 26768 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:16.628845 26771 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:16.631733 26602 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.000s
W20260709 12:18:16.660231 24141 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.690s (SENT)
I20260709 12:18:16.667268 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:16.630434 26804 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:16.669543 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.674782 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:16.661206 26850 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:16.684477 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:16.638365 26561 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.677397 26852 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.687472 26853 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:16.717598 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:16.723112 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 141659us
I20260709 12:18:16.724483 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:16.719516 26803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.023s	sys 0.025s
W20260709 12:18:16.725265 26803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.023s	sys 0.025s
I20260709 12:18:16.671104 26602 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.684458 26871 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:16.672421 26771 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:16.728488 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:16.691838 26873 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:16.733661 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.734331 24243 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:16.737309 24098 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:16.740207 26851 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.730731 26768 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:16.743443 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.743566 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.744221 24174 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:16.731855 26702 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:16.730199 26784 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:16.745474 24175 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:16.748098 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.748745 24174 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:16.749598 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.750378 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.750648 24174 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:16.751971 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.752431 24175 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:16.754129 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.754638 24176 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:16.759536 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.763963 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.764696 24171 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:16.765632 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.766211 26629 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:16.766702 26858 log.cc:927] Time spent T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.409s	user 0.003s	sys 0.000s
I20260709 12:18:16.766213 24171 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.769537 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.769805 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.772765 26771 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:16.735327 26873 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.775487 24175 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:16.775627 26873 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.776595 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.750392 26784 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.777725 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.778445 24175 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:16.779551 26784 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.779240 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.780933 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.733538 26764 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.781978 24175 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:16.782323 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.746312 26768 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:16.784503 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.782760 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.787643 24099 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:16.789834 24172 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 5: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:16.736683 26568 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.792213 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:16.770300 26673 consensus_meta.cc:287] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.590s	user 0.014s	sys 0.000s
I20260709 12:18:16.796255 24099 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:16.801218 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.801894 24175 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:16.808705 26629 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:16.785645 26775 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.829s	user 0.012s	sys 0.003s
I20260709 12:18:16.811988 24214 leader_election.cc:400] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:18:16.813382 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.795114 26768 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.819028 24174 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:18:16.819694 26657 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.511s	user 0.014s	sys 0.001s
I20260709 12:18:16.822881 24811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 241) took 1359 ms. Trace:
I20260709 12:18:16.823464 24811 rpcz_store.cc:276] 0709 12:18:15.463685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.464146 (+   461us) service_pool.cc:224] Handling call
0709 12:18:16.822637 (+1358491us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54006eebd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:16.822796 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972515200}
I20260709 12:18:16.825193 26657 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.828209 26764 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.817727 26775 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.835918 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.859752 24243 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 3.
I20260709 12:18:16.860508 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:16.857585 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:16.839579 24168 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:16.865160 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.843827 26673 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:16.883867 26673 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.872563 26561 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.894820 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.895802 26568 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.896263 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.896962 24241 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:16.897858 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.898957 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.899710 24241 raft_consensus.cc:2393] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:16.899575 26850 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.900609 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.901757 26775 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.902287 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:16.903429 24808 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:16.871536 26782 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:18:16.905040 26826 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:16.905613 26782 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:16.906008 26782 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:16.906667 26657 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.902474 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:16.922920 24174 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:16.924118 24093 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:18:16.914268 24095 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:18:16.912245 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.926934 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.931074 24171 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:16.932907 24168 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:16.928311 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1672) took 1071 ms. Trace:
I20260709 12:18:16.937062 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:16.933960 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:16.942050 24175 raft_consensus.cc:2368] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:16.955662 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:16.973183 24168 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:16.973565 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:16.974064 24174 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:16.977173 24175 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:16.910771 26850 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:16.979066 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:16.981436 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:16.977811 26766 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:17.002528 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 133508us
I20260709 12:18:16.906962 26782 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:16.992997 26850 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.005280 26355 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:16.995688 26766 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:17.008188 26782 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.013870 24172 raft_consensus.cc:2368] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
I20260709 12:18:17.016737 26355 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:17.031517 26355 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.033659 26768 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.018674 24095 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:17.047961 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:17.048066 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:17.050443 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:17.016601 26766 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.024501 26478 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.055143 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.062028 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:17.075001 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:17.076188 24175 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:17.073289 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:17.084867 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:17.086464 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.087277 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:17.087836 26806 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:17.090343 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:17.085783 24249 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:17.093385 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.094691 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.097569 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.101991 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.028308 26888 consensus_queue.cc:1059] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:18:17.116698 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:17.116041 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 89114.5us
I20260709 12:18:17.118096 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:17.120247 24095 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.017596 26850 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.122022 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:17.124871 24242 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:17.128677 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:17.128907 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.130693 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.131872 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:17.082069 26876 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.059892 26811 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
W20260709 12:18:17.142366 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47727.4us
I20260709 12:18:17.155006 24067 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.144881 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:17.156164 24101 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.145916 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:17.158386 24094 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.088600 26813 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:18:17.117086 26629 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:17.162904 24249 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:17.172569 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:17.127319 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:17.174552 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:17.174443 24141 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.513s (SENT)
I20260709 12:18:17.187528 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.140240 26878 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:17.190013 24101 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:17.191684 24242 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:17.190413 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:17.163005 26629 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:17.191563 26469 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:17.206177 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 69582.2us
W20260709 12:18:17.206893 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 154958us
I20260709 12:18:17.207772 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:16.934796 24170 rpcz_store.cc:276] 0709 12:18:15.856690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.856822 (+   132us) service_pool.cc:224] Handling call
0709 12:18:15.857251 (+   429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:15.918636 (+ 61385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.918670 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:15.919426 (+   756us) log.cc:844] Serialized 52 byte log entry
0709 12:18:16.078044 (+158618us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:16.830483 (+752439us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b1800251e60. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c08f733c7 00007f4c055859a7 00007f4c055950bf 00007f4c05595038
0709 12:18:16.862948 (+ 32465us) log.cc:844] Serialized 14 byte log entry
0709 12:18:16.912977 (+ 50029us) log.cc:844] Serialized 14 byte log entry
0709 12:18:16.913247 (+   270us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:16.913326 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:16.928090 (+ 14764us) raft_consensus.cc:1685] finished
0709 12:18:16.928111 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:16.928249 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65886,"prepare.queue_time_us":284752,"prepare.run_cpu_time_us":574,"prepare.run_wall_time_us":49629,"raft.queue_time_us":61568,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":16017,"spinlock_wait_cycles":22172928,"thread_start_us":182471,"threads_started":3,"wal-append.queue_time_us":213204}
I20260709 12:18:17.197276 26784 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:17.195581 26878 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:17.163973 26888 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:18:17.208420 26629 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.238881 26784 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.207176 26478 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:18:17.240367 26878 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:17.262601 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69763.5us
W20260709 12:18:17.263761 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 282389us
I20260709 12:18:17.265307 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1683) took 1312 ms. Trace:
W20260709 12:18:17.267273 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 76953.2us
I20260709 12:18:17.265842 24169 rpcz_store.cc:276] 0709 12:18:15.952564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.957906 (+  5342us) service_pool.cc:224] Handling call
0709 12:18:15.958253 (+   347us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:15.958675 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:15.958704 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:15.959275 (+   571us) log.cc:844] Serialized 52 byte log entry
0709 12:18:16.115430 (+156155us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:16.971694 (+856264us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b1800430ba0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c08f733c7 00007f4c055859a7 00007f4c055950bf 00007f4c05595038
0709 12:18:17.123487 (+151793us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.124212 (+   725us) log.cc:844] Serialized 14 byte log entry
0709 12:18:17.264675 (+140463us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b1800430ba0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02408c0a 00007f4c0bb48219 00007f4c02490a40 00007f4c0248b4e4 00007f4c0248b455 00007f4c05573060 00007f4c05585716 00007f4c05596287 00007f4c05596208
0709 12:18:17.264915 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.265010 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:17.265057 (+    47us) raft_consensus.cc:1685] finished
0709 12:18:17.265073 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:17.265237 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55224,"prepare.queue_time_us":262388,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":126,"raft.queue_time_us":5837,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":7295,"spinlock_wait_cycles":46685824,"thread_start_us":307188,"threads_started":2,"wal-append.queue_time_us":221742}
I20260709 12:18:17.265300 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:17.239143 26771 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:18:17.271049 24067 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:17.273653 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 58266.5us
W20260709 12:18:17.273855 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 99453.1us
I20260709 12:18:17.269465 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:17.275935 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.275820 24067 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.263283 26784 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:17.277999 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 151028us
W20260709 12:18:17.278524 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70708us
I20260709 12:18:17.293344 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.302093 24141 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.310127 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.210487 26890 consensus_queue.cc:1059] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.108s
I20260709 12:18:17.279278 26874 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.280076 26900 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:17.200809 26877 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 12:18:17.273474 26879 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:18:17.350566 26879 consensus_queue.cc:1243] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer 5d0f174a97494d0cbf08ae81ec4c807a log is divergent from this leader: its last log entry 6.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:18:17.351719 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:17.312354 26871 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.324270 26908 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.308338 26568 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:17.325765 26702 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.325609 26811 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:17.322685 26899 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.298002 26896 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:18:17.348479 26902 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:17.349330 26897 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:17.349749 26900 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.314603 26898 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:17.364300 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 54309us
I20260709 12:18:17.304277 26853 consensus_queue.cc:1059] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:18:17.320479 26850 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:17.366600 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:17.306010 26810 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:18:17.304519 26775 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:18:17.367677 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 91991.8us
I20260709 12:18:17.368438 24095 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:17.372370 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 1850) took 1286 ms. Trace:
I20260709 12:18:17.353298 26852 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.378679 24141 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.381233 24098 rpcz_store.cc:276] 0709 12:18:16.086063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.086362 (+   299us) service_pool.cc:224] Handling call
0709 12:18:16.122135 (+ 35773us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:16.737706 (+615571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.370147 (+632441us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540031a1d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:17.372276 (+  2129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1414383360}
I20260709 12:18:17.363268 26602 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:17.380357 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 73392us
I20260709 12:18:17.381439 24067 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.383025 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:16.978956 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:17.377055 26894 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:17.374962 26897 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:17.413583 23997 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:17.428542 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 45637.8us
I20260709 12:18:17.429560 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.432158 24094 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
W20260709 12:18:17.432395 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 51057.8us
I20260709 12:18:17.433248 24067 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.434526 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.434759 24095 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:18:17.416321 26850 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.436693 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.437013 23997 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 3 to 6, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 6 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:17.372134 26908 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.436090 26899 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.435809 26891 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:17.431764 26896 raft_consensus.cc:3055] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:17.446086 26771 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.424576 26759 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.447789 24098 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:17.423336 26897 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.420977 26894 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:17.421415 26898 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:17.435806 26879 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.449309 24141 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.438722 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.460566 26775 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.451995 23997 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 3 to 4, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 4 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:17.491678 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53012.6us
I20260709 12:18:17.431496 26853 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.432662 26852 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:17.494477 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 45284.4us
I20260709 12:18:17.446489 26355 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.461416 26891 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.480953 26896 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:17.488677 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 224122us
I20260709 12:18:17.436816 26782 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:18:17.497704 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:17.481175 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 113062us
I20260709 12:18:17.504227 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:17.444295 26900 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.506392 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.496341 26850 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.504361 23997 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 3 to 5, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 5 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:17.496578 26899 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:17.544248 26782 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:17.544840 26782 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.541128 26896 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.545315 26888 raft_consensus.cc:3055] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:17.545753 26888 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.545933 26896 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.545789 26782 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.548432 26908 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:17.548622 24175 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:18:17.549072 24175 pending_rounds.cc:85] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 6
I20260709 12:18:17.549319 24175 pending_rounds.cc:107] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:18:17.549563 24175 raft_consensus.cc:2889] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:17.549674 26898 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.504441 26602 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.068s
I20260709 12:18:17.558214 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.512526 26852 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.553476 26899 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:17.499315 26912 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:18:17.573829 26605 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:17.555958 26894 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.574296 26605 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.574003 26899 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.575062 26894 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:17.575361 26605 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.576853 26899 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:17.507097 26909 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:18:17.499240 26853 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.577606 26605 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.558141 26850 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.579203 26853 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:17.515684 26891 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.579546 26850 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.562793 26804 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:17.580384 26891 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.580682 26804 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.581736 26850 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:17.510700 26775 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:18:17.556663 26826 consensus_meta.cc:287] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.651s	user 0.006s	sys 0.008s
I20260709 12:18:17.517083 26886 raft_consensus.cc:3055] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:17.521229 26629 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.583285 26886 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.551275 26904 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:18:17.584602 26886 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.585392 24092 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:17.585140 23997 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:17.521910 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:17.522151 23996 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 208) took 25111 ms (client timeout 15000 ms). Trace:
I20260709 12:18:17.509559 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:17.589349 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 79904us
I20260709 12:18:17.590258 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.531070 26784 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.591574 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.546805 26888 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.592460 26853 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:17.538726 26768 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:17.593163 26853 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.510761 26913 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 12:18:17.593780 24100 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:18:17.593879 26853 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:18:17.596745 26766 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
W20260709 12:18:17.597329 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.597196 26766 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.598110 26733 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:17.599383 26733 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:17.569408 24249 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:17.599794 26733 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:17.601326 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:17.583266 26826 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.602730 24245 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:17.603271 26782 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.542748 26568 raft_consensus.cc:3055] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:17.604898 26568 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:17.605917 26568 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.562562 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.512571 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:17.520171 26355 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:17.585925 26886 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:17.558445 24101 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:17.592855 26784 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:17.639389 26914 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:17.642340 26784 consensus_queue.cc:1059] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:17.639708 26825 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 12:18:17.585160 26629 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:17.617200 26568 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.644374 26828 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:17.644763 26828 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:17.645763 26828 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:17.587031 23996 rpcz_store.cc:269] 0709 12:17:52.410501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:52.412922 (+  2421us) service_pool.cc:224] Handling call
0709 12:18:17.521878 (+25108956us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:10.737504 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:10.738144 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:10.738193 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:18:10.738212 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:10.890912 (+152700us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:11.004905 (+113993us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:11.022469 (+ 17564us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:18:11.178305 (+155836us) tablet.cc:701] Row locks acquired
0709 12:18:11.183324 (+  5019us) write_op.cc:260] PREPARE: finished
0709 12:18:11.228209 (+ 44885us) write_op.cc:270] Start()
0709 12:18:11.257490 (+ 29281us) write_op.cc:276] Timestamp: P: 1783599491228092 usec, L: 0
0709 12:18:11.263623 (+  6133us) op_driver.cc:348] REPLICATION: starting
0709 12:18:11.385182 (+121559us) log.cc:844] Serialized 2073 byte log entry
0709 12:18:12.927830 (+1542648us) op_driver.cc:464] REPLICATION: finished
0709 12:18:13.813230 (+885400us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c024710ac 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c08fb1ef0
0709 12:18:14.228771 (+415541us) write_op.cc:301] APPLY: starting
0709 12:18:14.238946 (+ 10175us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:14.239280 (+   334us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:14.239331 (+    51us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:14.240349 (+  1018us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:14.240654 (+   305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:18:14.240709 (+    55us) write_op.cc:312] APPLY: finished
0709 12:18:14.241152 (+   443us) log.cc:844] Serialized 46 byte log entry
0709 12:18:14.508397 (+267245us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:14.539569 (+ 31172us) write_op.cc:454] Released schema lock
0709 12:18:14.557470 (+ 17901us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:14.646935 (+ 89465us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:14.649548 (+  2613us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":492103,"reported_tablets":27,"child_traces":[["op",{"apply.queue_time_us":1273811,"apply.run_cpu_time_us":17502,"apply.run_wall_time_us":354678,"num_ops":5,"prepare.queue_time_us":306070,"prepare.run_cpu_time_us":21870,"prepare.run_wall_time_us":727421,"raft.queue_time_us":1450576,"raft.run_cpu_time_us":63389,"raft.run_wall_time_us":1583036,"replication_time_us":1663911,"spinlock_wait_cycles":60946432,"thread_start_us":2433760,"threads_started":5,"wal-append.queue_time_us":369443,"wal-append.run_cpu_time_us":26130,"wal-append.run_wall_time_us":2543631}]]}
I20260709 12:18:17.559475 26915 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:17.618076 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:17.649442 24246 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.651376 26850 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:17.651942 26850 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:17.653756 26850 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:17.570569 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66457.5us
I20260709 12:18:17.660696 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:17.662451 24216 leader_election.cc:400] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:17.662786 26478 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:17.663252 26478 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.663539 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:17.550899 26878 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.664412 26478 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.666251 26478 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.573141 26897 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.669034 24244 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:17.670327 26897 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:17.592939 26888 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.628825 26907 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:17.629621 26902 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:17.630231 26766 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:17.631789 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:17.617115 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:17.668826 24247 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:17.600793 26733 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.635795 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:17.636298 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 123811us
I20260709 12:18:17.623692 26891 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.675297 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:17.652714 26828 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.676363 26775 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:17.676164 26891 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.677284 26775 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:17.643499 26602 raft_consensus.cc:3055] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:17.679255 26602 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:17.679481 24140 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:17.680332 26853 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:17.680897 26853 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:17.680425 26602 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.682116 26602 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.681862 26853 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.678437 26775 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.592926 24141 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.688651 26851 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:17.690604 26804 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:17.692350 26878 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:17.695457 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 102608us
W20260709 12:18:17.695590 24780 leader_election.cc:336] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.742s (SENT)
I20260709 12:18:17.697434 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:17.697619 24141 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.698191 24243 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:17.586668 23997 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:17.701769 23997 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 1 to 5, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 5 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:17.705837 26403 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.675418 26733 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.708971 24141 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:17.711544 26915 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.711648 26886 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:17.712182 26886 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:17.712167 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.712781 26886 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:18:17.712671 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49242.5us
I20260709 12:18:17.678663 26891 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:17.702518 26851 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.721124 26886 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.722648 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.723503 26907 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:17.723691 26886 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:17.723948 26907 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.724787 26876 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:17.724896 26907 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.726229 26907 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.727526 26900 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:17.727950 26900 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.728739 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:17.728790 26900 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.732040 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:17.732803 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:17.735319 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:17.738734 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:17.735064 24141 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.741083 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:17.742599 24092 raft_consensus.cc:606] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:17.734156 26900 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:17.769981 24094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:17.771324 24094 raft_consensus.cc:606] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:17.722765 24246 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
W20260709 12:18:17.772787 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.774681 24216 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:17.786554 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 248186us
I20260709 12:18:17.788661 26920 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:17.798020 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.798213 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:17.810425 26853 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:17.811146 26853 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:17.819608 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 84678.2us
I20260709 12:18:17.821005 24141 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:17.822021 26851 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:17.822772 26851 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.771914 26844 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:17.823262 26878 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:17.824249 26878 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:17.824584 26878 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:17.825450 26878 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.779029 26891 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:18:17.826545 24141 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:17.826670 26878 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:17.827282 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.828385 26890 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:17.832664 26850 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:17.773061 26813 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.835476 26813 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.836344 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.837037 26853 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:17.837845 26813 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:17.838411 26403 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:17.838972 26403 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:17.837200 24101 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:17.839499 26403 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:17.840889 26898 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:17.841985 26916 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:17.842371 26916 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:17.843369 26916 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:17.844952 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 63307.1us
I20260709 12:18:17.846117 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:17.847199 26876 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:17.847683 26876 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:17.848631 26876 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:17.850210 26916 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:17.859630 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:17.809939 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 308600us
I20260709 12:18:17.863101 24067 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:17.870334 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:17.871076 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.873694 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:17.877269 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.878208 24096 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:17.779556 26886 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:17.899466 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:17.880322 26813 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:17.909946 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:17.877301 26897 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:17.912030 26903 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:17.912669 26903 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:17.913139 26903 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:17.918045 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:17.918888 24808 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:17.879583 26890 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:17.922428 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:17.928902 24806 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:17.912214 26897 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.938400 24141 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:17.945871 24141 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:17.941989 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 79032.9us
I20260709 12:18:17.952808 24096 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:17.953907 24094 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:17.948554 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:17.963188 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:17.963451 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.963927 24092 raft_consensus.cc:606] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:17.964416 24092 raft_consensus.cc:614] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:17.921639 26890 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:17.970356 24809 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:17.973598 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:17.977622 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.949780 26913 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:17.952899 26800 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:17.958928 26568 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:17.957815 26850 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.001782 26800 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:18.003861 26927 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:18:18.004885 26800 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:17.972935 26914 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:18:18.006417 26914 raft_consensus.cc:3055] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:18.006749 26403 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:18.022723 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.015902 26913 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:17.984901 26921 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:18.027385 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53877.2us
I20260709 12:18:18.036664 24067 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.041241 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:17.997526 26568 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:18.048552 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 249169us
I20260709 12:18:17.966164 26775 consensus_queue.cc:1059] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:18:17.967409 26891 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:18:18.049971 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:18.006796 26914 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:18.062623 24216 leader_election.cc:400] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:18.063141 24216 leader_election.cc:403] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:18:18.021754 26897 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:18.068282 24067 leader_election.cc:400] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
I20260709 12:18:18.068697 24067 leader_election.cc:403] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:18.039933 26878 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:18.073482 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.092280 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:18.094422 26911 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:18.095801 26911 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:18.053861 26568 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:18.099802 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:18.102662 24249 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:18.102793 24242 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: [6.6-8.7]
I20260709 12:18:18.103982 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:18.104041 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.105664 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:18.102685 24244 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:18.052009 26782 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.106243 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:18.107203 24170 pending_rounds.cc:85] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 2
I20260709 12:18:18.107532 24170 pending_rounds.cc:107] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 6.3
I20260709 12:18:18.106338 24173 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:18.107810 24170 raft_consensus.cc:2889] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:18.110934 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:18.113545 24174 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:18.105593 24248 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:18.118527 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:18.118887 24174 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:18:18.119930 24246 raft_consensus.cc:2368] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8.
I20260709 12:18:18.118862 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:18.070509 26898 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:18.122186 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 118579us
I20260709 12:18:18.087694 26478 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.130005 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.131701 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:48090
W20260709 12:18:18.139472 26930 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:18:18.119436 26782 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.115387 26403 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.157631 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:18.158015 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:18.152730 24094 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:18.161609 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:18.162649 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:18.119738 26844 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5.
I20260709 12:18:18.172538 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:18.180298 24173 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:18.182765 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:18.183430 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:18.183591 24174 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:18.184137 24092 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:18.185715 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:18.146956 26782 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:18.191597 24173 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:18.155444 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:18.197351 24141 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.199156 24141 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.201833 24214 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:18.213147 26932 log.cc:927] Time spent T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:18:18.214435 24093 raft_consensus.cc:606] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.187142 26902 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.220784 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.232385 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.233604 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:18.234014 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:18.234736 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.221115 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:18.222011 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:40964
I20260709 12:18:18.222848 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.236415 24246 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:18.223891 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.238159 24248 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:18.226260 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.227291 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:18.228681 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:18.238006 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.243918 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.248715 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.155673 26914 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.130731 26913 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.252573 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:18.192451 26897 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:18:18.266279 24241 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:18.260322 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:18.261294 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:18.264071 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.270761 24250 raft_consensus.cc:2410] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:18.270905 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.281970 26914 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.259049 26902 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:18.286589 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:18.287205 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:18.287788 26896 raft_consensus.cc:3055] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:18.288295 26896 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 4 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:18.288648 26902 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:18.289997 24241 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:18.291473 26605 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.292795 26890 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:18.293229 26890 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:18.271270 26403 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:18:18.297070 26403 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:18.297602 26403 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:18.298049 26403 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:18.299716 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.299985 26605 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:18.294327 26890 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:18.306084 26733 consensus_meta.cc:287] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.598s	user 0.010s	sys 0.002s
I20260709 12:18:18.307025 24810 raft_consensus.cc:2410] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:18:18.256456 26886 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:18.302722 24215 consensus_peers.cc:597] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 51d85bfbe5fb4a4ba1caf713a20ce874. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:18.315537 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 246063us
I20260709 12:18:18.388561 24242 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:18.272553 26907 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:18:18.394651 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.382318 26602 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.006s
I20260709 12:18:18.314446 26886 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:18.501585 24780 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.584s (SENT) [suppressed 24 similar messages]
I20260709 12:18:18.508652 24244 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:18.511482 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:18.561363 24779 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.565639 26920 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.545753 24092 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:18.544703 26469 raft_consensus.cc:993] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:18.574491 26469 raft_consensus.cc:1081] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
W20260709 12:18:18.575675 26936 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260709 12:18:18.577834 26851 raft_consensus.cc:3055] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:18.578315 26851 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:18.580754 26851 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:18.583547 26919 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.512s	user 0.002s	sys 0.002s
I20260709 12:18:18.608807 24094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:18.610276 24094 raft_consensus.cc:606] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:18.610711 24094 raft_consensus.cc:614] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:18.509423 26886 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:18.630466 24170 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.022s	sys 0.015s
W20260709 12:18:18.669003 24170 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.023s	sys 0.016s
I20260709 12:18:18.515430 26894 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:18.506071 26940 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:18.679031 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 441078us
I20260709 12:18:18.675316 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:18:18.685662 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:18.687006 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.688750 24815 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:18:18.689172 24815 pending_rounds.cc:85] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Aborting all ops after (but not including) 6
I20260709 12:18:18.689459 24815 pending_rounds.cc:107] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 12:18:18.689803 24815 raft_consensus.cc:2889] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:18.610464 26915 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:18.696547 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.698308 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.701695 24094 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:18.686354 26629 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:18.695133 26602 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.707090 26629 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.695552 26915 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:18.709718 26898 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:18.707209 26602 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.707468 24810 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:18.675597 26941 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.714437 24094 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:18.717777 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 282) took 1189 ms. Trace:
W20260709 12:18:18.724960 26478 consensus_meta.cc:287] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.591s	user 0.013s	sys 0.000s
I20260709 12:18:18.725519 26478 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:18.728801 26896 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.682493 26894 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:18.710747 26915 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.732896 26915 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.743206 26940 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:18:18.745071 26940 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:18.745551 26940 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.746851 24242 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:18.690169 24174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:18.751587 24174 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:18.751998 24174 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.752303 26947 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:18.758975 26851 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:18.686084 26921 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:18.760106 26921 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:18.761780 26702 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:18.762445 26921 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:18.688525 26878 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:18.773985 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.775219 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 77022.2us
I20260709 12:18:18.776332 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.718333 24098 rpcz_store.cc:276] 0709 12:18:17.528698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.531084 (+  2386us) service_pool.cc:224] Handling call
0709 12:18:17.531474 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:17.531871 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:17.531899 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:17.532406 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:18:17.962795 (+430389us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:17.962868 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:17.962972 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:18.582902 (+619930us) spinlock_profiling.cc:243] Waited 5.77 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:18.712168 (+129266us) raft_consensus.cc:1685] finished
0709 12:18:18.712192 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:18.717663 (+  5471us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3669,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"spinlock_wait_cycles":13269888,"thread_start_us":429882,"threads_started":1,"wal-append.queue_time_us":482923}
I20260709 12:18:18.779134 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:18.767657 24244 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:18.772228 26952 tablet_replica.cc:333] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:18:18.788441 24244 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:18:18.750505 26403 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.712605 26768 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:18.793594 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 506475us
I20260709 12:18:18.794646 24247 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:18.796564 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.792356 24174 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.798974 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:18.782090 26903 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.868s	user 0.011s	sys 0.004s
W20260709 12:18:18.800941 24171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.013s	sys 0.037s
W20260709 12:18:18.801267 24171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.013s	sys 0.037s
I20260709 12:18:18.788462 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:18.733076 26894 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.782333 26844 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:18.806417 24174 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.809518 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:18.812355 24175 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:18.780141 26945 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.790803 26898 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.814800 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:18.817430 24242 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:18.794276 26853 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:18:18.808753 26568 consensus_meta.cc:287] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.686s	user 0.012s	sys 0.000s
I20260709 12:18:18.786859 26469 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:18:18.800877 26800 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.782027 26878 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.787155 26921 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:18:18.843343 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.814455 26941 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.812495 26844 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:18.821369 26896 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.797379 26768 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.828269 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:18.829676 26775 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:18.806334 26804 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:18:18.866175 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:18.808638 26903 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:18.837862 26899 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:18.846589 26912 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:18:18.852440 26844 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:18.896745 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 209842us
W20260709 12:18:18.886837 26938 log.cc:927] Time spent T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 12:18:18.885506 26920 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.850260 26478 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:18:18.846433 26800 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:18.839553 26568 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:18.921144 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 132745us
W20260709 12:18:18.925796 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 103442us
I20260709 12:18:18.853428 26941 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.913623 26940 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:18.938187 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:18.927619 26952 raft_consensus.cc:2243] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:18:18.947052 24092 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:18.943131 26469 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:18.948731 26469 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:18.949576 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:18.950239 24093 raft_consensus.cc:3055] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:18.950539 24093 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:18.942292 26602 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.941398 26702 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.951364 24093 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.951574 26702 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.952391 24093 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:18.952829 26800 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.953716 26702 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.933717 26766 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:18.947170 26916 consensus_meta.cc:287] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.073s	user 0.017s	sys 0.000s
I20260709 12:18:18.959374 26766 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.961997 26912 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.962594 26912 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:18.935194 26890 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:18.973960 24093 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
W20260709 12:18:18.975298 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 149233us
I20260709 12:18:18.963326 26469 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:18.976223 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:18.947896 26950 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 12:18:18.976658 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 475115us
I20260709 12:18:18.982748 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:18.983901 24093 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:18.985991 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.989004 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.989867 24247 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:18.922197 26920 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:18.991928 26403 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.993129 26878 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.993180 26941 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.994843 26568 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:18.994000 26920 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.995949 26912 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:18.997130 26921 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:18.998925 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:18.999166 26965 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:18.999749 26768 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:18.971623 26629 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.001143 26953 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:19.001585 26953 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.008095 24092 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:19.009596 26878 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:19.010150 26844 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.017941 26469 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:19.026425 26953 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.026770 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:19.027881 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:19.028306 24815 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:19.028475 24242 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:19.029546 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:19.026388 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:19.027354 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:18.999819 26965 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.031550 24096 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.033187 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:19.033375 24215 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:19.033778 26965 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.035074 26903 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.035591 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:18.995326 26952 raft_consensus.cc:2272] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:18:19.038627 26912 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:19.035749 24098 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:19.041828 26898 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:18:19.042279 26898 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:19.047096 26912 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:19.047909 26804 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:19.049212 26966 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:19.049603 26966 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:18:19.050661 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 149694us
I20260709 12:18:19.026291 26766 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:19.051509 24141 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.052369 26952 ts_tablet_manager.cc:1916] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:18:19.051998 26898 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.052866 24141 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.053638 26898 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:19.054116 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.050521 26966 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.057022 26966 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.060741 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:19.061645 24092 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:19.035727 26907 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:19.060495 24094 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
W20260709 12:18:19.063463 26960 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.120s	user 0.000s	sys 0.003s
I20260709 12:18:19.064405 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.065333 26947 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.065766 24141 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.066030 26947 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:19.066653 26947 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:19.063488 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:19.066462 26886 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.067620 26963 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:19.068343 26403 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.068410 26964 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.071139 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.080772 24096 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:19.081156 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:19.082037 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 65353.6us
I20260709 12:18:19.110167 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.110852 24140 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:18:19.111423 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.112373 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.116840 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.118149 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.119486 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.045570 26888 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:18:19.125944 24246 raft_consensus.cc:2368] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8.
I20260709 12:18:19.118616 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:19.128574 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.129956 24171 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:19.130102 24066 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:19.131075 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.131410 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.133030 24168 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:19.134399 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.135556 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.136564 24173 raft_consensus.cc:2368] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8.
I20260709 12:18:19.137600 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.138520 24173 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:19.139245 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.140113 24167 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:19.094866 26355 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.123533 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:19.101085 26766 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.149863 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.157474 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.124550 24780 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:19.151881 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.143954 24168 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:19.121235 26945 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.142836 26568 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:19.163264 24067 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:19.127283 26944 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:19.199772 26948 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.201696 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1300) took 1097 ms. Trace:
I20260709 12:18:19.202512 26942 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.203330 26602 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:19.202214 24170 rpcz_store.cc:276] 0709 12:18:18.104304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.106552 (+  2248us) service_pool.cc:224] Handling call
0709 12:18:18.106915 (+   363us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:18.669489 (+562574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.669531 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:18.741583 (+ 72052us) spinlock_profiling.cc:243] Waited 7.25 ms on lock 0x7b2c00010da8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2
0709 12:18:18.788668 (+ 47085us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b2c00010da8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2
0709 12:18:18.789271 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 12:18:18.935475 (+146204us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:19.069135 (+133660us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.069576 (+   441us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.069749 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.069834 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.201394 (+131560us) raft_consensus.cc:1685] finished
0709 12:18:19.201417 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.201615 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":130814,"prepare.queue_time_us":131209,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":115999,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":8402,"spinlock_wait_cycles":72055296,"thread_start_us":668248,"threads_started":2,"wal-append.queue_time_us":322432}
I20260709 12:18:19.205789 26886 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:19.165421 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:19.167662 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.169697 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:19.157502 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.143092 26947 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:19.144536 26913 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.150662 26851 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:19.150368 26940 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.150506 26852 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.147368 26899 raft_consensus.cc:2764] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:18:19.147142 26916 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:19.188866 24173 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:19.108449 26963 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.196338 24067 leader_election.cc:400] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8.
W20260709 12:18:19.368547 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 172387us
I20260709 12:18:19.369553 24067 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:19.213001 24171 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:19.164388 26943 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:19.216423 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:19.370904 24099 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:19.217453 24174 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:18:19.302917 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.164732 26766 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:19.367223 26956 log.cc:927] Time spent T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260709 12:18:19.435130 24168 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:18:19.366055 26919 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:18:19.440160 24099 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:19.177454 26945 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.379745 26894 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.457263 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.377974 26568 raft_consensus.cc:697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:19.408601 26909 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:19.437498 26878 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:18:19.469498 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56689.9us
I20260709 12:18:19.361447 26940 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.446359 26943 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:19.435309 26851 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:19.287851 26913 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.472878 24094 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:19.466621 26702 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.470360 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.472078 26878 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.489429 26803 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:19.494241 24067 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:18:19.509016 26970 log.cc:927] Time spent T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 12:18:19.482827 26844 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.496322 26878 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:19.513892 26568 consensus_queue.cc:237] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.517421 26945 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.518898 26943 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.519551 26913 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.467643 26894 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:19.525290 26766 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:19.506423 26916 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:19.525445 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1572) took 1293 ms. Trace:
I20260709 12:18:19.527287 26940 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:19.531960 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 107582us
I20260709 12:18:19.493005 26899 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:19.549170 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 94295.6us
I20260709 12:18:19.498508 26853 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:19.545734 24245 rpcz_store.cc:276] 0709 12:18:18.232375 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.257116 (+ 24741us) service_pool.cc:224] Handling call
0709 12:18:18.272734 (+ 15618us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:18.547893 (+275159us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4800250158. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0a4a4aa1 00007f4c0a49bb37 00007f4c0a49b9ca 00007f4c0a59326f 00007f4c0a592f37 00007f4c0a5a755c 00007f4c0a5a7508 00007f4c0a5a7488 00007f4c0a5a7443 00007f4c0a5a66ec 00007f4c094d0a96
0709 12:18:18.791387 (+243494us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:18.791420 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:18.804086 (+ 12666us) log.cc:844] Serialized 52 byte log entry
0709 12:18:18.942044 (+137958us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:19.079895 (+137851us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.080358 (+   463us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.084920 (+  4562us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.085046 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.208357 (+123311us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b18002bff60. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0a4a4aa1 00007f4c0a49bb37 00007f4c0a49b9ca 00007f4c0a59326f
0709 12:18:19.209882 (+  1525us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4800250158. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0a4a4aa1 00007f4c0a49bb37 00007f4c0a49b9ca 00007f4c0a59326f 00007f4c0a592f37 00007f4c0a5a755c 00007f4c0a5a7508 00007f4c0a5a7488 00007f4c0a5a7443 00007f4c0a5a66ec 00007f4c094d0a96
0709 12:18:19.525143 (+315261us) raft_consensus.cc:1685] finished
0709 12:18:19.525175 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:19.525370 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47521,"prepare.queue_time_us":69701,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":6548,"raft.queue_time_us":34185,"raft.run_cpu_time_us":5671,"raft.run_wall_time_us":386426,"spinlock_wait_cycles":94053504,"thread_start_us":705328,"threads_started":3,"wal-append.queue_time_us":306463}
I20260709 12:18:19.471246 26909 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.532537 26913 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:19.566130 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.545476 26916 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:19.576596 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:19.577168 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:19.578073 26997 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:19.578717 26997 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:19.584321 26629 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:19.585081 24176 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 4. Current term is 5. Ops: []
W20260709 12:18:19.585610 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 429558us
I20260709 12:18:19.561898 26853 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.576048 26916 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:19.600925 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.601738 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.580473 26997 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:19.530812 26851 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:19.595254 26982 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 12:18:19.603567 24170 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:19.612501 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:18:19.613261 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.596073 26853 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.612989 26986 ts_tablet_manager.cc:933] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.571182 26913 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:19.613263 26890 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.637s	user 0.013s	sys 0.001s
W20260709 12:18:19.659740 26989 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:19.664047 26963 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.617312 26921 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:19.675560 24244 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:19.665565 26974 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.678025 26899 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.677428 26921 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:19.680008 26938 log.cc:927] Time spent T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:18:19.687685 26966 consensus_meta.cc:287] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.630s	user 0.011s	sys 0.003s
I20260709 12:18:19.748595 26878 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.732304 26921 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:19.752996 26403 consensus_meta.cc:287] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.006s
I20260709 12:18:19.753521 26403 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:19.730786 26894 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:19.756218 26942 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.553s	user 0.012s	sys 0.000s
W20260709 12:18:19.756428 26987 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.109s	user 0.000s	sys 0.002s
I20260709 12:18:19.756778 26942 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:19.758296 26909 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.760589 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:19.761492 24806 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:19.765448 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:19.766233 24170 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:19.763322 26953 consensus_meta.cc:287] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.718s	user 0.010s	sys 0.004s
I20260709 12:18:19.784252 24781 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:19.735920 26899 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.786777 27009 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:19.682471 26974 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.789983 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.790171 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.792587 26909 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.793219 26909 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.793521 26878 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.794623 26952 ts_tablet_manager.cc:1929] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:18:19.795359 26952 log.cc:1199] T c29a1bdc82674a4ab1ad6c3b54c69e25 P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/c29a1bdc82674a4ab1ad6c3b54c69e25
I20260709 12:18:19.796890 26952 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40964 (request call id 73) took 1578 ms. Trace:
I20260709 12:18:19.797290 26952 rpcz_store.cc:276] 0709 12:18:18.218421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.221646 (+  3225us) service_pool.cc:224] Handling call
0709 12:18:18.771794 (+550148us) ts_tablet_manager.cc:1151] Deleting tablet c29a1bdc82674a4ab1ad6c3b54c69e25
0709 12:18:18.771901 (+   107us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:18:19.594571 (+822670us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:19.794447 (+199876us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:19.796790 (+  2343us) inbound_call.cc:177] Queueing success response
Metrics: {"tablet-delete.queue_time_us":520522,"thread_start_us":391551,"threads_started":1}
I20260709 12:18:19.780200 26469 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.799396 26469 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.801843 26469 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.777793 26965 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.803920 26965 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.806218 26965 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.808069 26996 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.790628 24173 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
W20260709 12:18:19.794674 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:19.812335 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.820643 24170 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:19.808744 26996 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:19.825353 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:19.822045 26803 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:19.827601 24806 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:19.827831 24067 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:19.826041 24175 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:19.832682 26629 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:19.833197 26629 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:19.829051 26803 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:19.838429 26996 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:19.839148 24167 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:19.823387 26986 tablet_copy_client.cc:323] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
W20260709 12:18:19.844054 26980 log.cc:927] Time spent T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.374s	user 0.001s	sys 0.001s
I20260709 12:18:19.789301 26953 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.859882 26953 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:19.856781 26568 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:18:19.830616 26469 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:19.828912 26899 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:19.888715 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 63866us
I20260709 12:18:19.875801 26469 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:19.892789 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 774181us
W20260709 12:18:19.893852 26898 consensus_meta.cc:287] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.840s	user 0.009s	sys 0.004s
I20260709 12:18:19.897737 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:19.913982 24806 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:19.970793 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:20.114557 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1395) took 1319 ms. Trace:
I20260709 12:18:20.278211 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:20.279188 24170 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
W20260709 12:18:20.132596 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.119901 24781 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:18:20.281360 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 161579us
W20260709 12:18:19.925262 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 756814us
I20260709 12:18:20.276748 24245 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
W20260709 12:18:20.175155 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:20.019410 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 102670us
I20260709 12:18:20.275478 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:20.290361 24175 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:20.277041 24244 rpcz_store.cc:276] 0709 12:18:18.795640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:18.795834 (+   194us) service_pool.cc:224] Handling call
0709 12:18:20.114355 (+1318521us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54000b68d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:20.114482 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2010260864}
I20260709 12:18:19.952085 26810 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:20.309118 26902 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.309947 26896 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:20.309767 26810 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.310542 26896 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.311164 26953 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.311676 26953 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.309793 26902 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:20.312842 26896 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.313442 26896 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.313871 26896 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:20.173507 27007 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:18:19.913640 26469 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.318082 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:19.927511 26897 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.920605 26974 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.954975 26766 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.019580 26981 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.955163 26914 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:19.913374 26913 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:19.954650 26955 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.274642 26899 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:20.143405 26888 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59764 (request call id 7) took 2576 ms. Trace:
I20260709 12:18:20.315171 26478 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:20.337029 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.382022 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:20.300570 26997 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:20.313881 26953 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.314972 26902 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:20.293314 26886 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:20.109762 26629 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:19.921523 26916 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.327443 26915 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:19.924341 26921 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.361392 26775 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:20.362026 26355 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.365916 26974 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:20.455971 26775 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.460846 26775 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:20.361780 26890 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.383190 26850 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.385354 26955 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.404451 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:20.392299 26899 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.364972 26897 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.390839 26997 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:20.460461 26974 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.421545 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1318) took 1292 ms. Trace:
I20260709 12:18:20.373965 26766 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.400130 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 51d85bfbe5fb4a4ba1caf713a20ce874 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
W20260709 12:18:20.428932 26803 consensus_meta.cc:287] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.594s	user 0.015s	sys 0.001s
I20260709 12:18:20.386066 26913 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:20.374333 26981 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.378944 26914 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.484530 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:20.465896 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:20.486035 24099 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:20.434418 26915 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.393428 26478 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.469282 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:20.469942 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:20.496901 24245 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:20.458154 26921 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.467520 26850 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:20.474426 24172 rpcz_store.cc:276] 0709 12:18:19.128830 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.135100 (+  6270us) service_pool.cc:224] Handling call
0709 12:18:19.167536 (+ 32436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:19.191272 (+ 23736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.191324 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:19.191975 (+   651us) log.cc:844] Serialized 26 byte log entry
0709 12:18:19.850930 (+658955us) spinlock_profiling.cc:243] Waited 21.5 ms on lock 0x7b180030c9a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:18:19.879472 (+ 28542us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:19.914132 (+ 34660us) log.cc:844] Serialized 14 byte log entry
0709 12:18:19.914476 (+   344us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:19.914554 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:19.918569 (+  4015us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b180030c9a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:20.421178 (+502609us) raft_consensus.cc:1685] finished
0709 12:18:20.421215 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:20.421445 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83172,"prepare.queue_time_us":34301,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":62,"raft.queue_time_us":22121,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":241,"spinlock_wait_cycles":57528064,"thread_start_us":28077,"threads_started":1,"wal-append.queue_time_us":1195336}
I20260709 12:18:20.429324 26886 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.465104 26890 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.485437 24093 raft_consensus.cc:2368] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:20.497078 24092 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:20.474328 26997 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:20.498873 24101 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:20.456355 26878 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.465323 26355 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.480075 26810 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.485502 26914 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.501245 26902 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.481009 26896 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.505927 26921 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.532069 26850 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:20.532557 26766 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.534044 26897 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.519817 26902 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.524358 26629 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.534480 26469 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.525569 26916 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.492349 26913 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.536242 26902 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:20.523026 27015 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:18:20.532176 26921 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:20.533828 27014 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.105s	user 0.002s	sys 0.000s
I20260709 12:18:20.488302 26803 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:20.531317 26991 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:20.524606 26981 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.504097 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 51d85bfbe5fb4a4ba1caf713a20ce874 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-51d85bfbe5fb4a4ba1caf713a20ce874
I20260709 12:18:20.540612 26915 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.508955 26878 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.541342 26909 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.541692 26913 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.542775 26886 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.541173 26921 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.595130 24812 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:20.596630 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:20.605857 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:20.606642 24101 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:20.612668 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:20.613220 26955 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.614562 26899 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.613358 24093 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:20.605855 24250 raft_consensus.cc:2410] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:20.622167 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:20.624913 26955 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:20.625897 26955 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:20.629036 26915 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:20.632257 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:20.632777 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:20.633036 24250 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:20.636624 26469 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.382746 26888 rpcz_store.cc:276] 0709 12:18:17.566781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:17.566944 (+   163us) service_pool.cc:224] Handling call
0709 12:18:17.714164 (+147220us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b4c0005f600. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03847a20 00007f4c03858a29 00007f4c0381e644 00007f4c03845f2d 00007f4c03845b93 00007f4c054d41af 00007f4c054d3f3e 00007f4c05559888 00007f4c0557675c 00007f4c0557776a 00007f4c0557691b
0709 12:18:17.714947 (+   783us) log.cc:844] Serialized 506 byte log entry
0709 12:18:20.143198 (+2428251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27485,"raft.queue_time_us":30903,"raft.run_cpu_time_us":2034,"raft.run_wall_time_us":2032,"spinlock_wait_cycles":3938560,"thread_start_us":70910,"threads_started":1,"wal-append.queue_time_us":194085,"wal-append.run_cpu_time_us":2889,"wal-append.run_wall_time_us":1128561}
I20260709 12:18:20.637295 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:20.638173 26888 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.638883 26888 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.638219 24250 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:20.639571 26909 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:20.640434 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:20.640178 26909 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:20.641196 26888 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.642300 26909 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:20.643150 26803 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.643778 26568 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:20.644088 26974 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.644362 26568 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.646534 26568 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.647207 24250 raft_consensus.cc:2376] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7. Re-sending same reply.
I20260709 12:18:20.556516 26991 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:20.651194 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:20.654589 24250 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:20.657097 24093 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:20.662259 24101 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:20.629676 26915 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:20.669577 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 298145us
W20260709 12:18:20.673362 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 275330us
I20260709 12:18:20.672158 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:20.658557 26909 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:20.674852 24214 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:20.659279 26899 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:20.678089 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:20.663465 26355 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.664503 24259 tablet_copy_source_session.cc:215] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:20.681967 24101 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:20.684742 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:20.687832 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 293523us
I20260709 12:18:20.688879 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:20.693928 24806 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:20.690897 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:20.691668 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:20.689780 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 143307us
I20260709 12:18:20.695438 24095 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:20.703521 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:20.704910 26568 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:20.705224 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:20.705621 26568 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:20.706161 24250 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:20.710760 26955 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:20.711566 26955 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:20.689318 26478 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:20.719177 26850 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:20.719882 26850 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:20.724731 27022 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.099s	user 0.000s	sys 0.002s
I20260709 12:18:20.746618 26944 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.747504 26878 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:20.747402 26944 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.679200 26886 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:20.748967 26886 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:20.749969 26886 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.679438 26909 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:20.925239 27032 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.249s	user 0.000s	sys 0.000s
W20260709 12:18:21.160097 24141 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.604s (SENT)
I20260709 12:18:21.161362 27024 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:20.751011 26944 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:20.948055 27030 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:18:21.162324 26944 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:21.163130 26944 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:20.757436 24246 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:18:21.162007 27024 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:20.754781 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:20.683979 26899 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.164996 24244 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:21.165503 26944 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.166066 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1416) took 1097 ms. Trace:
I20260709 12:18:21.166124 27024 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.166721 24246 pending_rounds.cc:85] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 3
W20260709 12:18:20.901180 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:20.699067 26990 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:20.826234 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.186082 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.183350 26813 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:21.171679 26355 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:21.209923 24246 pending_rounds.cc:107] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:18:21.210271 24099 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:21.154280 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.224323 24246 raft_consensus.cc:2889] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:21.224714 24250 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:21.225412 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.225414 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1408) took 1294 ms. Trace:
I20260709 12:18:21.226428 24246 rpcz_store.cc:276] 0709 12:18:19.930631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.933704 (+  3073us) service_pool.cc:224] Handling call
0709 12:18:20.728795 (+795091us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:20.729089 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:21.225135 (+496046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.225341 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9951616}
I20260709 12:18:21.189175 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.217684 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.217819 26851 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.228371 26469 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:21.167176 26915 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:20.679459 26902 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:21.219413 24242 raft_consensus.cc:2410] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
I20260709 12:18:21.219889 24100 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:18:20.949383 27027 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:18:21.264618 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:20.944238 26997 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.268323 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.270493 26997 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.222678 26965 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:20.932046 26775 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.168344 26944 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:21.223240 27019 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:21.223567 24097 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:21.191005 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.228114 26851 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.167119 24244 rpcz_store.cc:276] 0709 12:18:20.068784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.636151 (+567367us) service_pool.cc:224] Handling call
0709 12:18:20.754545 (+118394us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:21.165934 (+411389us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27247360}
I20260709 12:18:21.229820 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:20.691478 26890 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:21.231756 26469 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.228816 26568 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.231985 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.232792 27026 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:21.214570 26955 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:21.232893 26850 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.232004 26810 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.224295 27020 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:21.214959 26981 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.232561 26766 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:18:21.236637 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:21.237948 27017 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.738s	user 0.006s	sys 0.021s
I20260709 12:18:21.219202 26878 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:21.239840 24067 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:21.240559 26921 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.240976 27005 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.241668 24066 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:21.349330 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:21.350020 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 108422us
W20260709 12:18:21.246863 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:21.253448 26907 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:21.354535 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.260962 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.355227 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.270156 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:21.356010 24096 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:21.356737 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 87031.3us
I20260709 12:18:21.273027 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.358966 24101 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:21.268324 24810 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:21.271552 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:21.274623 24245 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1418) took 1179 ms (client timeout 1534 ms). Trace:
W20260709 12:18:21.227293 27034 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:18:20.747566 26991 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.154183 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:21.218700 26813 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.276244 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1410) took 1337 ms. Trace:
I20260709 12:18:21.187449 27025 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:21.288383 24250 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:21.288435 24095 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:21.285691 26896 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:21.294055 27019 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.391614 26888 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:21.396863 26888 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.296451 27038 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.391848 26890 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.399374 27038 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.399528 26890 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.399461 27025 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.402068 27038 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.402705 27038 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.299234 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:21.300082 24094 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:21.254528 26899 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.307473 24246 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:21.312765 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:21.312639 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72897.4us
I20260709 12:18:21.442236 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1581) took 1048 ms. Trace:
I20260709 12:18:21.442628 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:21.287951 27021 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.289268 26902 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:21.352734 24066 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:21.446100 24171 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:21.442344 24249 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:21.227100 26990 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.248489 26355 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.224812 26953 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 12:18:21.385754 24245 rpcz_store.cc:269] 0709 12:18:20.094900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.336296 (+241396us) service_pool.cc:224] Handling call
0709 12:18:21.274423 (+938127us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b5400059954. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:21.274549 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":250945920}
I20260709 12:18:21.456367 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:21.456554 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 102405us
I20260709 12:18:21.355980 24098 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:21.457090 24248 raft_consensus.cc:2376] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7. Re-sending same reply.
I20260709 12:18:21.457767 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 242) took 1141 ms. Trace:
I20260709 12:18:21.457935 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.386510 24242 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:21.458664 24098 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:21.459132 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1585) took 1063 ms. Trace:
I20260709 12:18:21.364073 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.389174 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:21.460346 24100 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:21.350268 24097 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:21.393133 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.461829 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.462416 24249 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.290565 26965 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.297392 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.363453 26974 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:21.363595 26913 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.388202 27029 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:21.292239 26944 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.363256 27005 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.312247 27026 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.410724 27024 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:21.413235 27040 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:21.403136 26775 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.343812 26909 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.402925 26896 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.411780 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.391662 24247 rpcz_store.cc:276] 0709 12:18:19.938590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.939519 (+   929us) service_pool.cc:224] Handling call
0709 12:18:20.817291 (+877772us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:20.817652 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:20.822011 (+  4359us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:20.822061 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:21.159782 (+337721us) log.cc:844] Serialized 26 byte log entry
0709 12:18:21.206493 (+ 46711us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:21.219343 (+ 12850us) log.cc:844] Serialized 14 byte log entry
0709 12:18:21.261039 (+ 41696us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:21.261124 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:21.263595 (+  2471us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b18000998e0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:21.275972 (+ 12377us) raft_consensus.cc:1685] finished
0709 12:18:21.276002 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.276169 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53108,"prepare.queue_time_us":19564,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":76,"raft.queue_time_us":48337,"raft.run_cpu_time_us":424,"raft.run_wall_time_us":95450,"spinlock_wait_cycles":16881408,"thread_start_us":46246,"threads_started":1,"wal-append.queue_time_us":67940}
I20260709 12:18:21.483816 24250 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:21.468443 26991 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:21.341209 26568 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:21.348528 27031 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:21.398641 27019 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.444393 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.442770 24246 rpcz_store.cc:276] 0709 12:18:20.394280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.236127 (+841847us) service_pool.cc:224] Handling call
0709 12:18:21.442157 (+206030us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:21.446727 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 94112.6us
I20260709 12:18:21.311890 26955 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.348179 26981 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.456621 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.364892 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.497949 24245 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.499076 24096 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:21.459719 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.467619 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:21.502451 24140 leader_election.cc:400] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:21.506098 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.355363 26921 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.345240 26810 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.355561 26878 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.383229 26907 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.489724 27041 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:21.488902 26568 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:21.491868 26947 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:21.539371 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 62986.6us
I20260709 12:18:21.440169 26890 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:21.475304 24780 leader_election.cc:336] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Timed out: RequestConsensusVote RPC to 127.22.93.195:37157 timed out after 1.584s (SENT)
I20260709 12:18:21.348379 27020 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:21.477267 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.548498 24101 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:21.452754 26899 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:21.477512 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 119472us
I20260709 12:18:21.478035 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.447376 27038 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.552911 24244 raft_consensus.cc:2410] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:18:21.484259 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.406019 26813 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:21.485219 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.554242 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.487803 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1404) took 2401 ms. Trace:
I20260709 12:18:21.554922 24247 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.489949 24097 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:21.451031 27021 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.495786 24066 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:21.559195 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 64423us
I20260709 12:18:21.496786 27031 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:21.507120 24094 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
W20260709 12:18:21.509356 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 62747.7us
I20260709 12:18:21.500339 24098 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:21.530256 26851 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.512221 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:21.471271 26913 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.564862 27049 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:21.458138 24248 rpcz_store.cc:276] 0709 12:18:20.316329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.633876 (+317547us) service_pool.cc:224] Handling call
0709 12:18:21.456207 (+822331us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:21.457704 (+  1497us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32081408}
I20260709 12:18:21.567493 27049 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.567962 27049 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.568162 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.568612 26913 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.569048 24248 raft_consensus.cc:2393] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 5: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:21.569264 26913 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:21.569535 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1579) took 1176 ms. Trace:
I20260709 12:18:21.569940 24248 rpcz_store.cc:276] 0709 12:18:20.392699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.567841 (+1175142us) service_pool.cc:224] Handling call
0709 12:18:21.569465 (+  1624us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.532111 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:21.571830 27039 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:18:21.571885 26469 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.487427 27048 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:18:21.533209 24099 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:21.574834 26921 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.540977 24214 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.577798 27052 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:21.499199 27043 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:21.578251 27052 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.578692 27052 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.578926 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.578635 27043 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.579620 27031 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.543596 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:21.582129 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 106859us
I20260709 12:18:21.583222 27044 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:21.584446 27028 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:21.584765 26878 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.585183 27028 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.585695 27028 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:21.511359 26902 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.587239 26355 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:21.540702 24093 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:21.533917 27024 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:18:21.551492 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 46775.2us
I20260709 12:18:21.474083 27029 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.526129 26897 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:21.556733 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1419) took 1456 ms. Trace:
I20260709 12:18:21.592880 24244 rpcz_store.cc:276] 0709 12:18:20.100078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.475769 (+1375691us) service_pool.cc:224] Handling call
0709 12:18:21.556665 (+ 80896us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.558046 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.590895 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.594015 24250 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:21.594352 24248 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.594599 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1423) took 1404 ms. Trace:
I20260709 12:18:21.590751 24066 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.553190 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:21.485662 27040 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.564504 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:21.550426 26947 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:21.597020 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 43925.4us
I20260709 12:18:21.459525 24242 rpcz_store.cc:276] 0709 12:18:20.395606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.268576 (+872970us) service_pool.cc:224] Handling call
0709 12:18:21.459062 (+190486us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.597591 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.576270 26810 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:21.555157 24241 rpcz_store.cc:276] 0709 12:18:19.084529 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.084735 (+   206us) service_pool.cc:224] Handling call
0709 12:18:19.085211 (+   476us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:18:19.114673 (+ 29462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:19.114716 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:18:19.115502 (+   786us) log.cc:844] Serialized 78 byte log entry
0709 12:18:20.119234 (+1003732us) spinlock_profiling.cc:243] Waited 6.16 ms on lock 0x7b18003fbb60. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:18:20.326110 (+206876us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:20.672744 (+346634us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.685854 (+ 13110us) log.cc:844] Serialized 14 byte log entry
0709 12:18:20.686153 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:20.686222 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:20.722708 (+ 36486us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b18003fbb60. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:21.237292 (+514584us) spinlock_profiling.cc:243] Waited 2.42 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:21.264319 (+ 27027us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b18003fbb60. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e522 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:21.485813 (+221494us) raft_consensus.cc:1685] finished
0709 12:18:21.485850 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:21.486063 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":770648,"prepare.queue_time_us":346871,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":93,"raft.queue_time_us":44605,"raft.run_cpu_time_us":376,"raft.run_wall_time_us":17177,"spinlock_wait_cycles":37642880,"thread_start_us":540479,"threads_started":2,"wal-append.queue_time_us":1328597}
I20260709 12:18:21.601519 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.541841 26568 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:21.544859 24249 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:21.623500 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.624195 24249 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:21.624706 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1586) took 1228 ms. Trace:
I20260709 12:18:21.624930 24247 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:21.625047 24249 rpcz_store.cc:276] 0709 12:18:20.395902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.623215 (+1227313us) service_pool.cc:224] Handling call
0709 12:18:21.624630 (+  1415us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.576000 27020 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.598747 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:21.602257 24244 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:21.594946 24250 rpcz_store.cc:276] 0709 12:18:20.190772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.554881 (+1364109us) service_pool.cc:224] Handling call
0709 12:18:21.594504 (+ 39623us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.603438 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:21.605368 26955 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.606283 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.607084 26921 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:21.611184 26986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51d85bfbe5fb4a4ba1caf713a20ce874. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:21.611351 26897 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:21.601086 26775 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:21.613158 26981 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.613303 26965 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.613758 26991 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.639622 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:21.639899 26991 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:21.640568 24809 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:21.614315 27029 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.614387 27046 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:21.641920 27046 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:21.642361 27046 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:21.614647 26907 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:21.615332 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:21.616150 27005 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.644418 24811 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:21.619053 24246 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:21.645947 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:21.646656 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.647392 27025 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:21.648939 27026 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.636139 26851 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
W20260709 12:18:21.626694 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47853.2us
I20260709 12:18:21.628681 24066 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:21.654373 24810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 397) took 1288 ms. Trace:
I20260709 12:18:21.633029 26921 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.655217 27005 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:21.655395 26921 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.621716 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.656951 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.630414 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.657683 24241 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:21.658198 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 243) took 1341 ms. Trace:
I20260709 12:18:21.658366 24066 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.630465 24242 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:21.631440 27002 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:21.632308 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.591930 26990 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.639353 27040 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.544205 27041 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.647460 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1584) took 1252 ms. Trace:
I20260709 12:18:21.630682 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.633178 26899 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:21.658720 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.791738 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.753991 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.792673 24250 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:21.676721 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:21.792948 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.658509 24241 rpcz_store.cc:276] 0709 12:18:20.316634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.621256 (+1304622us) service_pool.cc:224] Handling call
0709 12:18:21.658133 (+ 36877us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.794250 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.795902 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.796398 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.771377 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:21.771574 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 113292us
I20260709 12:18:21.797924 24250 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
W20260709 12:18:21.772163 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 133730us
I20260709 12:18:21.775921 24245 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:21.800200 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.776674 24248 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:21.801121 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1417) took 1732 ms. Trace:
I20260709 12:18:21.801508 24248 rpcz_store.cc:276] 0709 12:18:20.069079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.570738 (+1501659us) service_pool.cc:224] Handling call
0709 12:18:21.801051 (+230313us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.802575 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.803267 24248 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:21.803577 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:21.747792 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 113853us
I20260709 12:18:21.783886 24244 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:21.788970 24780 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.632164 27024 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:21.769773 24246 rpcz_store.cc:276] 0709 12:18:20.395304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.646383 (+1251079us) service_pool.cc:224] Handling call
0709 12:18:21.647395 (+  1012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.805872 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.804184 24247 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:21.818361 24242 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:21.819509 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 241) took 1508 ms. Trace:
I20260709 12:18:21.821002 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:21.821265 24242 rpcz_store.cc:276] 0709 12:18:20.310949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.605932 (+1294983us) service_pool.cc:224] Handling call
0709 12:18:21.819430 (+213498us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.822031 24249 raft_consensus.cc:2376] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7. Re-sending same reply.
I20260709 12:18:21.824853 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.634349 26775 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.633375 26896 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:21.829435 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.845158 24250 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:21.831473 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.846688 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.848201 24250 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:21.849709 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.850536 24250 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:21.833320 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.833534 24248 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:21.834648 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:21.831193 24214 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.851541 24241 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:21.851744 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.851572 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1426) took 1155 ms. Trace:
I20260709 12:18:21.836018 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.838721 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.675134 26965 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:21.843637 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:21.861050 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:21.852614 24248 rpcz_store.cc:276] 0709 12:18:20.696603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.802272 (+1105669us) service_pool.cc:224] Handling call
0709 12:18:21.851497 (+ 49225us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:21.853336 24242 raft_consensus.cc:2368] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:21.862757 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.853256 24249 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:21.852411 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:21.852548 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:21.856561 24247 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:21.752269 26897 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.671686 26888 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.654814 24810 rpcz_store.cc:276] 0709 12:18:20.366389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.370621 (+  4232us) service_pool.cc:224] Handling call
0709 12:18:21.654156 (+1283535us) spinlock_profiling.cc:243] Waited 799 ms on lock 0x7b540067f054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:21.654305 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1838357376}
I20260709 12:18:21.689884 26947 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.790822 26899 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:21.802832 26981 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:21.734462 26851 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:21.672506 27043 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.790736 27005 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:21.738430 26991 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.751502 27050 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.287s
I20260709 12:18:21.741516 27046 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.870795 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:22.038568 26810 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:22.390079 24250 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:22.049332 26878 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:22.390836 27005 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:22.113256 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.389482 26899 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.286859 26803 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:22.388783 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:22.390323 26810 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:22.388500 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 581313us
I20260709 12:18:22.389235 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:22.389010 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 269530us
I20260709 12:18:22.396103 24100 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:22.397748 27021 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.402976 24780 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.396804 26851 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:21.857972 26974 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:22.407415 27002 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.393568 26981 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.407282 26803 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:22.418040 27005 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:22.450670 26851 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.041504 26913 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.464s
I20260709 12:18:22.300122 27020 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:22.451454 26851 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:22.412034 26909 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.451915 27020 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.452347 26803 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.834440 26828 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:22.452796 26355 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:22.453269 26355 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:22.453518 26828 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:22.454283 27020 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.455024 27020 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:22.411693 26813 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:22.424768 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 572409us
W20260709 12:18:22.455741 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 51914.4us
I20260709 12:18:22.456076 24214 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.418699 26974 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:22.455534 26813 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:22.459606 26813 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:22.447875 27052 consensus_meta.cc:287] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.868s	user 0.013s	sys 0.001s
I20260709 12:18:22.460500 27052 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.460824 26974 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:21.840320 26775 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.425586 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:22.463315 24244 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:22.447161 27002 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:22.464469 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1421) took 2296 ms. Trace:
I20260709 12:18:22.464867 27038 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.464927 24248 rpcz_store.cc:276] 0709 12:18:20.167988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.463531 (+2295543us) service_pool.cc:224] Handling call
0709 12:18:22.463923 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.464129 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.464155 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:22.464202 (+    47us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:22.464242 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.464297 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.464402 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.465824 27002 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:22.447831 24216 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.044s	sys 0.099s
I20260709 12:18:22.447753 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:22.467505 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:22.468061 24216 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.045s	sys 0.100s
I20260709 12:18:22.468192 24815 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
W20260709 12:18:22.468423 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 653624us
I20260709 12:18:22.461051 26944 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.470495 26991 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.845379 26568 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.391556 26878 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.473035 26568 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.828649 26990 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:22.409454 26810 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.473869 26990 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.475375 27052 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:22.454221 26355 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.476140 26990 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:21.871774 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:22.478628 24246 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:22.479199 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1597) took 1277 ms. Trace:
I20260709 12:18:22.454537 26828 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:22.479835 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:22.481030 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:22.481709 24814 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:22.049989 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:22.483686 24809 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:22.041728 26965 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:22.485271 26810 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.485376 26965 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.449617 26981 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.487955 26355 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.488145 26810 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:22.488802 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:22.489487 24250 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:18:22.492028 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:22.493472 26921 consensus_meta.cc:287] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.837s	user 0.008s	sys 0.004s
I20260709 12:18:22.493995 26921 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.038630 27053 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:22.495411 27053 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.495859 27053 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.496486 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 246) took 2105 ms. Trace:
I20260709 12:18:21.834827 26850 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:21.858355 26478 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:22.479523 24246 rpcz_store.cc:276] 0709 12:18:21.201474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.827381 (+625907us) service_pool.cc:224] Handling call
0709 12:18:22.479119 (+651738us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.093281 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1413) took 2073 ms. Trace:
W20260709 12:18:22.458469 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48005.7us
I20260709 12:18:22.119367 27040 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:22.497064 26981 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.132166 27041 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.423844 27024 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:22.499081 27020 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:18:22.545905 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 89919.3us
W20260709 12:18:22.457947 27028 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.872s	user 0.012s	sys 0.005s
I20260709 12:18:22.546550 24246 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:22.466789 24248 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:22.547559 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1577) took 2155 ms. Trace:
I20260709 12:18:22.547755 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1424) took 2337 ms. Trace:
I20260709 12:18:22.548090 24246 rpcz_store.cc:276] 0709 12:18:20.392098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.525960 (+2133862us) service_pool.cc:224] Handling call
0709 12:18:22.546050 (+ 20090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.547155 (+  1105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.547471 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.548384 24248 rpcz_store.cc:276] 0709 12:18:20.210726 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.466238 (+2255512us) service_pool.cc:224] Handling call
0709 12:18:22.466594 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.547376 (+ 80782us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.547672 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.516852 24242 rpcz_store.cc:276] 0709 12:18:20.391390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.493014 (+2101624us) service_pool.cc:224] Handling call
0709 12:18:22.493319 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.493516 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.493546 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:22.493584 (+    38us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:22.493617 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.493672 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.496417 (+  2745us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.552227 27042 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:22.551476 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:22.518560 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 244) took 2201 ms. Trace:
W20260709 12:18:22.375424 27049 consensus_meta.cc:287] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.807s	user 0.014s	sys 0.000s
I20260709 12:18:22.527866 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:22.473194 26878 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.553901 24250 rpcz_store.cc:276] 0709 12:18:20.316940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.490181 (+2173241us) service_pool.cc:224] Handling call
0709 12:18:22.490537 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.490733 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.490758 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:22.490798 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:22.490881 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.490941 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.518452 (+ 27511us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.529036 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1414) took 2461 ms. Trace:
I20260709 12:18:22.530054 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:22.532908 26899 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.534281 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:22.525624 24243 rpcz_store.cc:276] 0709 12:18:20.019916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:20.020101 (+   185us) service_pool.cc:224] Handling call
0709 12:18:21.243386 (+1223285us) spinlock_profiling.cc:243] Waited 6.28 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:21.243644 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:21.477072 (+233428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:21.477106 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:21.477146 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:21.477178 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.092803 (+615625us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5400002654. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:22.092896 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.093156 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":550795008}
I20260709 12:18:22.536337 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:22.558143 24242 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:18:22.539278 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:22.542474 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1595) took 1341 ms. Trace:
I20260709 12:18:22.503275 26775 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:22.525432 26478 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.535590 27040 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.447677 26888 raft_consensus.cc:2764] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:18:22.552739 27042 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.452826 26909 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.562400 27020 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:22.563127 26921 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.550616 27024 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.535750 26850 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.553162 27028 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.585337 27028 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:22.570399 27042 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:22.563704 26981 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.563657 26813 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:22.593822 26813 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.565790 26775 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:22.479771 27046 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.567296 26478 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.572249 26899 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.560422 27065 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:22.580089 27024 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.582144 26850 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.568204 27040 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.608211 27053 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.560595 27049 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.610844 27053 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.612548 27049 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.614513 26909 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.614814 27040 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.620921 26986 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33918 (request call id 393) took 3455 ms. Trace:
I20260709 12:18:22.618631 27042 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.622570 26986 rpcz_store.cc:276] 0709 12:18:19.177012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:19.194082 (+ 17070us) service_pool.cc:224] Handling call
0709 12:18:19.634536 (+440454us) ts_tablet_manager.cc:934] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
0709 12:18:21.609021 (+1974485us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:18:22.581534 (+972513us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:22.581759 (+   225us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:18:22.618671 (+ 36912us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:18:22.620233 (+  1562us) tablet_replica.cc:206] Creating consensus instance
0709 12:18:22.620723 (+   490us) ts_tablet_manager.cc:989] Replica registered.
0709 12:18:22.620798 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":25403,"tablet-copy.queue_time_us":355997,"thread_start_us":301928,"threads_started":2}
I20260709 12:18:22.621990 27040 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:22.446807 24142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.009s	sys 0.000s
I20260709 12:18:22.043669 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:22.422365 24140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.002s	sys 0.005s
I20260709 12:18:22.389156 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.421460 24141 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:22.555794 24247 rpcz_store.cc:276] 0709 12:18:20.067508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.037633 (+1970125us) service_pool.cc:224] Handling call
0709 12:18:22.528099 (+490466us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:22.528403 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.528638 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.528663 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:22.528717 (+    54us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:22.528758 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.528844 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.528965 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14589696}
I20260709 12:18:22.558380 24246 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:22.556332 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1587) took 2160 ms. Trace:
I20260709 12:18:22.557010 24249 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:22.624894 26986 tablet_copy_client.cc:806] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:22.745235 27020 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:22.746574 26986 tablet_copy_client.cc:670] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:22.735715 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:22.730046 26355 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:22.739658 26890 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:22.757753 27038 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.758035 26355 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.733078 24243 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:22.758764 27038 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.760249 26810 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.761059 26810 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:22.762137 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 372896us
I20260709 12:18:22.762724 27038 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:22.661743 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.705750 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1588) took 2309 ms. Trace:
I20260709 12:18:22.767096 26909 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:22.767762 26909 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:22.763708 26913 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:22.768364 26909 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:22.766081 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 344573us
I20260709 12:18:22.747918 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1425) took 2051 ms. Trace:
I20260709 12:18:22.763494 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1592) took 2365 ms. Trace:
I20260709 12:18:22.729840 26886 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:22.777033 26913 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:22.734799 24807 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:22.752792 24250 rpcz_store.cc:276] 0709 12:18:20.396194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.555402 (+2159208us) service_pool.cc:224] Handling call
0709 12:18:22.555764 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.555991 (+   227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.556018 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:22.556064 (+    46us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:22.556102 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.556158 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.556274 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:20.399418 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet c29a1bdc82674a4ab1ad6c3b54c69e25 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:18:22.697840 24215 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:22.780562 23985 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 2.44887e+06us
W20260709 12:18:22.781462 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 84088.6us
I20260709 12:18:22.558562 24242 pending_rounds.cc:85] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 4
I20260709 12:18:22.792472 24242 pending_rounds.cc:107] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:18:22.792995 24242 raft_consensus.cc:2889] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:22.794425 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1580) took 2401 ms. Trace:
I20260709 12:18:22.794862 24242 rpcz_store.cc:276] 0709 12:18:20.393028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.550269 (+2157241us) service_pool.cc:224] Handling call
0709 12:18:22.557291 (+  7022us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.793967 (+236676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.794371 (+   404us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.797072 24242 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:22.772913 26355 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:22.769174 26810 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:22.696214 24245 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:22.797819 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1598) took 1596 ms. Trace:
I20260709 12:18:22.798429 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1591) took 2401 ms. Trace:
I20260709 12:18:22.798893 24245 rpcz_store.cc:276] 0709 12:18:20.397430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.694416 (+2296986us) service_pool.cc:224] Handling call
0709 12:18:22.695337 (+   921us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.798120 (+102783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.798349 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.801268 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1578) took 2408 ms. Trace:
I20260709 12:18:22.801753 24246 rpcz_store.cc:276] 0709 12:18:20.392395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.549529 (+2157134us) service_pool.cc:224] Handling call
0709 12:18:22.558190 (+  8661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.788957 (+230767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.801070 (+ 12113us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.804718 24066 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.769819 24249 rpcz_store.cc:276] 0709 12:18:20.696267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.745835 (+2049568us) service_pool.cc:224] Handling call
0709 12:18:22.746589 (+   754us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.747206 (+   617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.747235 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:22.747314 (+    79us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:22.747354 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.747428 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.747572 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.776374 26886 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.769995 24243 rpcz_store.cc:276] 0709 12:18:20.397745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.731366 (+2333621us) service_pool.cc:224] Handling call
0709 12:18:22.732131 (+   765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.759898 (+ 27767us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.763379 (+  3481us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.772230 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:20.164481 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:22.789163 26913 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:22.693396 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 141920us
I20260709 12:18:22.559173 24244 rpcz_store.cc:276] 0709 12:18:21.200849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.831181 (+630332us) service_pool.cc:224] Handling call
0709 12:18:22.542169 (+710988us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b54003d7554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:22.542378 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1416194304}
I20260709 12:18:22.791007 27066 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:22.766709 24248 rpcz_store.cc:276] 0709 12:18:20.396520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.560359 (+2163839us) service_pool.cc:224] Handling call
0709 12:18:22.704382 (+144023us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.705060 (+   678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.705097 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:22.705178 (+    81us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:22.705228 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.705341 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.705500 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.773372 24247 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:22.624959 27042 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:22.683537 24241 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:22.798247 24242 rpcz_store.cc:276] 0709 12:18:21.201771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.795935 (+1594164us) service_pool.cc:224] Handling call
0709 12:18:22.796525 (+   590us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.797570 (+  1045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.797769 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:22.820559 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48616.1us
I20260709 12:18:22.829659 26899 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:22.830242 26899 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.830614 26899 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.831121 27066 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.831790 27066 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.836180 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1442) took 1004 ms. Trace:
I20260709 12:18:22.836755 24241 rpcz_store.cc:276] 0709 12:18:21.831970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:21.852313 (+ 20343us) service_pool.cc:224] Handling call
0709 12:18:22.835906 (+983593us) spinlock_profiling.cc:243] Waited 816 ms on lock 0x7b54003d8954. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:22.836104 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1877089152}
I20260709 12:18:22.838270 27038 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:22.838884 27038 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:22.839454 27038 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.843755 27049 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:22.844744 26886 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:22.844496 27049 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:22.845593 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.847893 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:22.849344 27046 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:22.849772 27046 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:22.850131 27046 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.851758 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.853281 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:22.854552 27053 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:22.855016 27053 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:22.855325 27040 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.855419 27053 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.826148 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 247) took 1631 ms. Trace:
I20260709 12:18:22.864328 24247 rpcz_store.cc:276] 0709 12:18:21.199055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.755274 (+1556219us) service_pool.cc:224] Handling call
0709 12:18:22.755989 (+   715us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.825821 (+ 69832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.826079 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:22.845553 26478 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.872922 26478 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:22.883265 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.885800 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.883582 24141 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:22.887930 26850 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:22.889163 24141 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.890305 26850 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:22.890770 26850 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:22.891309 26850 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.893596 27042 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:22.895277 27042 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:22.895653 27042 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:22.893669 24214 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.899600 24214 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.901386 24214 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.901919 26478 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:22.902510 26478 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.902949 26886 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:22.896740 27042 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.903309 26478 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.903491 26886 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.904034 26886 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.904258 27042 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.902447 26355 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:22.907594 26355 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.908012 26355 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.909307 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:22.909847 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:22.910557 24244 raft_consensus.cc:2376] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9. Re-sending same reply.
W20260709 12:18:22.911340 24140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.008s	sys 0.006s
W20260709 12:18:22.911906 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 1.02303e+06us
I20260709 12:18:22.913933 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:22.914182 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:22.908097 27066 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:22.916376 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:22.916774 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:22.917419 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:22.918496 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:22.915346 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:22.919078 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.922750 24175 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:22.923175 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1445) took 1090 ms. Trace:
I20260709 12:18:22.924172 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:22.923583 24245 rpcz_store.cc:276] 0709 12:18:21.832654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.801734 (+969080us) service_pool.cc:224] Handling call
0709 12:18:22.802282 (+   548us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:22.803671 (+  1389us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:22.803715 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:22.804575 (+   860us) log.cc:844] Serialized 26 byte log entry
0709 12:18:22.865523 (+ 60948us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:22.867258 (+  1735us) log.cc:844] Serialized 14 byte log entry
0709 12:18:22.867570 (+   312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:22.867655 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:22.922871 (+ 55216us) raft_consensus.cc:1685] finished
0709 12:18:22.922895 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:22.923098 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2200,"raft.run_cpu_time_us":427,"raft.run_wall_time_us":1395,"thread_start_us":61552,"threads_started":2,"wal-append.queue_time_us":60826}
I20260709 12:18:22.925323 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:22.925482 24173 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:22.922744 26981 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:22.927542 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:22.928318 27066 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:22.928680 24168 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:22.927737 26981 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.929436 26981 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:22.929541 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:22.930212 24172 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:22.930313 24807 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:22.931613 24171 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:22.933022 26899 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.940758 26899 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.943451 26921 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:22.943485 24066 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:22.944082 26921 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:22.944639 26921 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:22.949122 26965 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:18:22.949803 26965 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:22.950326 26965 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:22.932739 27049 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:22.973554 26913 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:22.974545 26913 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:22.975956 26913 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:22.977857 27019 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:22.979717 26878 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:23.007606 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:22.997526 24214 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.015492 26878 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:23.019769 24244 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:23.037317 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 81881.4us
I20260709 12:18:23.037822 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.029209 27019 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.047616 26850 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.049650 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.050136 26850 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.047984 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.051759 24066 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.057554 24169 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:18:23.068240 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44526.4us
W20260709 12:18:23.072685 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 136700us
I20260709 12:18:23.047616 27019 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:23.076764 23997 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 99) took 26092 ms (client timeout 15000 ms). Trace:
W20260709 12:18:23.079038 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.079561 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.089442 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 248) took 1875 ms. Trace:
I20260709 12:18:23.050734 26478 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.093672 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.097066 24171 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:23.072046 27066 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:23.108294 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.109144 24172 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
I20260709 12:18:23.110131 27066 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:23.110683 27066 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:23.102191 24168 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:23.125711 24244 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:23.132738 24092 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:23.093204 26878 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:23.133455 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:23.198297 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 103610us
W20260709 12:18:23.223760 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 210350us
I20260709 12:18:23.092238 24250 rpcz_store.cc:276] 0709 12:18:21.199531 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:22.778330 (+1578799us) service_pool.cc:224] Handling call
0709 12:18:22.779097 (+   767us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:22.779612 (+   515us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:22.921469 (+141857us) log.cc:844] Serialized 14 byte log entry
0709 12:18:23.073458 (+151989us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:23.073540 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:23.074134 (+   594us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:23.074217 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:23.074374 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":156576,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":25105,"thread_start_us":200194,"threads_started":2}
I20260709 12:18:23.135417 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.231485 24169 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:23.139269 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.240890 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:23.243312 26850 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:23.247123 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.249010 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.250532 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.251483 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.252482 24167 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:23.253329 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.256177 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.255510 23994 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:23.257669 23994 catalog_manager.cc:5697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:23.155603 27021 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:23.259435 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:23.259694 27021 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.260104 27021 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.260315 24094 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:23.134052 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.241063 24093 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:23.255573 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.258332 24176 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Committing config change with OpId 6.4: config changed from index -1 to 4, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:18:23.277979 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:23.278504 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.291707 24100 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:23.292315 26478 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:23.294103 26981 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:23.295861 26909 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.516s	user 0.017s	sys 0.006s
I20260709 12:18:23.267398 27046 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.297019 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:23.302692 24175 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:23.304428 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.305105 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:23.309494 24092 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:23.310340 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 67334.1us
I20260709 12:18:23.311856 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.312171 27046 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.311940 26886 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.313303 24141 leader_election.cc:400] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:23.313645 24141 leader_election.cc:403] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:23.314940 24094 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.315022 27024 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:23.315882 27024 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:23.316267 27043 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.317216 27024 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.319113 24171 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:23.323297 27044 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:23.324007 27044 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:23.082690 23997 rpcz_store.cc:269] 0709 12:17:56.926669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:17:56.927283 (+   614us) service_pool.cc:224] Handling call
0709 12:18:23.013567 (+26086284us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:18.176512 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:18.577057 (+400545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:18.577139 (+    82us) write_op.cc:435] Acquired schema lock
0709 12:18:18.577168 (+    29us) tablet.cc:662] Decoding operations
0709 12:18:18.578614 (+  1446us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:18.578729 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:18.578775 (+    46us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:18:18.579886 (+  1111us) tablet.cc:701] Row locks acquired
0709 12:18:18.579948 (+    62us) write_op.cc:260] PREPARE: finished
0709 12:18:18.580196 (+   248us) write_op.cc:270] Start()
0709 12:18:18.580408 (+   212us) write_op.cc:276] Timestamp: P: 1783599498580101 usec, L: 0
0709 12:18:18.580461 (+    53us) op_driver.cc:348] REPLICATION: starting
0709 12:18:18.581442 (+   981us) log.cc:844] Serialized 3596 byte log entry
0709 12:18:19.367180 (+785738us) op_driver.cc:464] REPLICATION: finished
0709 12:18:19.597808 (+230628us) write_op.cc:301] APPLY: starting
0709 12:18:19.607374 (+  9566us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:19.662821 (+ 55447us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:19.678597 (+ 15776us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:19.809719 (+131122us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:19.831576 (+ 21857us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:18:19.831641 (+    65us) write_op.cc:312] APPLY: finished
0709 12:18:19.832030 (+   389us) log.cc:844] Serialized 70 byte log entry
0709 12:18:19.832238 (+   208us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:19.832405 (+   167us) write_op.cc:454] Released schema lock
0709 12:18:19.832464 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:19.832973 (+   509us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:19.833003 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1967237,"reported_tablets":18,"child_traces":[["op",{"apply.queue_time_us":193182,"apply.run_cpu_time_us":6357,"apply.run_wall_time_us":244054,"num_ops":9,"prepare.queue_time_us":311955,"prepare.run_cpu_time_us":16556,"prepare.run_wall_time_us":658014,"raft.queue_time_us":162794,"raft.run_cpu_time_us":4806,"raft.run_wall_time_us":316538,"replication_time_us":610022,"thread_start_us":536656,"threads_started":4,"wal-append.queue_time_us":346826,"wal-append.run_cpu_time_us":13193,"wal-append.run_wall_time_us":1907633}]]}
I20260709 12:18:23.327338 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:23.328351 24245 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:23.328715 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:23.329623 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:23.330549 24241 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:23.332154 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:23.333653 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:23.334357 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.337196 24168 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:23.306349 24807 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:23.298708 27038 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.340097 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:23.336066 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:23.345150 24247 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.345367 24100 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:23.345412 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:23.347402 24244 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:23.336316 26909 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.348886 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:23.349615 24174 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:23.349982 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:23.350869 24245 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:23.351017 26986 tablet_copy_client.cc:538] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:18:23.353955 27019 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:23.354655 27019 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:23.355157 26775 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:23.356393 26775 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:23.356789 26775 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.326723 27044 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.363889 24215 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.369405 24172 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:23.274160 26355 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.369751 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:23.374028 24250 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:23.376350 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.377111 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.350893 26909 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.379189 24173 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:23.380638 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.394126 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:23.382131 27040 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.006s
I20260709 12:18:23.379144 26766 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:23.398212 24094 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:23.398864 24241 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:23.398833 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:23.399717 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.402256 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.395768 24093 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:23.403723 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.404122 26828 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:18:23.406071 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.407609 24780 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.396427 24169 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:23.412101 27038 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.371717 27053 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:23.378304 26886 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:23.416507 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 83638.8us
I20260709 12:18:23.417857 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:23.428382 24167 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:23.414819 26850 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:23.412101 26981 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:23.430493 24097 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:23.432767 24172 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:23.414727 27040 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:23.436240 26878 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:23.447244 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:23.447723 24246 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:23.377810 23994 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.437408 24093 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:23.389771 26965 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.437837 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:23.438534 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:23.439081 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.439205 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:23.420230 27044 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:23.427166 27038 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:23.458367 24245 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:23.461055 24170 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.463900 26850 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.464486 26850 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.467602 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:23.426754 26921 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.474598 24244 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:23.472522 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.453893 27020 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:23.474051 27042 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.569s	user 0.017s	sys 0.010s
I20260709 12:18:23.496543 24242 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:23.501310 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.476383 27038 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:23.502023 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:23.507501 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 89820.8us
I20260709 12:18:23.475265 27044 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:23.504267 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:23.456452 26878 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.520255 24241 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:23.500030 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:23.509454 24216 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.770s (SENT) [suppressed 25 similar messages]
I20260709 12:18:23.530001 24093 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:23.530150 24247 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:23.535596 27019 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:23.536912 24214 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.543485 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.509938 27020 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.558317 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:23.565809 24169 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:23.532467 26828 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:18:23.572341 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.552330 26355 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:23.555456 27049 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:23.588168 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:23.463905 23994 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 4, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 4 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:23.587154 27044 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:23.603300 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 125977us
I20260709 12:18:23.572888 27040 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:18:23.613261 26828 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:23.613950 26828 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:23.614420 26828 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.581243 27053 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:23.575738 26766 raft_consensus.cc:697] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:23.630602 24167 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:23.632526 24170 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:23.620962 26913 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.636674 26913 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.641371 24214 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.626842 27040 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:23.649971 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45788.6us
W20260709 12:18:23.655515 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54658us
I20260709 12:18:23.661437 27055 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:23.662133 27055 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:23.662575 27055 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.663347 27086 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:23.662583 23994 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 6, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:23.665058 23994 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:23.641152 26766 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:23.668519 26878 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.674109 23994 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:23.676534 23994 catalog_manager.cc:5697] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 5 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:18:23.677652 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 96875.1us
I20260709 12:18:23.678040 27021 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.626842 27066 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.682032 26909 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:23.683050 26850 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.683393 27083 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:23.685518 26850 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.685535 27083 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:18:23.692766 24173 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:23.695636 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.697119 26355 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:23.697757 26355 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:23.698938 26355 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.699698 27020 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.699286 26909 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:18:23.701510 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:23.701707 27043 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:23.656234 26921 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:23.661530 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 234842us
I20260709 12:18:23.649205 26965 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.709775 24214 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:23.713477 24097 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:23.719101 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 224842us
I20260709 12:18:23.658936 26478 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:23.734225 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.740559 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.635591 27038 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:23.743029 26913 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.744443 26775 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.746855 26775 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.744875 27021 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:23.752521 24173 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:23.744741 27082 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:23.782881 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:23.783313 27082 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.783910 27082 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:23.784191 24092 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:23.762567 27040 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:23.763576 23994 catalog_manager.cc:5697] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 5. New cstate: current_term: 5 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:23.764870 26810 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:23.763496 24066 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:23.766705 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.794059 24173 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:18:23.769048 24175 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:23.776265 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.735674 26478 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.799358 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.800144 24167 raft_consensus.cc:2376] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8. Re-sending same reply.
I20260709 12:18:23.800211 27021 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.800848 27021 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:23.801184 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.801864 24172 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.802086 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:23.803289 26913 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:23.803722 26913 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:23.804070 26913 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.806344 27090 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:23.779165 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.808156 24170 raft_consensus.cc:2376] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:23.780197 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.781798 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:23.809281 24174 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:23.795657 24169 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:23.796201 23994 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.799599 26478 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:23.777297 27093 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:18:23.822413 27066 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:23.814052 24806 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:23.829344 23994 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 6, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:23.836743 27021 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:23.819767 26965 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:23.837386 27092 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:23.837698 26965 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:23.837880 27092 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:23.838217 26965 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:23.841639 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:23.844870 26775 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:18:23.855641 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.857213 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:23.858016 24172 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:23.858807 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.825701 26828 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:23.857650 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.862370 24169 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.859464 24172 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:23.861492 24092 raft_consensus.cc:2368] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:23.865437 24174 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:23.866417 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.864348 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.866959 24174 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:23.879001 24170 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:23.880954 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.881613 24174 raft_consensus.cc:2376] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7. Re-sending same reply.
I20260709 12:18:23.882382 24097 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:23.884577 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.885545 26986 tablet_bootstrap.cc:492] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:18:23.888942 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.889596 24172 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:23.898146 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.899318 24170 raft_consensus.cc:2376] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9. Re-sending same reply.
I20260709 12:18:23.908986 26810 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:23.839130 27092 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:23.909789 26810 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.910605 27092 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:23.912467 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.913661 24174 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 4: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:23.909855 23994 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 6, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 6 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:23.917833 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.919090 24176 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:23.920409 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.922492 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.923997 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.924600 24167 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:23.925891 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.927260 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.928519 24168 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:23.929437 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.930130 24168 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:23.930418 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.931213 24171 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:23.937172 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.939481 23994 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:23.941699 23994 catalog_manager.cc:5697] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:23.947870 24096 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 12:18:23.950304 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:23.950964 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:23.951754 24094 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:23.951898 24170 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:23.953155 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:23.928269 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:23.957329 24167 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:23.968325 24169 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:23.970968 26810 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:23.972150 27082 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:23.974334 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.975600 24173 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:23.976178 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.957674 26913 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:23.981945 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:23.982651 24176 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:23.943854 23994 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:18:23.993719 27098 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:18:24.000092 26828 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:24.000909 27102 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:18:23.998253 24781 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:24.004213 24242 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
W20260709 12:18:24.004926 27099 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:18:24.014029 27082 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:24.015365 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.016359 24169 raft_consensus.cc:2393] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:24.010743 24244 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:24.015287 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30d4ada45d4b4872986993abc4470158"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:24.018491 24093 raft_consensus.cc:606] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:24.019033 24093 raft_consensus.cc:614] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:24.005712 24092 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:24.019632 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.019632 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.017024 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.021379 24174 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:24.023401 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.025035 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:24.014345 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:24.032748 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.033151 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:24.033777 24099 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.035370 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:24.017958 23994 catalog_manager.cc:5697] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 3, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 3 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:24.039067 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:24.039316 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.040091 24243 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:24.039870 23994 catalog_manager.cc:5697] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 5, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 5 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:24.042307 27094 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:24.043493 27094 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:24.043949 27090 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:24.044047 27094 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:24.044562 27090 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:24.044739 27084 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:24.045835 27090 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:24.047820 27090 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:24.051139 26478 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.030874 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.055522 24245 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:24.041867 23994 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 6, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 6 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:24.077435 24169 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:24.087219 27100 log.cc:927] Time spent T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.147s	user 0.000s	sys 0.002s
I20260709 12:18:24.088729 23994 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 4, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 4 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:24.079970 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.091084 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.091774 24250 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:24.092864 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.094522 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.081030 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.095250 24246 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.095427 24175 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.096890 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.083118 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.067267 24214 leader_election.cc:400] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:24.098953 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.099431 24167 raft_consensus.cc:2376] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:24.085155 24809 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:24.100953 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.099339 24214 leader_election.cc:403] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:18:24.102945 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.103093 26810 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:24.106215 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47272.5us
W20260709 12:18:24.085898 27101 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:18:24.090095 24099 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:24.044752 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.047814 27094 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:24.109427 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.115375 24245 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
W20260709 12:18:24.109685 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.109419 24168 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:24.044055 24066 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:24.120549 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.120704 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.120887 24175 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:24.053501 26478 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:24.122181 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 78215.1us
I20260709 12:18:24.123760 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.124032 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:24.124724 24093 raft_consensus.cc:606] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:24.125223 24093 raft_consensus.cc:614] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:24.125293 24243 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:24.125393 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.130541 24245 raft_consensus.cc:2368] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7.
I20260709 12:18:24.126096 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.126335 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.126621 27052 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:18:24.127879 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.137200 24241 raft_consensus.cc:2368] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:24.138028 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.138269 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.139048 24243 raft_consensus.cc:2368] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:24.139200 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.139905 24241 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:24.139802 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.140645 24243 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:24.140748 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.141458 24241 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:24.128764 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.062892 26913 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:24.131397 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.133265 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:24.145547 24248 raft_consensus.cc:2368] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:24.145574 24245 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.146394 24242 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:24.147783 24242 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:24.133827 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.133081 23994 catalog_manager.cc:5697] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 7, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 7 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:24.141425 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:24.119201 26810 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:24.134544 27089 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:24.153597 24241 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: [5.3-7.4]
I20260709 12:18:24.158562 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:24.154778 24214 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:24.033072 26965 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:24.163975 24242 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:24.175959 24141 leader_election.cc:400] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7.
I20260709 12:18:24.176565 24141 leader_election.cc:403] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:24.178258 24141 leader_election.cc:400] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:24.159868 27089 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:24.179435 27040 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7.
I20260709 12:18:24.179755 27089 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:24.178853 24141 leader_election.cc:403] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:18:24.184187 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:24.185072 27040 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:24.110869 27055 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.177525 23994 catalog_manager.cc:5697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 4, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 4 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:24.202440 24250 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:24.207377 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:24.208555 24096 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:24.211583 24141 leader_election.cc:400] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:24.212108 24141 leader_election.cc:403] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:18:24.212971 27043 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:24.213876 24141 leader_election.cc:400] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:24.214192 24141 leader_election.cc:403] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:24.215724 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.218005 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.218444 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.219250 24168 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:24.218577 24176 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:24.220160 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.221412 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.223347 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.224081 24169 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:24.224936 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.240602 27055 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:24.247136 24176 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
W20260709 12:18:24.250721 24216 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.531s (SENT)
I20260709 12:18:24.251230 24246 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:24.190747 27066 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.193922 26810 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:24.254184 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.191115 26921 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:24.265825 24245 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:24.200173 27040 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:24.299397 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53127.2us
W20260709 12:18:24.300369 24216 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.549s (SENT)
W20260709 12:18:24.307425 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52468.1us
I20260709 12:18:24.252929 26775 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:24.197554 27021 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:18:24.252818 27043 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:18:24.294333 27066 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.292616 26921 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:24.329304 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.330308 24175 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:24.260910 27038 consensus_queue.cc:1059] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:18:24.310854 26810 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:24.350759 24241 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:24.355793 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:24.355857 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 107086us
I20260709 12:18:24.356809 24175 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:24.325827 26921 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:24.313102 26913 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:18:24.394057 24066 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:24.396680 24246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:24.397524 24246 raft_consensus.cc:606] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:24.397982 24246 raft_consensus.cc:614] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:24.413944 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:24.437462 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 181161us
W20260709 12:18:24.423092 27102 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:18:24.438337 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44494.2us
I20260709 12:18:24.342752 27040 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.077s
I20260709 12:18:24.404685 26478 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.442317 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.460282 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:24.508665 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.521173 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.518925 26766 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.524273 26766 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.525465 27066 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:24.488700 26965 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:24.541586 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 51197.9us
I20260709 12:18:24.488746 27113 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:24.504395 27117 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:24.526804 26766 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:24.556535 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 97249.1us
I20260709 12:18:24.493597 27090 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 12:18:24.566397 27092 consensus_meta.cc:287] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.655s	user 0.006s	sys 0.006s
I20260709 12:18:24.556963 27089 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.568449 24092 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:24.564901 27113 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:24.570407 27113 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.565845 24094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:24.572203 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.573238 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:24.573552 24170 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
I20260709 12:18:24.574298 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:24.562219 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:24.546272 27116 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:24.571897 24094 raft_consensus.cc:606] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:24.505746 26478 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.364387 23994 catalog_manager.cc:5697] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 6, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 6 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:24.562381 26965 consensus_queue.cc:1059] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
W20260709 12:18:24.583679 27110 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:18:24.584254 26775 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:24.584858 26775 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:18:24.585667 27109 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:18:24.585950 26775 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.591496 24807 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:24.557353 27117 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:24.527392 27120 consensus_queue.cc:1059] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:18:24.603051 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:24.603793 24097 raft_consensus.cc:606] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:24.601341 24066 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:24.603900 24170 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:24.604172 24097 raft_consensus.cc:614] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:24.505241 26810 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.578487 27040 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:24.581797 26913 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:24.613441 24098 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:24.692556 27040 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:24.577692 27043 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:18:24.661579 26478 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:24.656723 27091 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:24.725538 27091 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:24.726076 27091 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:24.727394 27040 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.666906 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.658382 24809 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:18:24.655201 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 72712us
I20260709 12:18:24.662863 23994 catalog_manager.cc:5697] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 6, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 6 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:24.668529 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.745982 24169 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:24.746971 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.748112 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.749104 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.667790 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.612766 27117 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.670033 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.669203 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.751650 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.671010 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.752419 24168 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:24.670027 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.612854 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:24.631376 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.650949 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:24.669111 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.667160 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.580622 27116 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:24.660657 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:24.695816 26913 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:18:24.700939 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 358604us
I20260709 12:18:24.758700 24171 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:18:24.702476 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54636.5us
I20260709 12:18:24.705969 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.701938 26766 consensus_queue.cc:1059] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:18:24.710796 27131 raft_consensus.cc:3055] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:24.660964 27038 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:18:24.712936 27126 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.188s	user 0.002s	sys 0.000s
W20260709 12:18:24.715677 27108 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260709 12:18:24.692956 27089 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:24.730257 27115 raft_consensus.cc:3055] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:24.772324 27115 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:24.773264 27091 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.773398 27115 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:24.739429 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:24.743448 24066 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:24.758193 24097 raft_consensus.cc:606] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:24.766003 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.766844 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.767509 24170 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:24.769441 26766 raft_consensus.cc:3055] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:24.764873 24099 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
W20260709 12:18:24.903342 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:24.799556 24174 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:25.046872 24172 raft_consensus.cc:2376] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8. Re-sending same reply.
I20260709 12:18:25.040555 24097 raft_consensus.cc:614] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:25.047482 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:24.775461 24167 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:25.046968 24173 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:24.879805 26913 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.051462 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:25.048432 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.054051 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 310700us
W20260709 12:18:25.057734 24067 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.536s (SENT)
I20260709 12:18:25.061474 24066 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:25.058264 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:24.775902 27116 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:24.793012 27052 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.281s
I20260709 12:18:24.763728 27131 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:25.064937 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:25.109066 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 43753.2us
W20260709 12:18:25.109444 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46803.9us
I20260709 12:18:25.067282 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:25.063741 27040 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:18:25.041599 27115 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:25.112329 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47478.7us
I20260709 12:18:25.046060 27117 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:25.070552 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.069424 24101 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:25.067028 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.764848 27038 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:25.124898 27038 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.126434 27038 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.112533 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:25.108382 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.128072 24172 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:25.063287 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.047168 26766 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:25.115661 24169 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.116122 26965 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:25.119109 27042 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:25.119477 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 61778.3us
I20260709 12:18:25.111783 27129 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:25.120213 27123 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:24.896325 23994 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:25.123163 24098 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:25.147017 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:24.898558 27091 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:25.140729 24067 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.544s (SENT)
I20260709 12:18:25.063853 27113 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:25.067804 27128 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:18:25.145717 24216 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.528s (SENT)
I20260709 12:18:24.915946 26921 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.149049 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.062429 27138 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:25.153712 24168 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:25.147754 24171 raft_consensus.cc:2376] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9. Re-sending same reply.
I20260709 12:18:25.158970 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.159770 24172 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:18:25.160396 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 99019.6us
I20260709 12:18:25.151943 26986 tablet_bootstrap.cc:492] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:18:25.140201 27042 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.174183 27042 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:25.176443 24067 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.599s (SENT)
I20260709 12:18:25.152797 27123 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:25.164888 23994 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:25.156929 27129 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.166066 27138 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:25.166929 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.150955 27113 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.172904 24093 raft_consensus.cc:2393] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:25.181911 24216 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.535s (SENT)
I20260709 12:18:25.212702 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:25.189395 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:25.195322 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.171196 27128 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:25.196092 24171 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
W20260709 12:18:25.216213 24067 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.680s (SENT)
I20260709 12:18:25.160207 27116 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:25.222182 24067 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.699s (SENT)
I20260709 12:18:25.223239 24067 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:25.224961 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.225107 24169 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:25.226857 24176 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:25.225787 24171 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:25.215734 27113 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:25.238534 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:25.239850 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:25.239861 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57952us
I20260709 12:18:25.236557 24809 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:25.233860 27121 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:25.241426 26965 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:25.242133 27129 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:25.232426 27089 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:25.247228 27091 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:25.242152 26965 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:25.247771 27138 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:25.264423 24241 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
W20260709 12:18:25.268064 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 44251.7us
I20260709 12:18:25.269516 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.265720 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.273602 24092 raft_consensus.cc:2393] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:25.276228 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:25.276968 24101 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:25.228634 26766 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:25.224359 26828 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:18:25.279633 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:25.255262 27089 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:25.284891 27123 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:25.285320 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 1973) took 1093 ms. Trace:
I20260709 12:18:25.285708 24093 rpcz_store.cc:276] 0709 12:18:24.192004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:24.192181 (+   177us) service_pool.cc:224] Handling call
0709 12:18:25.285047 (+1092866us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b54002d5ad4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:25.285214 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2218044800}
I20260709 12:18:25.286679 26986 tablet_bootstrap.cc:492] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:18:25.286424 27131 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.287705 26986 ts_tablet_manager.cc:1403] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 1.402s	user 0.045s	sys 0.029s
I20260709 12:18:25.287880 27131 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:25.289119 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.289901 24175 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:25.294251 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.295392 24094 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:25.236897 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:25.299541 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.303755 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.320797 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:25.319243 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 103819us
I20260709 12:18:25.327520 24241 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:25.329274 24174 raft_consensus.cc:2410] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:25.332847 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:25.343274 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.349822 24241 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:25.352638 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:25.355229 24216 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.943s (SENT)
I20260709 12:18:25.355731 24216 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:25.357216 24214 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:25.358042 26478 consensus_queue.cc:1059] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:25.358909 26355 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:25.359167 24175 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:25.359355 26355 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:25.359781 26355 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.367579 24241 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:25.373404 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:25.376716 24067 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.847s (SENT)
I20260709 12:18:25.377218 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:25.379958 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.380899 24175 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:25.361819 26965 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:25.383671 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:25.384253 24169 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:25.384311 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.387895 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.388551 24175 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
W20260709 12:18:25.394119 27139 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:18:25.270609 23994 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 6, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:25.395798 27089 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:25.396382 23994 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 6, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:25.383538 26921 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:25.399680 27090 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.400350 27090 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:25.401134 27042 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.340291 27128 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.404923 26766 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:25.412086 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:25.402724 27090 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:25.414577 24101 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:25.417023 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:25.413584 27123 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:25.422320 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:25.420624 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 65439.7us
I20260709 12:18:25.421106 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:25.416030 24067 leader_election.cc:336] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.004s (SENT)
I20260709 12:18:25.426039 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:25.428417 24216 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.567s (SENT)
I20260709 12:18:25.379554 27144 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:25.448029 27042 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:25.448375 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:25.454888 24243 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:25.455646 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:25.456055 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.456472 24249 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:25.415583 26810 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:25.432008 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:25.451521 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:25.466768 24806 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:25.468253 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.452692 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.398274 23994 catalog_manager.cc:5697] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.462548 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:25.470736 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 53837.2us
I20260709 12:18:25.472373 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:25.473870 24172 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:25.431365 27086 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.475081 24093 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:25.478811 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.480545 24169 raft_consensus.cc:2376] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6. Re-sending same reply.
W20260709 12:18:25.483657 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67662.9us
I20260709 12:18:25.504261 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:25.505486 24247 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:25.482734 27042 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:25.478684 27094 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:25.534590 27150 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:18:25.547463 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:25.547899 24067 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.816s (SENT)
I20260709 12:18:25.554229 24092 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:25.555060 24067 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.818s (SENT)
W20260709 12:18:25.551280 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60397.1us
I20260709 12:18:25.447027 26986 raft_consensus.cc:359] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:25.556962 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.568257 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:25.573400 24067 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.040s (SENT)
I20260709 12:18:25.481961 26810 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:25.576944 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 148549us
W20260709 12:18:25.578083 24216 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.646s (SENT)
W20260709 12:18:25.564774 27133 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:18:25.586490 24216 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.685s (SENT)
I20260709 12:18:25.588406 24175 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:25.600862 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:25.566691 26986 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:18:25.611140 24250 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
W20260709 12:18:25.625439 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.630203 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:25.634680 27149 log.cc:927] Time spent T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:18:25.601301 23994 catalog_manager.cc:5697] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 5, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 5 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:18:25.658741 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 85398.9us
I20260709 12:18:25.660570 24249 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:18:25.661171 24067 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.041s (SENT)
I20260709 12:18:25.667526 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:25.668413 24242 raft_consensus.cc:2393] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:25.669718 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:25.667356 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 110516us
I20260709 12:18:25.672225 23994 catalog_manager.cc:5697] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:25.674903 23994 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:25.678013 24169 raft_consensus.cc:2410] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:25.663642 26986 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:25.684543 26986 ts_tablet_manager.cc:1434] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.396s	user 0.012s	sys 0.000s
I20260709 12:18:25.690510 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.690733 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.691463 24171 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:25.691332 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.691588 24170 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:25.692546 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.692605 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.693284 24168 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:25.694057 27145 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:25.710722 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:25.713193 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 126785us
I20260709 12:18:25.707516 26355 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.714179 24096 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:18:25.714133 24216 leader_election.cc:336] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.689s (SENT)
I20260709 12:18:25.716598 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.717406 24175 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:25.718451 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:25.721624 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.721828 24092 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:25.676949 23994 catalog_manager.cc:5697] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 6, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 6 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.727996 27090 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:25.728564 27090 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:25.728950 23994 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.729462 27090 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:25.731729 24242 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:25.733903 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.725561 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:25.736757 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.737442 26355 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:25.740124 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.740888 24096 raft_consensus.cc:2368] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8.
I20260709 12:18:25.734189 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.741644 24170 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:18:25.742190 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.734762 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:25.744292 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 61859.5us
I20260709 12:18:25.745446 24171 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:25.747641 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.747901 27120 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:25.751804 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:25.751641 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:25.752590 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:25.754714 24067 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.902s (SENT)
I20260709 12:18:25.755196 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:25.756311 24067 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.942s (SENT)
I20260709 12:18:25.730896 27123 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:25.760641 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.761653 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-51d85bfbe5fb4a4ba1caf713a20ce874 received from {username='slave'} at 127.0.0.1:59766
I20260709 12:18:25.761739 24249 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:25.762245 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-51d85bfbe5fb4a4ba1caf713a20ce874 on tablet 51d85bfbe5fb4a4ba1caf713a20ce874 with peer c090031f610346ed82285cd847bca6d6
W20260709 12:18:25.762439 27116 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.540s	user 0.014s	sys 0.000s
I20260709 12:18:25.763659 27115 consensus_queue.cc:1059] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:25.764830 27115 raft_consensus.cc:3055] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:25.765177 27115 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:25.766120 27115 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.767616 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.769886 24172 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:25.776948 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.796319 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.776109 27140 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:18:25.774529 27128 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:18:25.730798 23994 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:25.800096 26810 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:25.749212 27129 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:18:25.757364 27121 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:18:25.801143 23994 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 5, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 5 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.757217 26913 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:25.799000 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:25.804487 24095 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:25.805497 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:25.806051 24095 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:25.748934 27161 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:25.837630 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 61598.6us
I20260709 12:18:25.853101 24806 raft_consensus.cc:1217] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 LEARNER]: Deduplicated request from leader. Original: 6.3->[6.4-6.4]   Dedup: 6.4->[]
W20260709 12:18:25.854429 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 98148.1us
I20260709 12:18:25.859769 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:25.863606 24067 leader_election.cc:336] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.047s (SENT)
I20260709 12:18:25.864400 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:25.876113 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.877241 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:25.878296 24807 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
W20260709 12:18:25.879393 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:25.855038 27115 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:25.859141 27161 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:25.866779 26775 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:25.867242 27086 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:25.887919 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:25.876535 27113 consensus_meta.cc:287] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.621s	user 0.008s	sys 0.005s
I20260709 12:18:25.894555 24807 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:18:25.904114 24216 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.770s (SENT)
I20260709 12:18:25.878346 26913 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:25.904695 24241 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:25.892416 27161 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:25.907017 26775 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.916790 26775 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:25.926321 24097 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:18:25.928496 24215 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:25.929659 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 173207us
I20260709 12:18:25.932715 24099 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:25.937644 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:25.886641 27140 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:18:25.962962 27121 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:25.960089 24809 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:25.899253 23994 catalog_manager.cc:5697] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.896166 27113 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:25.906939 27117 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:18:26.022454 23994 catalog_manager.cc:5697] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:25.979458 27042 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.024775 27042 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.025009 23994 catalog_manager.cc:5697] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 4, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 4 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:25.975986 27121 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:26.028113 27121 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:26.030671 24174 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:25.969249 27086 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
W20260709 12:18:26.032461 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 128400us
W20260709 12:18:26.033526 24216 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.780s (SENT)
W20260709 12:18:26.049891 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61305.3us
I20260709 12:18:26.042601 24095 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:26.071245 24249 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:18:26.074101 24216 leader_election.cc:336] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.787s (SENT)
I20260709 12:18:26.074661 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:26.076733 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.081265 26478 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:25.994223 27155 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:26.103654 24214 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:26.104261 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.112356 24094 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:26.114053 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:26.116143 24216 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.804s (SENT)
W20260709 12:18:26.133071 24216 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.818s (SENT)
I20260709 12:18:26.103245 27129 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:26.140482 24067 leader_election.cc:336] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.204s (SENT)
I20260709 12:18:26.141170 24067 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.128475 27155 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:26.127873 27042 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:26.127640 26810 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:26.146864 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.146126 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:26.150812 24216 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.824s (SENT)
I20260709 12:18:26.151399 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.152451 27162 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.153824 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.154642 24172 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:26.155458 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.155828 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.156708 24171 raft_consensus.cc:2410] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:18:26.156754 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.157513 24170 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
W20260709 12:18:26.157603 24216 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.851s (SENT)
I20260709 12:18:26.154637 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.158573 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.158903 24176 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:26.158675 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.158145 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.160627 24175 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:26.160712 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.159674 24172 raft_consensus.cc:2410] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:26.159652 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.165798 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.166443 24170 raft_consensus.cc:2376] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7. Re-sending same reply.
I20260709 12:18:26.160548 27162 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.172283 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.144241 27131 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:26.173126 24175 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:26.204938 24173 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:18:26.207828 24094 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:26.207715 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.209559 24176 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:26.210928 24169 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:18:26.211617 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 54047us
I20260709 12:18:26.214968 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.143345 27129 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.214968 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.215890 24167 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:26.169023 26965 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.216677 24173 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:26.217644 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:26.217640 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:26.219189 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:26.220966 24216 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.879s (SENT)
W20260709 12:18:26.221655 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 81216us
I20260709 12:18:26.221722 24216 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:26.222247 24067 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.535s (SENT)
I20260709 12:18:26.170715 26810 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:26.228192 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.228870 24173 raft_consensus.cc:2376] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6. Re-sending same reply.
I20260709 12:18:26.227257 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.233357 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:26.238273 27129 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.239917 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.240784 24093 raft_consensus.cc:2368] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:26.241561 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:26.242292 24093 raft_consensus.cc:2368] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:26.244920 24250 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:26.244344 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.246953 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:26.248255 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.249557 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:26.250834 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:26.251617 24093 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:26.252636 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:26.253499 24093 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:26.254333 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.255604 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.103819 23994 catalog_manager.cc:5697] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 1 to 4, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 4 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:26.257143 23994 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 5 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:18:26.258416 24067 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.142s (SENT)
I20260709 12:18:26.259060 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:26.259876 27089 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.271616 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.275583 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.276444 24100 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:26.277518 27168 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:26.278291 26810 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.277582 24100 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:26.283528 24098 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:18:26.284910 24097 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:26.288635 26921 raft_consensus.cc:3055] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:26.289088 26921 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:26.232582 27157 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:26.290032 26921 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.290702 27157 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:26.291169 27157 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:26.291201 27042 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.292878 24100 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:26.294554 24100 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:26.297220 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.297847 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.298168 24170 raft_consensus.cc:2410] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:26.298323 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.298477 24171 raft_consensus.cc:2376] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9. Re-sending same reply.
I20260709 12:18:26.299098 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.299355 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.299471 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.299098 24173 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:26.299669 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.300024 27155 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.300669 24170 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:26.301010 24172 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:18:26.301355 24172 pending_rounds.cc:85] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 3
I20260709 12:18:26.301646 24172 pending_rounds.cc:107] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:18:26.301931 24172 raft_consensus.cc:2889] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:26.303025 24168 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:26.313680 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.314430 24170 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:26.318784 24100 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:26.311316 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.214246 27131 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.323307 24097 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:26.324656 23994 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:26.328016 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.321110 24100 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:26.341725 24172 raft_consensus.cc:2376] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7. Re-sending same reply.
I20260709 12:18:26.335223 24170 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
W20260709 12:18:26.335796 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 114868us
I20260709 12:18:26.338182 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:26.344451 24096 raft_consensus.cc:2368] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7.
W20260709 12:18:26.343729 24216 leader_election.cc:336] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.884s (SENT)
I20260709 12:18:26.345191 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:26.347687 24096 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:26.348554 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.346705 26921 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.353286 24097 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:26.356408 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.359557 24173 raft_consensus.cc:2410] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:18:26.355278 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.362366 26965 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:26.346469 27140 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.362686 27172 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:18:26.317374 27089 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:18:26.355168 27161 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:26.368754 24813 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:26.370070 27161 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.363965 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.371711 24168 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.364696 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.373421 24167 raft_consensus.cc:2410] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:26.364270 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.374783 24173 raft_consensus.cc:2368] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
I20260709 12:18:26.375737 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:26.363184 24216 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.135s (SENT)
I20260709 12:18:26.377702 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.379866 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.379966 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.316447 27128 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:18:26.342427 24100 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.383860 24100 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.381508 24170 raft_consensus.cc:2376] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7. Re-sending same reply.
I20260709 12:18:26.387120 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:26.389642 26810 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:26.391064 27172 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:26.391304 24216 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.158s (SENT)
I20260709 12:18:26.391607 27172 raft_consensus.cc:697] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:18:26.392315 24216 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.007s (SENT)
I20260709 12:18:26.392733 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.392612 27172 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:26.393577 26810 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:26.394399 24216 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.007s (SENT)
I20260709 12:18:26.394811 24216 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.411762 26355 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.413796 24173 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:26.363247 27042 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.416838 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.418860 24173 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:26.420207 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.364399 26965 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:26.421289 26965 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:26.421988 24047 auto_rebalancer.cc:629] Failed to schedule move for tablet 3fc81ca349024898b0af873713a28fcb: Illegal state: Replica 5d0f174a97494d0cbf08ae81ec4c807a is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:18:26.426777 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.428669 27148 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:26.429023 27116 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:26.429286 27148 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.430326 27116 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:18:26.431813 27116 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:26.432147 27116 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:26.432987 27116 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:26.364362 23994 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 4, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 4 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:26.436147 27148 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.436316 24809 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:26.439388 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.440099 24167 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:26.440707 27091 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:18:26.417754 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.445277 24171 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:26.446972 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.447633 24173 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:26.448804 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.449680 24168 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:26.451078 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.451298 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.451952 24140 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.434185 27116 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:26.454166 24173 raft_consensus.cc:2410] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:18:26.453500 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.452831 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.456249 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.457530 24171 raft_consensus.cc:2376] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5. Re-sending same reply.
I20260709 12:18:26.458935 24100 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:18:26.459439 24100 pending_rounds.cc:85] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 4
I20260709 12:18:26.459784 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:26.459878 24100 pending_rounds.cc:107] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:18:26.460525 24100 raft_consensus.cc:2889] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:26.460563 24173 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:26.471300 24140 leader_election.cc:400] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8.
I20260709 12:18:26.471779 24140 leader_election.cc:403] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:26.473635 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 84464.4us
I20260709 12:18:26.476316 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:26.481859 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.482873 24168 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:26.483841 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.457738 27148 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:26.488265 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 99177.6us
I20260709 12:18:26.488642 24100 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:18:26.489113 24067 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.491760 27157 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:26.479976 27120 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8.
I20260709 12:18:26.457281 27129 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260709 12:18:26.485108 27131 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.510007 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.515175 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:26.505069 27086 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260709 12:18:26.519603 27182 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:18:26.499586 27147 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:18:26.488464 27121 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:26.554242 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 65211.3us
I20260709 12:18:26.531600 27157 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.555233 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.568413 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50598 (request call id 336) took 1140 ms. Trace:
I20260709 12:18:26.569026 24099 rpcz_store.cc:276] 0709 12:18:25.428147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.428283 (+   136us) service_pool.cc:224] Handling call
0709 12:18:26.568134 (+1139851us) spinlock_profiling.cc:243] Waited 476 ms on lock 0x7b54001f59d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:26.568297 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1094590848}
I20260709 12:18:26.540253 27129 consensus_queue.cc:1243] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:18:26.548805 27148 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:18:26.563583 27162 raft_consensus.cc:1064] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:18:26.556596 27187 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.600389 26355 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:26.606197 27121 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:26.606464 27113 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.607306 26965 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.608566 24096 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:26.610558 26965 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.619727 24092 raft_consensus.cc:1217] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 2.2->[3.3-5.4]   Dedup: 3.3->[5.4-5.4]
I20260709 12:18:26.620373 24092 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: [3.3-5.4]
W20260709 12:18:26.621361 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66219.6us
I20260709 12:18:26.622561 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.623227 27191 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.624362 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:26.628908 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:26.629819 24807 raft_consensus.cc:2368] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:18:26.639189 24215 leader_election.cc:400] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:18:26.639580 24215 leader_election.cc:403] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:18:26.596969 26810 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:18:26.638255 27186 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.645072 27113 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:26.676623 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52364.2us
I20260709 12:18:26.678025 24067 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.683373 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:26.684661 24092 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:26.688269 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:26.691067 26355 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.662683 27145 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:26.693567 27185 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 12:18:26.695230 27181 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.123s	user 0.000s	sys 0.007s
I20260709 12:18:26.700017 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.701519 27042 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:18:26.704298 27184 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:18:26.693033 26965 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:26.711995 26965 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:26.712404 26965 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:26.712606 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:26.715556 24067 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:26.719383 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:26.720959 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.702095 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:26.751856 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49830.2us
I20260709 12:18:26.732227 27117 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:26.759708 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 249816us
W20260709 12:18:26.762564 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:26.768553 27156 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:26.710314 27162 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 2, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:26.780146 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:26.744242 27148 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.781644 24140 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:26.780310 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64827.8us
I20260709 12:18:26.789758 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:26.790927 24172 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:26.791338 24172 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:26.792842 24067 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.759574 27129 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.776373 27147 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.799522 24140 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.782548 27144 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:26.784662 27172 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.785611 27131 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.791612 27104 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:26.803082 27140 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.794127 27148 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.814270 27131 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.779513 27117 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:26.771354 27156 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:18:26.806953 24067 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.802047 27129 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.802546 27144 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:26.829766 27201 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.861153 27187 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.830574 27120 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.810063 27104 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:26.869288 27104 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.827647 27148 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.861397 27144 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:26.803948 27147 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:26.872650 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 119993us
I20260709 12:18:26.795544 27021 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:26.870515 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 63635.1us
I20260709 12:18:26.876004 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:26.876943 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 119377us
I20260709 12:18:26.879218 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.880930 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.881980 26355 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:26.882370 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 86501.6us
I20260709 12:18:26.882582 26355 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:26.883883 26355 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:26.889900 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 90477.2us
I20260709 12:18:26.892594 24216 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.897044 27117 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:26.898934 27145 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:18:26.887441 26766 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:18:26.899952 27203 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:26.906162 27203 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:26.907238 27203 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:26.908564 27129 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.902932 27131 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:26.903755 24216 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:26.923053 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:26.921640 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45708.3us
I20260709 12:18:26.924269 24096 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:26.906330 24172 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:26.925460 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.927345 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.943619 27113 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:26.943972 24098 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:26.893441 27121 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:26.925460 27104 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:26.963501 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 59841.5us
I20260709 12:18:26.964398 24172 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:26.965734 24140 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:26.965775 26355 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:26.943656 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:26.966821 27131 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:26.976240 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:26.964509 27140 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:26.963414 27121 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:26.967216 26766 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.981061 27205 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:18:26.983836 27207 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:26.987670 24813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 401) took 1031 ms. Trace:
I20260709 12:18:26.989097 26478 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:26.989710 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:26.991978 24250 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:27.024425 24242 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:18:27.010849 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45218.8us
I20260709 12:18:26.975646 27129 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:26.967336 27145 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:27.029928 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:27.030591 26355 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:27.011911 27121 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:27.034905 24140 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.023149 24813 rpcz_store.cc:276] 0709 12:18:25.955989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:25.969079 (+ 13090us) service_pool.cc:224] Handling call
0709 12:18:26.022668 (+ 53589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:26.369201 (+346533us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:26.987376 (+618175us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b540067f054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:26.987588 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795357952}
I20260709 12:18:27.047053 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.048730 27207 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.050554 24140 leader_election.cc:400] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 5 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6.
I20260709 12:18:27.051419 26355 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:27.061790 24140 leader_election.cc:400] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:27.059783 27117 consensus_queue.cc:1059] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:18:27.073511 27117 raft_consensus.cc:3055] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:27.073693 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.073989 27117 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:27.073853 26965 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.075145 27117 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:27.075835 24140 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.059171 24172 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 12:18:27.079860 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.082310 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:27.084875 26355 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:27.086438 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:27.086908 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.087124 24093 raft_consensus.cc:606] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:27.084560 27207 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:27.088388 27117 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.089358 26355 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.089913 24248 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:27.091447 24249 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:27.092373 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.089390 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:27.033293 27042 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:27.096861 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:27.100903 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:27.046329 27120 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.043318 27145 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:27.115800 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:27.116685 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:27.095252 26775 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:18:27.115842 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:27.131224 24094 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:27.096081 27042 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:27.132121 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:27.040694 27129 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.135143 27201 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:27.135317 27145 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:27.139367 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:27.154609 24242 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.133072 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:27.155547 24246 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:27.095736 27131 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:27.139307 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47075.2us
I20260709 12:18:27.165714 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.173439 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.143446 27042 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.180713 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:27.141430 26828 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:18:27.177335 27128 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:18:27.205536 24246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:27.197690 27147 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:27.207866 27129 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:27.211632 27216 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:18:27.212307 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:27.214591 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.214478 24811 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:18:27.269629 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.232815 27148 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.234277 26965 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:27.176787 27140 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
W20260709 12:18:27.303524 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 46124.1us
I20260709 12:18:27.303525 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.252650 27104 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:27.245574 24246 raft_consensus.cc:606] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:27.346763 24246 raft_consensus.cc:614] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:27.253301 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 120058us
I20260709 12:18:27.267405 27129 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:27.275046 24101 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:27.240514 24242 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:27.351804 24100 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:27.354249 26355 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:18:27.394025 24100 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:27.371330 27155 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:27.370323 27104 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.418025 27104 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:27.412477 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.421217 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:27.412786 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:27.423574 27228 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:27.424357 27228 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.424669 26886 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:27.426092 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.424932 27228 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:27.421487 27227 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.158s	user 0.004s	sys 0.000s
W20260709 12:18:27.439258 24067 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.582s (SENT)
I20260709 12:18:27.439822 24067 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.409619 27147 consensus_queue.cc:1059] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:27.428062 27129 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:27.446830 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 273558us
I20260709 12:18:27.450505 27147 raft_consensus.cc:3055] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:27.451181 27147 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:27.452452 27147 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.429457 26886 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:18:27.422294 27155 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.461238 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.463840 24098 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
W20260709 12:18:27.464963 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.457312 24140 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:27.471391 24047 auto_rebalancer.cc:629] Failed to schedule move for tablet 988ca15bb1fd49b7822eef733e4a24a3: Illegal state: Replica 729aa4b1ccec48b588c14e67652c61e1 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:27.448076 27191 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.482640 27225 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.483378 27225 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:27.484411 27144 consensus_meta.cc:287] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.591s	user 0.013s	sys 0.000s
I20260709 12:18:27.485041 27144 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.485909 27225 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:27.486526 27147 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.488643 24248 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:27.492445 27155 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:27.494937 24250 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:18:27.493378 24243 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:27.496764 27042 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.499801 24100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "984475bb8f024d469921acdc98196b93"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:27.500561 24100 raft_consensus.cc:606] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:27.500975 24100 raft_consensus.cc:614] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:27.501478 27042 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:27.449647 27203 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260709 12:18:27.506744 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.507467 24097 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:27.506776 24098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:27.508484 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:27.508844 24098 raft_consensus.cc:606] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:27.509855 24093 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:27.502249 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.502919 27121 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.513834 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:27.521207 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:27.525066 24067 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.668s (SENT)
I20260709 12:18:27.511237 24813 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:18:27.523511 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:27.529822 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:27.535668 24246 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:27.538125 24100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:27.540899 24100 raft_consensus.cc:606] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:27.541296 24100 raft_consensus.cc:614] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:27.541170 26355 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:27.546044 24249 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:27.522560 27131 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.532768 27230 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.539160 26478 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:27.548910 26478 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:27.549314 26478 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.526423 27144 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:27.542953 27203 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:27.559769 27203 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:27.562412 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.582999 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:27.560230 27129 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.567528 27203 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.583859 24093 raft_consensus.cc:606] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:27.587132 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 46534.1us
I20260709 12:18:27.583566 24140 leader_election.cc:400] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7.
I20260709 12:18:27.599658 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:27.567912 27116 consensus_queue.cc:1059] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:18:27.602721 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:27.567683 26913 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:18:27.603894 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:27.603183 24140 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.602851 27117 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
W20260709 12:18:27.618142 24067 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.760s (SENT)
I20260709 12:18:27.618920 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.580437 27225 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:18:27.621593 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.578548 27230 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:18:27.629244 27172 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.640111 27120 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.587754 27129 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.600135 27131 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:18:27.606164 27228 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.667656 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:27.673470 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 51979.8us
I20260709 12:18:27.662593 27201 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:27.686121 27201 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:27.687286 27201 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.690122 27228 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:27.692209 27225 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:27.692745 27225 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:27.693348 27129 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:27.683063 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.684345 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.695763 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:27.685463 24067 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:27.699478 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.699486 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.699786 24067 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.703187 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.703394 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:27.704054 24093 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:27.705607 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.706394 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.709738 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.710664 24097 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:27.708381 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.707497 24096 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:27.706499 24093 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:27.714178 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:27.671041 27239 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:27.719825 27239 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.720238 27239 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.722014 27191 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.728155 27090 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.728722 27090 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:27.718869 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.740447 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.741683 24094 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:27.742136 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:27.742959 24170 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:27.747596 24173 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:18:27.754812 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:27.803992 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 85229us
I20260709 12:18:27.712563 27172 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:27.726842 26913 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:27.819011 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:27.820235 24175 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:27.753415 24096 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:18:27.806475 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:27.807109 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:27.814802 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:27.803992 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 44656.9us
I20260709 12:18:27.822599 24172 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:27.834964 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:27.844000 24172 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:27.850961 24171 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:27.808807 27172 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:27.852389 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:27.853744 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:27.861094 24171 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:27.854009 24175 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:18:27.865765 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:27.693936 27225 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.866833 24140 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.818507 26913 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:27.863850 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:27.927188 24172 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:27.821412 27113 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.940096 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:27.941327 24175 raft_consensus.cc:2410] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:18:27.940021 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:27.948750 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 82034.4us
I20260709 12:18:27.949741 24140 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.951030 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.877889 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:27.804616 27120 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:27.958425 24171 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:27.961159 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:27.967346 24167 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:27.967367 24096 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.968402 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:27.842702 27090 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:27.854470 27206 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:27.855540 27190 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.854600 27218 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:27.960659 26913 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:27.974323 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:28.006628 24175 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:27.975447 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:27.854346 27208 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:27.832620 27140 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:27.876443 27191 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:27.974094 27131 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.852980 26478 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:28.019665 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:28.024045 27205 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.973887 27207 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:27.983922 27116 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:27.852625 27172 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:27.851727 27128 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.161s
I20260709 12:18:27.999450 27218 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:28.018347 27206 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:28.004776 27190 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:27.972393 27120 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:28.069789 27116 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:27.853210 27115 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.225s
I20260709 12:18:28.076329 27131 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:27.806165 27145 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Committing config change with OpId 6.5: config changed from index 4 to 5, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:28.093351 24175 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
W20260709 12:18:28.068276 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 107215us
I20260709 12:18:28.149425 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:28.113579 27120 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:28.116516 27239 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:28.100441 27116 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:28.179495 27113 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:28.202255 24175 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:28.208073 24175 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:28.151569 24216 leader_election.cc:400] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 4 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 4. Current term is 5.
W20260709 12:18:28.211629 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 60257.4us
I20260709 12:18:28.043433 27191 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:28.202705 27242 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.395s	user 0.000s	sys 0.002s
I20260709 12:18:28.231560 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:28.268142 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.216104 27113 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:28.301262 27206 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:28.202369 27205 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:28.213761 27218 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:28.408238 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 439883us
W20260709 12:18:28.408957 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:28.427111 24140 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:28.446283 24096 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:28.405432 27140 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:28.453802 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 241034us
I20260709 12:18:28.457521 24216 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:28.441895 24813 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:28.467465 24216 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:28.475343 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48150us
I20260709 12:18:28.477942 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:28.461050 27218 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:28.454334 26478 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:28.526652 27250 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:18:28.496426 27156 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:28.530793 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 63450us
I20260709 12:18:28.597498 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:28.703594 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 106164us
I20260709 12:18:28.594532 27128 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.468374 27140 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:28.732937 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:28.741716 27253 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:28.747820 27264 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:28.748243 27255 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:28.748714 27255 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.748545 27264 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:28.749123 27255 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:28.749229 27252 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260709 12:18:28.750018 27256 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:28.750481 27256 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:28.750840 27256 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:28.751353 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1840) took 1005 ms. Trace:
I20260709 12:18:28.753480 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1843) took 1006 ms. Trace:
I20260709 12:18:28.754002 24174 rpcz_store.cc:276] 0709 12:18:27.747402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.747534 (+   132us) service_pool.cc:224] Handling call
0709 12:18:27.747865 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.807120 (+ 59255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.807174 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.829578 (+ 22404us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.249244 (+419666us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:28.702109 (+452865us) log.cc:844] Serialized 14 byte log entry
0709 12:18:28.753028 (+ 50919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.753140 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.753201 (+    61us) raft_consensus.cc:1685] finished
0709 12:18:28.753220 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.753402 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":282521,"prepare.queue_time_us":276027,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":61528,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":7116,"thread_start_us":529035,"threads_started":2,"wal-append.queue_time_us":582240}
I20260709 12:18:28.765194 27247 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:28.715786 26478 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:28.751861 24168 rpcz_store.cc:276] 0709 12:18:27.745540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.745687 (+   147us) service_pool.cc:224] Handling call
0709 12:18:27.746085 (+   398us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.819094 (+ 73009us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.819169 (+    75us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.829924 (+ 10755us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.091833 (+261909us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:28.241619 (+149786us) log.cc:844] Serialized 14 byte log entry
0709 12:18:28.241891 (+   272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.241986 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.751057 (+509071us) raft_consensus.cc:1685] finished
0709 12:18:28.751083 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.751265 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":60666,"prepare.queue_time_us":382533,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":63,"raft.queue_time_us":513584,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":52023,"thread_start_us":263822,"threads_started":2,"wal-append.queue_time_us":316957}
I20260709 12:18:28.712339 27269 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:28.789044 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50679.6us
I20260709 12:18:28.738822 27259 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:28.765854 27247 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:28.922628 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1844) took 1057 ms. Trace:
I20260709 12:18:28.929382 27292 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:28.928169 24173 rpcz_store.cc:276] 0709 12:18:27.808774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.809143 (+   369us) service_pool.cc:224] Handling call
0709 12:18:27.820111 (+ 10968us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.820690 (+   579us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.820727 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.821374 (+   647us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.148942 (+327568us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:28.437367 (+288425us) log.cc:844] Serialized 14 byte log entry
0709 12:18:28.445320 (+  7953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.445404 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:28.866061 (+420657us) raft_consensus.cc:1685] finished
0709 12:18:28.866102 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:28.866318 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62175,"prepare.queue_time_us":375900,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":311216,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":11089,"thread_start_us":391523,"threads_started":2,"wal-append.queue_time_us":436787}
I20260709 12:18:28.930266 27292 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:28.931350 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 453535us
I20260709 12:18:28.735651 27156 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.096s
W20260709 12:18:28.934087 24067 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.948s (SENT)
I20260709 12:18:28.941298 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:28.940596 24139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.008s	sys 0.032s
W20260709 12:18:28.943398 24139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.008s	sys 0.032s
I20260709 12:18:28.856077 26965 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:28.740202 27128 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:29.006405 24175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.021s	sys 0.015s
W20260709 12:18:29.008229 24175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.021s	sys 0.015s
W20260709 12:18:29.008773 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 76203.5us
I20260709 12:18:28.939492 27247 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:29.018604 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 154780us
I20260709 12:18:28.858472 26478 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.033833 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.034840 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:29.035118 24176 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.006s	sys 0.024s
I20260709 12:18:28.729379 27191 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:29.038275 24176 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.007s	sys 0.025s
I20260709 12:18:29.007563 27113 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.050349 27279 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:28.761544 27264 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:28.919595 27259 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:28.773166 27253 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.064828 27293 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.065512 27293 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.064828 27281 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.067854 27281 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.070196 27281 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.084311 27281 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:29.073189 27128 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.007167 26965 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.075402 27259 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.075750 27117 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:29.077374 27172 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.988s	user 0.012s	sys 0.000s
I20260709 12:18:29.077718 27257 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:29.080171 27264 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:29.081384 26913 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.056s	user 0.010s	sys 0.002s
W20260709 12:18:29.081714 27265 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
W20260709 12:18:29.082387 27270 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:18:29.071349 27292 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.086802 27272 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.088272 27140 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.059017 27113 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:29.089800 27203 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.499s	user 0.019s	sys 0.005s
W20260709 12:18:29.090134 27260 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:18:29.090456 27084 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:29.038024 27283 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:29.019726 27205 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 12:18:29.063294 27145 consensus_meta.cc:287] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.942s	user 0.021s	sys 0.001s
I20260709 12:18:29.056200 27279 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:29.125943 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 191878us
I20260709 12:18:29.127785 27206 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:29.062111 27277 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:29.092445 27191 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:29.133800 26965 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.134344 27286 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:18:29.134931 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1442) took 1283 ms. Trace:
I20260709 12:18:29.136065 26478 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.130550 27128 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:29.137023 27296 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:29.139380 27117 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.140702 27155 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:29.143976 27157 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:29.144869 27293 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.150015 27264 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.129107 27281 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:29.159612 27121 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:29.269356 24067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.718s (SENT) [suppressed 68 similar messages]
W20260709 12:18:29.269421 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 234657us
I20260709 12:18:29.270309 24171 rpcz_store.cc:276] 0709 12:18:27.851867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.000266 (+148399us) service_pool.cc:224] Handling call
0709 12:18:28.000607 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.240499 (+239892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.240556 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.388021 (+147465us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.941281 (+553260us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:29.016924 (+ 75643us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.032802 (+ 15878us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.032928 (+   126us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.134628 (+101700us) raft_consensus.cc:1685] finished
0709 12:18:29.134660 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.134849 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21908,"prepare.queue_time_us":77884,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":157143,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":30964,"spinlock_wait_cycles":4465024,"thread_start_us":713270,"threads_started":2,"wal-append.queue_time_us":604414}
W20260709 12:18:29.207736 27218 consensus_meta.cc:287] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.644s	user 0.018s	sys 0.000s
I20260709 12:18:29.243436 27279 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:29.235219 27113 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:29.298455 27244 log.cc:927] Time spent T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 1.221s	user 0.005s	sys 0.005s
I20260709 12:18:29.303490 27147 raft_consensus.cc:3055] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:29.305241 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1443) took 1453 ms. Trace:
I20260709 12:18:29.379601 24172 rpcz_store.cc:276] 0709 12:18:27.852127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.008770 (+156643us) service_pool.cc:224] Handling call
0709 12:18:28.009236 (+   466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.009692 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.009744 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.020562 (+ 10818us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.213697 (+193135us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:28.436858 (+223161us) log.cc:844] Serialized 14 byte log entry
0709 12:18:28.480291 (+ 43433us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:28.480410 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.304977 (+824567us) raft_consensus.cc:1685] finished
0709 12:18:29.305016 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.305167 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35005,"prepare.queue_time_us":311361,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":419568,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":137,"thread_start_us":195193,"threads_started":3,"wal-append.queue_time_us":456071}
W20260709 12:18:29.307546 27248 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.873s	user 0.012s	sys 0.008s
W20260709 12:18:29.308992 27254 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.276s	user 0.001s	sys 0.001s
I20260709 12:18:29.312072 27224 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:29.312209 27190 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.398763 24809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 281) took 1766 ms. Trace:
I20260709 12:18:29.399292 27190 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:29.400013 27190 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.401654 27113 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.270738 27206 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.404819 27206 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.316622 27307 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.399315 24809 rpcz_store.cc:276] 0709 12:18:27.632056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.632243 (+   187us) service_pool.cc:224] Handling call
0709 12:18:27.632622 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.633044 (+   422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.633077 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.633628 (+   551us) log.cc:844] Serialized 26 byte log entry
0709 12:18:27.825940 (+192312us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:27.828443 (+  2503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:27.847373 (+ 18930us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.294255 (+1446882us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:29.390856 (+ 96601us) raft_consensus.cc:1685] finished
0709 12:18:29.390889 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.398662 (+  7773us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":312,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":102612864,"thread_start_us":169776,"threads_started":1,"wal-append.queue_time_us":336181}
I20260709 12:18:29.405731 27307 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.406383 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.287629 27294 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.157s
I20260709 12:18:29.408397 27307 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.320353 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:29.328815 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:29.409636 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 89438.9us
W20260709 12:18:29.409839 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.228772 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1448) took 1375 ms. Trace:
W20260709 12:18:29.227659 27217 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.422s	user 0.025s	sys 0.096s
I20260709 12:18:29.410890 27298 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:29.155984 26913 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.411698 27298 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:29.412101 27298 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:29.413472 26913 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.341100 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.149518 27172 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.332492 27207 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.226148 27269 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:29.358963 27116 consensus_meta.cc:287] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.138s	user 0.008s	sys 0.013s
I20260709 12:18:29.377065 27293 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:29.150857 27257 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.356842 27191 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:29.432902 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.357515 27148 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:29.375233 27208 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.315s	user 0.019s	sys 0.062s
I20260709 12:18:29.386255 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.369673 27228 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:29.390365 27274 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:29.391129 27308 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:29.391391 27117 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.211445 27272 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.374583 27157 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.466472 27156 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.472462 27272 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.471997 27156 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.472980 27157 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.473284 27259 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:18:29.474349 27113 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:29.446244 27148 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.475033 27156 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.466766 26886 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:29.476199 27281 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.476409 26886 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.477005 27148 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.429405 26965 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:18:29.478505 26965 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:29.474753 27113 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:29.433135 27116 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.393913 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:29.394524 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:29.484072 24097 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:29.395521 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:29.397176 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:29.485112 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.378881 27168 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:29.399344 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:29.407214 27279 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.229954 27302 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:29.235062 27203 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.332018 27128 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.420486 27239 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.420863 27172 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:29.411219 27217 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.656s	user 0.030s	sys 0.104s
I20260709 12:18:29.410841 24175 rpcz_store.cc:276] 0709 12:18:27.853598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:28.210386 (+356788us) service_pool.cc:224] Handling call
0709 12:18:28.210763 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.214500 (+  3737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.214596 (+    96us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.215512 (+   916us) log.cc:844] Serialized 26 byte log entry
0709 12:18:29.008783 (+793271us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:29.055298 (+ 46515us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.228294 (+172996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.228408 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.228464 (+    56us) raft_consensus.cc:1685] finished
0709 12:18:29.228477 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.228682 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97938,"prepare.queue_time_us":46514,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":62,"raft.queue_time_us":491164,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":16179,"thread_start_us":731748,"threads_started":2,"wal-append.queue_time_us":775359}
W20260709 12:18:29.426848 24096 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1657) took 1562 ms (client timeout 1744 ms). Trace:
I20260709 12:18:29.382025 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:29.243187 27084 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:29.385810 27255 consensus_meta.cc:287] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.004s
I20260709 12:18:29.579264 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.402213 27190 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.379477 27147 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:29.337383 27296 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.445443 27257 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:29.448503 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:29.429091 27207 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.593910 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.594596 24245 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
W20260709 12:18:29.446306 27208 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.394s	user 0.019s	sys 0.062s
I20260709 12:18:29.594821 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.595331 27208 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:29.595757 27207 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.596863 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.597688 24250 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:29.453936 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:29.452600 27042 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:29.599004 27042 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.470551 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:29.480844 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 211557us
W20260709 12:18:29.393251 27243 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 1.314s	user 0.010s	sys 0.004s
I20260709 12:18:29.483958 24094 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:29.485172 24093 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:29.525440 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:29.527377 24092 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:29.525792 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:29.603832 24097 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:29.532874 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 64351.7us
W20260709 12:18:29.604199 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 78564.3us
I20260709 12:18:29.538618 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:29.463801 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.605635 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:29.490396 27254 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:29.606791 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.478919 26965 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:29.546759 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:29.535867 27256 consensus_meta.cc:287] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.784s	user 0.009s	sys 0.004s
I20260709 12:18:29.445695 27304 consensus_queue.cc:1059] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 12:18:29.528373 27104 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:29.566674 24096 rpcz_store.cc:269] 0709 12:18:27.864562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.865478 (+   916us) service_pool.cc:224] Handling call
0709 12:18:29.426652 (+1561174us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540031a1d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:29.426777 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231916416}
I20260709 12:18:29.634116 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:29.635354 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:29.635964 24096 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:29.636848 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:29.572698 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 190760us
I20260709 12:18:29.453642 27191 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.536763 27218 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:29.468210 27228 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.243436 27283 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.660063 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.660857 24245 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:29.661550 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.662465 24248 raft_consensus.cc:2410] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:29.588536 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.479576 27269 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.601990 24169 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:29.449225 27155 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:29.478881 26886 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.606561 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.672461 24246 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:29.541651 27168 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.544759 27302 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.584656 27121 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:29.680991 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.480964 27274 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.617627 26965 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.618268 27042 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:29.619223 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.473094 27301 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.203s
W20260709 12:18:29.628294 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.628633 27296 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.669924 27294 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:29.629791 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1845) took 1804 ms. Trace:
I20260709 12:18:29.700882 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:29.631415 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1659) took 1766 ms. Trace:
I20260709 12:18:29.575083 27113 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.587800 27253 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:29.639058 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 130006us
I20260709 12:18:29.425599 27224 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.640900 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:29.630759 27313 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:18:29.661775 27218 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.467947 27293 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.718648 27281 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:29.725589 27113 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:29.726205 24096 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:29.663539 24247 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:29.614220 27190 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.620711 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.699726 26965 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:29.669210 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:29.735620 24093 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:29.606719 27172 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:29.672971 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.707227 27279 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:29.674185 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.677942 24095 raft_consensus.cc:2410] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:29.678097 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.678618 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.683656 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.596776 27208 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.742050 24244 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:29.614146 27299 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:29.696816 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:29.629448 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1838) took 1885 ms. Trace:
I20260709 12:18:29.680168 27205 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:29.656378 27104 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.700268 24176 rpcz_store.cc:276] 0709 12:18:27.825393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.825885 (+   492us) service_pool.cc:224] Handling call
0709 12:18:27.925357 (+ 99472us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.948377 (+ 23020us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.948413 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.949010 (+   597us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.143561 (+194551us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:28.342435 (+198874us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.041218 (+698783us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.041280 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.308171 (+266891us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:29.629448 (+321277us) raft_consensus.cc:1685] finished
0709 12:18:29.629575 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.629716 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24643,"prepare.queue_time_us":380835,"prepare.run_cpu_time_us":165,"prepare.run_wall_time_us":165,"raft.queue_time_us":382530,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":15456,"spinlock_wait_cycles":10688384,"thread_start_us":907752,"threads_started":3,"wal-append.queue_time_us":462288}
I20260709 12:18:29.705750 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:29.706634 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:29.680609 27264 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.681154 27217 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:29.682590 27168 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.656152 24140 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:29.532230 27308 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:29.701658 24101 rpcz_store.cc:276] 0709 12:18:27.865304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.866775 (+  1471us) service_pool.cc:224] Handling call
0709 12:18:27.961693 (+ 94918us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:28.132511 (+170818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:28.132560 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:28.154208 (+ 21648us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.461146 (+306938us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:28.858722 (+397576us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.269635 (+410913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.630896 (+361261us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54003bf6d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:29.630945 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.631005 (+    60us) raft_consensus.cc:1685] finished
0709 12:18:29.631126 (+   121us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.631313 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":280525,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":190561,"raft.run_cpu_time_us":372,"raft.run_wall_time_us":12766,"spinlock_wait_cycles":391658752,"thread_start_us":825810,"threads_started":3,"wal-append.queue_time_us":438113}
I20260709 12:18:29.636399 27256 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.766062 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.766187 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:29.723080 24094 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:29.723647 27289 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:29.726652 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.587636 27255 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.725442 27281 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.733865 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.689980 26886 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:18:29.699373 27121 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:29.621351 27207 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:29.688994 24248 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:29.744845 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:29.746846 24241 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:29.749774 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:29.747090 24170 rpcz_store.cc:276] 0709 12:18:27.743991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.744098 (+   107us) service_pool.cc:224] Handling call
0709 12:18:27.744413 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:27.823270 (+ 78857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:27.823324 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:27.847327 (+ 24003us) log.cc:844] Serialized 26 byte log entry
0709 12:18:28.036277 (+188950us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:29.306664 (+1270387us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:29.628716 (+322052us) spinlock_profiling.cc:243] Waited 937 us on lock 0x7b180001dbc0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c08f733c7 00007f4c055859a7 00007f4c055950bf
0709 12:18:29.628881 (+   165us) log.cc:844] Serialized 14 byte log entry
0709 12:18:29.629123 (+   242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:29.629209 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:29.629252 (+    43us) raft_consensus.cc:1685] finished
0709 12:18:29.629264 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:29.629385 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85209,"prepare.queue_time_us":418953,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":75,"raft.queue_time_us":63804,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":15412,"spinlock_wait_cycles":27865216,"thread_start_us":417149,"threads_started":2,"wal-append.queue_time_us":443400}
I20260709 12:18:29.735620 27190 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:29.759864 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 103809us
I20260709 12:18:29.763818 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:29.753712 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.719800 27294 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.743050 27203 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:29.770995 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:29.752795 27247 consensus_meta.cc:287] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.717s	user 0.014s	sys 0.000s
I20260709 12:18:29.754025 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:29.743839 27172 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:29.741202 27155 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:29.699384 26913 consensus_queue.cc:1175] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" responder_term: 7 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:18:29.727425 27259 consensus_queue.cc:1175] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" responder_term: 10 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:18:29.850185 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:29.933821 24095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:29.845796 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.129118 24100 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
W20260709 12:18:29.893908 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:30.131179 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.077359 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.127976 24095 raft_consensus.cc:606] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:30.133206 24095 raft_consensus.cc:614] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:29.992365 27289 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.134181 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.126168 24247 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:30.136772 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:30.138531 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.143793 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.145633 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.146211 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.146399 24168 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:30.146525 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.090013 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.138312 24169 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:30.147044 24175 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:29.770254 27264 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:30.086624 27090 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:30.142050 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.153728 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.751552 27238 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:29.966390 27315 log.cc:927] Time spent T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.279s	user 0.001s	sys 0.001s
I20260709 12:18:30.149040 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:30.149778 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:30.151100 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:30.152716 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.155053 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:30.172819 24173 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.086314 27201 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.148013 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.154563 24096 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:30.191452 24779 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:29.910907 27272 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.153738 24172 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:29.904856 27084 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.809221 27128 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.158005 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:29.891897 27239 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:29.754065 27205 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:29.938123 27244 log.cc:927] Time spent T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:18:30.149010 24092 raft_consensus.cc:2410] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:18:30.086236 27298 consensus_meta.cc:287] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.674s	user 0.018s	sys 0.001s
W20260709 12:18:30.008490 27316 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260709 12:18:30.160493 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.163568 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.166085 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.226531 24248 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:29.762604 27217 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.166390 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:30.237254 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70966.7us
I20260709 12:18:30.239050 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:30.240129 27129 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:30.240236 24140 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:30.240633 27129 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:30.241076 27129 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:29.930210 27257 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.241930 27257 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.177393 27238 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.243346 27253 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:30.243831 27253 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.244211 27253 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.245568 27238 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.171841 24169 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.171809 24175 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:30.204617 27259 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:30.176529 24093 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:30.177230 24098 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.155498 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.256963 24095 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:30.179117 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.179293 27274 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.116179 27308 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.959515 27283 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:30.075941 27224 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.094460 27206 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 12:18:29.880363 26775 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:30.227808 27116 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.185381 27255 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.206969 27272 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.128014 27228 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.188129 24099 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:30.188373 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.116420 27304 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:29.875615 27168 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.193811 24170 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:30.346057 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:30.197981 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.157377 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:29.905066 27191 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:29.851732 27302 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:30.135082 27207 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.089537 27256 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.893293 27293 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:30.206169 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:30.217128 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.220299 24092 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:30.154742 27264 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:30.230012 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:30.226305 24176 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 3.
I20260709 12:18:30.166375 24241 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:30.204252 26766 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:30.208595 27086 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:30.155550 27247 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.354147 27168 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.392333 27247 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:30.241180 27131 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:30.393095 27131 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.393494 27131 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:30.393639 27172 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.205026 27251 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:30.395079 27281 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:29.995564 27147 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.395355 27251 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:30.396062 27147 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.397708 27251 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:30.204813 27203 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:30.174310 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.398411 27203 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.400238 27218 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:30.400664 27203 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:30.225310 24094 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:18:30.402561 27113 consensus_meta.cc:287] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.672s	user 0.017s	sys 0.001s
I20260709 12:18:30.177824 27090 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:30.354485 27207 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:30.232235 27104 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:30.184772 27292 raft_consensus.cc:3055] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:30.161770 27289 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.384598 27086 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:30.286111 24175 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:30.235034 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:30.186203 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:30.272146 26965 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.529s	user 0.012s	sys 0.000s
I20260709 12:18:30.215987 27239 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.328622 24169 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:29.768762 27299 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.335709 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.232481 27298 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:30.347100 24172 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:30.353224 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.452988 24170 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:30.274392 27274 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:30.327221 26775 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.382968 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:30.383548 27264 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.466758 24241 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.315410 27224 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:30.387539 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 157651us
I20260709 12:18:30.417224 27257 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:30.417618 27289 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.434943 27256 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:30.392606 27293 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:30.258402 24247 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:30.403292 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.261564 24173 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:30.258440 24101 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:30.270364 27259 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.291700 27283 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:30.406975 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:30.494421 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 87525.8us
I20260709 12:18:30.414461 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.414804 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.415550 24093 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:18:30.419507 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.428416 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.407608 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.402590 24097 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:30.412740 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:30.418408 24811 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:30.383876 26766 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.450482 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:30.410048 27168 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.416486 27086 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:30.277010 27121 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:30.389477 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 183349us
I20260709 12:18:30.431407 27084 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:30.415426 27292 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:30.471509 24066 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:30.500365 24243 raft_consensus.cc:2376] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8. Re-sending same reply.
W20260709 12:18:30.547106 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 76174.4us
I20260709 12:18:30.547595 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:30.548323 24066 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:30.470039 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 228774us
I20260709 12:18:30.415971 27205 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:30.334954 27129 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:30.356117 27304 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.488420 24813 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:30.414280 27090 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.490144 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.516049 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.498667 24175 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
W20260709 12:18:30.493393 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.500000 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1665) took 1082 ms. Trace:
I20260709 12:18:30.519709 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.568301 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:30.540076 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 44040.3us
I20260709 12:18:30.541640 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.544283 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:30.570159 24092 raft_consensus.cc:2376] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8. Re-sending same reply.
I20260709 12:18:30.545274 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.549592 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:30.562264 24066 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:30.551436 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:30.552572 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.553524 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:30.493502 27269 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.000s	sys 0.032s
I20260709 12:18:30.491201 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.576226 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.578438 24246 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:30.485680 27217 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:30.489982 27281 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:30.577033 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:30.566393 24097 rpcz_store.cc:276] 0709 12:18:29.417125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.996034 (+578909us) service_pool.cc:224] Handling call
0709 12:18:30.402218 (+406184us) spinlock_profiling.cc:243] Waited 4.64 ms on lock 0x7b5800002798. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456eee 000000000036eb39 00007f4c0a4ca1e0 00007f4c0a5930c4 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:30.402395 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.499653 (+ 97258us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.499923 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10951808}
I20260709 12:18:30.564119 24249 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:30.583536 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:30.583707 27113 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:30.495651 27190 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.469564 27274 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.587181 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:30.587431 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.592603 27113 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.585547 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.601965 24248 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:30.610710 24097 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
W20260709 12:18:30.611548 24215 consensus_peers.cc:597] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b29f161fe0e24b51ad5c1903bdc5112c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:18:30.611982 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.586333 24099 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.613401 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.553942 27084 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:30.597757 24242 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:30.592092 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:30.607100 24093 raft_consensus.cc:2393] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:30.558869 27168 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:30.578265 27269 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.000s	sys 0.033s
I20260709 12:18:30.564805 26965 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:30.488186 27224 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.495541 27256 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.513204 24241 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:30.617071 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:30.652851 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:30.620484 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 50936.2us
I20260709 12:18:30.652364 24247 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:30.559824 27286 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:30.588243 26775 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.673116 24097 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.663543 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:30.685962 24172 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:30.583595 27120 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:30.591302 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:30.664124 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.603080 27239 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.546164 27283 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.657898 27168 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.617939 27113 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.619897 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:30.690474 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.679184 27286 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.671070 26965 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:30.621872 27084 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:30.707691 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:30.709474 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2073) took 1019 ms. Trace:
I20260709 12:18:30.621348 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:30.596788 27281 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:30.719334 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 102202us
I20260709 12:18:30.744005 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:30.712075 24172 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:30.718492 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:18:30.729187 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.695746 27191 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:30.745764 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:30.746337 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:30.713277 27168 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.757427 24098 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:30.759581 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:18:30.760746 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 140947us
I20260709 12:18:30.761842 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:30.764264 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:30.766033 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 250582us
I20260709 12:18:30.704411 27120 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:30.776726 24169 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.725472 27286 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:30.752888 24172 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:30.781939 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:30.690102 27330 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:30.691612 27257 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:18:30.719564 27299 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.784029 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:30.724421 26965 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:30.784709 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:30.784279 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:30.738996 27272 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.794654 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:30.748693 24099 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:30.726092 27301 consensus_queue.cc:1059] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:18:30.774123 27255 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:30.814692 24241 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:30.804544 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.816138 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.817042 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.817225 24242 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:30.817703 24099 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:30.818475 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.804606 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:30.819432 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.820250 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.797140 27330 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.809367 27274 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.810407 27190 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:30.795675 26913 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:30.810230 27191 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:30.810748 27293 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:30.779022 27333 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:30.811712 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.812721 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.813704 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.844712 24247 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:30.849699 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.853662 24169 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:30.855898 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.859241 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.860738 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.861567 24172 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:30.862397 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.863161 24172 raft_consensus.cc:2393] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:30.787621 27042 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
I20260709 12:18:30.814076 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:30.792682 27331 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:30.821329 26766 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:30.824601 24140 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:30.805691 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1554) took 1069 ms. Trace:
I20260709 12:18:30.826812 24067 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:30.827646 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.816156 27218 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:30.828261 27330 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.772606 27205 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:18:30.796707 27239 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:18:30.774863 27325 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:30.773998 27326 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:30.804621 27329 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:30.839885 27327 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:18:30.840114 27269 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:30.877349 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:30.877365 24141 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:30.868397 24176 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
W20260709 12:18:30.903942 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 99446.1us
I20260709 12:18:30.868728 24243 rpcz_store.cc:276] 0709 12:18:29.736116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.575818 (+839702us) service_pool.cc:224] Handling call
0709 12:18:30.576192 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.576515 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:18:30.668436 (+ 91921us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.805176 (+136740us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:30.805233 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:30.805399 (+   166us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.805495 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.805620 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18943,"prepare.queue_time_us":105061,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":8519,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":10646,"thread_start_us":128113,"threads_started":1,"wal-append.queue_time_us":160325}
I20260709 12:18:30.883481 24248 raft_consensus.cc:2393] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:30.904820 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:30.891942 27308 consensus_queue.cc:1059] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:18:30.894017 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 69505.9us
W20260709 12:18:30.889501 27328 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.134s	user 0.003s	sys 0.000s
I20260709 12:18:30.844668 26913 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:30.900349 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 73599us
I20260709 12:18:30.857290 27259 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.910650 24141 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:30.960151 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 49590us
I20260709 12:18:30.842423 27255 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:30.916795 26965 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:30.909148 27269 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:30.969328 27269 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:30.918030 27307 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:30.969424 26965 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.971211 27283 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.914281 27304 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:30.919075 27340 log.cc:927] Time spent T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:18:30.917918 27298 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:30.976476 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:30.932606 27256 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.933511 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 2065) took 1258 ms. Trace:
I20260709 12:18:30.977921 24101 rpcz_store.cc:276] 0709 12:18:29.675064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.765927 (+ 90863us) service_pool.cc:224] Handling call
0709 12:18:30.933295 (+1167368us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5400391054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:30.933432 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":943810432}
I20260709 12:18:30.720659 24094 rpcz_store.cc:276] 0709 12:18:29.690346 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.224627 (+534281us) service_pool.cc:224] Handling call
0709 12:18:30.224963 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.225185 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:30.424268 (+199083us) log.cc:844] Serialized 14 byte log entry
0709 12:18:30.709081 (+284813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:30.709144 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:30.709198 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:30.709272 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:30.709408 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16693,"raft.queue_time_us":27255,"thread_start_us":267689,"threads_started":1}
I20260709 12:18:30.980089 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.981681 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.939944 27281 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:30.941679 27225 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:30.946632 24067 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:30.988780 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:30.904449 27330 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:30.957177 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 103188us
W20260709 12:18:30.965533 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 60822.2us
I20260709 12:18:30.997325 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:30.911060 27218 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:30.919113 24171 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:18:30.897925 27129 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:30.990612 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:30.879921 27331 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:30.990911 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.994911 26965 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:30.999796 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:30.999428 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:31.011552 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.012616 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.043758 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:30.962882 27326 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:31.054000 24246 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:31.055114 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:30.987764 27253 consensus_meta.cc:287] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.743s	user 0.011s	sys 0.003s
I20260709 12:18:30.962371 26913 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.050915 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:31.056593 24242 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:31.052615 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 62001.5us
I20260709 12:18:31.055924 24094 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:31.058513 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:31.058416 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.056612 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:31.060237 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:30.989251 27042 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.051756 27239 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:30.988121 27329 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.065038 27239 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.067302 27239 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:31.067883 27299 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:31.068320 27299 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:31.068706 27299 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:18:31.070554 27207 consensus_meta.cc:287] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.658s	user 0.013s	sys 0.000s
I20260709 12:18:31.071074 27207 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.072376 24170 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:31.050027 27331 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:30.997360 27304 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.092924 27255 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.095878 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.097617 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.098392 24244 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:31.074733 27286 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.099416 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.100905 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.105907 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.057071 24215 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:31.107043 24101 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:31.107589 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 50637.1us
W20260709 12:18:31.108999 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48859.4us
I20260709 12:18:31.101331 27286 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:31.103452 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.104233 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.111317 24245 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:31.111668 24141 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:31.108770 24215 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:31.102167 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.113094 24249 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:31.059253 24094 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.095082 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:31.117269 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:31.036247 27257 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.148363 24242 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:31.001781 27218 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:30.910386 27120 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.060989 27205 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:31.062255 27326 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:31.178997 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 61829.5us
I20260709 12:18:31.179867 24067 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.181160 24067 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.182116 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:31.182337 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.120510 24245 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:31.120700 27129 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:31.121032 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:31.121845 27131 consensus_meta.cc:287] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.728s	user 0.008s	sys 0.005s
I20260709 12:18:31.122020 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.125573 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:31.102393 27147 consensus_meta.cc:287] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.706s	user 0.011s	sys 0.001s
I20260709 12:18:31.050721 27140 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.132956 27348 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:31.134660 27145 raft_consensus.cc:3055] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:31.049731 27308 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.049415 27302 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:31.054428 27330 raft_consensus.cc:697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:31.135663 27329 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.136529 27224 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:31.137537 27201 consensus_meta.cc:287] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.935s	user 0.010s	sys 0.001s
I20260709 12:18:31.107962 27253 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.138540 27301 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.139447 27294 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:31.141315 27086 consensus_meta.cc:287] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.578s	user 0.009s	sys 0.001s
I20260709 12:18:31.143694 27207 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:31.151703 24094 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:31.210294 27326 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.117959 24097 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:31.156085 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.276955 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2068) took 1601 ms. Trace:
I20260709 12:18:31.119510 27259 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.142167 27084 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.119571 27113 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.138744 27272 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:31.169539 24780 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:31.170620 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.128145 27293 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:31.283248 27264 consensus_meta.cc:287] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.793s	user 0.010s	sys 0.004s
I20260709 12:18:31.287617 27264 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.288098 27168 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.290432 27264 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.159938 27286 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:31.209583 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:31.161327 27205 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:31.208065 26965 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:31.207329 27281 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:31.209038 24244 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:31.317070 24814 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:31.275563 27350 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:31.210197 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:31.215306 24067 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.214200 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.209445 27129 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:31.231448 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.183887 27325 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:31.269819 24249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:31.323374 24249 raft_consensus.cc:606] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:31.213466 27304 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:31.216795 27140 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.240286 24167 raft_consensus.cc:2410] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 3.
I20260709 12:18:31.152055 24215 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:31.330628 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 178745us
I20260709 12:18:31.274274 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:31.277411 24096 rpcz_store.cc:276] 0709 12:18:29.675994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.193216 (+517222us) service_pool.cc:224] Handling call
0709 12:18:30.193406 (+   190us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.477459 (+284053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.477504 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:30.477559 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:30.477600 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.276706 (+799106us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540037e454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:31.276759 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.276894 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":652775168}
I20260709 12:18:31.278616 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1477) took 1112 ms. Trace:
I20260709 12:18:31.275720 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:31.281711 27272 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:31.285274 27084 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:31.285274 24813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 412) took 1938 ms (client timeout 1831 ms). Trace:
W20260709 12:18:31.341950 24813 rpcz_store.cc:269] 0709 12:18:29.336183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.336571 (+   388us) service_pool.cc:224] Handling call
0709 12:18:31.274325 (+1937754us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002ef9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:31.274482 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2444936064}
I20260709 12:18:31.283449 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:31.343211 24097 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.214654 27145 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:31.292303 24241 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:31.320109 27281 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:31.291796 24176 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:31.313913 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 144523us
I20260709 12:18:31.327059 27293 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:31.278692 24173 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Committing config change with OpId 6.5: config changed from index 4 to 5, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:18:31.351804 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.351861 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:31.194008 27131 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:31.319404 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 104186us
I20260709 12:18:31.320290 24099 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:31.358150 24067 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.358579 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:31.359457 24099 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:31.268934 27042 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:31.320978 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 106952us
I20260709 12:18:31.361701 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.223454 27239 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.281463 27086 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.318064 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:31.233808 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.331672 27288 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.322892 27129 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.213339 27349 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:31.332286 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 56684.5us
I20260709 12:18:31.364967 24244 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.368125 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:31.338194 27300 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.331930 24174 rpcz_store.cc:276] 0709 12:18:30.165782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.387885 (+222103us) service_pool.cc:224] Handling call
0709 12:18:30.428704 (+ 40819us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.469111 (+ 40407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.469159 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:30.469217 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:30.469262 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.278331 (+809069us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b54002af3d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:31.278389 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.278519 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92333440}
I20260709 12:18:31.212369 27292 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.382966 24812 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:31.383653 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:31.384027 27292 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:31.384366 24241 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.386068 27131 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.364807 27225 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:31.387528 27145 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.367422 27348 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:18:31.388731 27145 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.391028 27259 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:31.391355 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:31.391641 27259 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:31.392649 27259 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.393306 27140 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.394918 27353 ts_tablet_manager.cc:933] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.290916 27168 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.233872 27308 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.338533 24094 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:31.318342 27205 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.344488 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:31.419340 24096 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:31.420609 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:31.237996 27299 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.320561 27290 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.240188 27302 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.284282 24810 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:31.324925 27275 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.354806 24097 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:31.325726 26965 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:31.341480 27090 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:31.338529 27304 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:31.363969 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:31.426584 27356 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.070s	user 0.001s	sys 0.006s
I20260709 12:18:31.367132 24067 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:31.371527 27349 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:31.372161 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:31.367501 27298 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:31.373451 27042 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.447106 27304 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.448879 27042 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:31.376876 27086 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.367565 27249 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:18:31.396090 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:31.403271 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.359164 27281 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:31.450938 27298 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:31.451478 27298 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:31.415689 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1478) took 1249 ms. Trace:
I20260709 12:18:31.452877 24168 rpcz_store.cc:276] 0709 12:18:30.166064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.399312 (+233248us) service_pool.cc:224] Handling call
0709 12:18:30.399761 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.747452 (+347691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:30.747506 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:30.747574 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:30.747623 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.412111 (+664488us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b540016dfd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:31.415489 (+  3378us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:31.415609 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":798865152}
I20260709 12:18:31.454293 24807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 283) took 2073 ms. Trace:
I20260709 12:18:31.454447 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:31.454707 24807 rpcz_store.cc:276] 0709 12:18:29.380427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.385970 (+  5543us) service_pool.cc:224] Handling call
0709 12:18:31.454046 (+2068076us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54005d7fd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:31.454222 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2853645696}
I20260709 12:18:31.437347 27275 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.415799 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:31.455838 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:31.458108 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.360489 27293 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:31.418579 24167 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1440) took 3564 ms (client timeout 2160 ms). Trace:
I20260709 12:18:31.459039 27293 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:31.459105 24167 rpcz_store.cc:269] 0709 12:18:27.851387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.987030 (+135643us) service_pool.cc:224] Handling call
0709 12:18:31.410665 (+3423635us) spinlock_profiling.cc:243] Waited 3.19 s on lock 0x7b54003f7854. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:31.415578 (+  4913us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7344532352}
I20260709 12:18:31.460578 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:31.461158 24167 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:31.461992 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:31.324510 27350 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.415261 27190 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:31.463337 27190 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:31.464377 27190 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.456517 24168 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:31.465677 27190 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:31.466523 24098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 2075) took 1725 ms (client timeout 1773 ms). Trace:
W20260709 12:18:31.467046 24098 rpcz_store.cc:269] 0709 12:18:29.740648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:29.763470 (+ 22822us) service_pool.cc:224] Handling call
0709 12:18:31.466332 (+1702862us) spinlock_profiling.cc:243] Waited 51 ms on lock 0x7b5400265cd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:31.466453 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":117403392}
I20260709 12:18:31.468537 27299 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.469532 27331 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.470682 24172 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.462970 27113 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.427906 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:31.471990 24093 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:18:31.472139 24173 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:31.472981 24172 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.474445 24100 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.476055 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 1672) took 1834 ms. Trace:
I20260709 12:18:31.476428 24100 rpcz_store.cc:276] 0709 12:18:29.641988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.141288 (+499300us) service_pool.cc:224] Handling call
0709 12:18:31.474250 (+1332962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.474889 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.475857 (+   968us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400265cd0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:31.475991 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3064757120}
I20260709 12:18:31.403757 27301 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:31.478255 27301 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:31.478615 27302 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:31.423954 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:31.371227 27239 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.479321 27301 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.422210 24241 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:31.338732 27330 consensus_queue.cc:237] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:31.440702 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 76820.5us
I20260709 12:18:31.430703 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:31.483338 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:31.483978 24097 raft_consensus.cc:606] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:31.445231 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 78228.9us
I20260709 12:18:31.446540 27264 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.446673 27349 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.401554 27288 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.466429 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:31.275664 27218 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.428177 27207 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.490242 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.433977 24094 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:31.496650 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:31.497646 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.498898 24175 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.499783 24067 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.503398 24067 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.499883 24066 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:31.505844 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.458841 27275 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.510385 24174 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:31.489809 27350 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:31.494500 27225 raft_consensus.cc:2764] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:18:31.514977 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 146797us
I20260709 12:18:31.490932 27168 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:31.513396 24167 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.502493 27255 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.513690 24141 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.518548 24244 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
W20260709 12:18:31.524252 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 151522us
I20260709 12:18:31.426254 27272 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.502327 27090 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:31.538585 24097 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:31.539047 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.540071 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:31.540843 24094 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:31.541716 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:31.507230 27351 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.511057 27140 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.514299 27299 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:31.573004 24092 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.576862 24066 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:31.515142 27264 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.514379 27275 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:31.543718 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.544250 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:31.546638 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.519255 27168 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:31.632910 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 56148.8us
I20260709 12:18:31.636996 24097 raft_consensus.cc:606] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:31.638224 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:31.611053 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.542794 27333 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:31.576354 27269 consensus_meta.cc:287] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.004s
I20260709 12:18:31.549255 27131 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.647925 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:31.574072 27331 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:31.528312 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 167936us
I20260709 12:18:31.526502 27325 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:31.668026 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 121592us
I20260709 12:18:31.675551 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:31.651453 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72722.1us
I20260709 12:18:31.677495 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.679179 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:31.655354 27168 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.556650 27120 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:31.682142 24141 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:31.683233 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.548062 27084 consensus_queue.cc:1059] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:18:31.652634 27140 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:31.709239 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 181515us
I20260709 12:18:31.579191 27272 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.714259 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.669354 27296 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:31.722569 27296 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.725312 27296 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:31.716137 27331 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:31.552435 27352 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.132s
I20260709 12:18:31.669013 27264 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:31.675096 27325 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:31.752885 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.765064 27325 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:31.757061 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.684948 27255 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:31.706063 27274 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:31.705806 27147 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:31.761379 27331 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:31.770793 24245 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:31.771363 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.783751 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.651048 27275 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.719184 27239 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.714144 27302 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:31.777077 24244 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:31.582971 26965 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.780529 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:31.780753 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:31.784618 24249 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
W20260709 12:18:31.759523 26913 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.629s	user 0.011s	sys 0.002s
I20260709 12:18:31.712122 27281 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.781893 27147 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:31.766026 27357 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260709 12:18:31.795225 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:31.834721 24247 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:31.738133 27140 raft_consensus.cc:697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:31.780197 27274 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:31.779351 27308 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.670859 27269 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.802681 24243 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:31.811813 24242 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:31.773590 27255 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:31.805366 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:31.810868 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 140591us
I20260709 12:18:31.846334 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:31.784986 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48934us
I20260709 12:18:31.684715 27333 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:31.831894 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 155297us
I20260709 12:18:31.795513 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:31.836300 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:31.840469 24096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:31.767472 27359 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.091s
I20260709 12:18:31.826064 27239 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:31.799958 27299 raft_consensus.cc:697] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:31.854489 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:31.855392 24243 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.836305 27147 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:31.736251 27090 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.857014 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:31.867452 24248 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:31.843089 27274 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:31.872779 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:31.921020 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.810730 27129 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.812981 27298 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:31.803840 26913 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:31.933723 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.927975 24097 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:31.923794 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:31.851249 27255 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:31.918900 27363 log.cc:927] Time spent T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
W20260709 12:18:31.950887 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 95901.4us
I20260709 12:18:31.857034 27301 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
I20260709 12:18:31.923563 27239 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:31.955287 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:31.866439 27282 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.090s
W20260709 12:18:31.956866 27364 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:18:31.957086 27374 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:31.960959 27275 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:31.967074 24096 raft_consensus.cc:606] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:31.940307 27131 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.971266 27140 consensus_queue.cc:237] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.971622 27147 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:31.975500 27264 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:31.977356 24814 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:31.978874 24098 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:18:31.985524 27129 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:31.933631 27042 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:18:31.989045 24096 raft_consensus.cc:614] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:32.022429 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 176168us
W20260709 12:18:31.989797 27366 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260709 12:18:32.001067 27293 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.003s
W20260709 12:18:32.052259 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 122835us
I20260709 12:18:31.987486 27239 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.055089 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.057763 24097 raft_consensus.cc:2376] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8. Re-sending same reply.
I20260709 12:18:32.024552 27131 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.055861 24215 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:32.056125 24094 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:18:32.029878 27264 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.091109 24243 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:32.050918 27293 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.022122 27299 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.110008 24174 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:32.110972 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 460) took 1017 ms. Trace:
I20260709 12:18:32.111358 24174 rpcz_store.cc:276] 0709 12:18:31.093354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.101994 (+1008640us) service_pool.cc:224] Handling call
0709 12:18:32.105680 (+  3686us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.110668 (+  4988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.110902 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:32.113397 24093 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:32.116591 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 461) took 1020 ms. Trace:
I20260709 12:18:32.117158 24174 rpcz_store.cc:276] 0709 12:18:31.095852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.112998 (+1017146us) service_pool.cc:224] Handling call
0709 12:18:32.115885 (+  2887us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.116152 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.116191 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:32.116254 (+    63us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:32.116302 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.116389 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.116517 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:32.095647 27042 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:18:32.121366 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59226.9us
I20260709 12:18:32.097091 27281 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:32.127188 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:32.123780 27385 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:18:32.135574 27387 consensus_queue.cc:1059] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:32.137749 27390 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:32.138374 27390 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:32.139333 27390 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.122457 27333 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.127151 27269 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:32.148299 27274 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.145933 27298 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.146112 27264 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.160688 27131 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.161206 27274 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:32.144862 27292 consensus_meta.cc:287] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.760s	user 0.015s	sys 0.000s
W20260709 12:18:32.145223 27205 consensus_meta.cc:287] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.715s	user 0.010s	sys 0.005s
I20260709 12:18:32.140895 26913 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:32.168058 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46145us
I20260709 12:18:32.149775 27042 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:18:32.152918 27326 consensus_meta.cc:287] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.859s	user 0.011s	sys 0.007s
W20260709 12:18:32.184108 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.161725 27293 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:32.162578 27349 consensus_meta.cc:287] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.669s	user 0.014s	sys 0.000s
I20260709 12:18:32.213867 27292 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.235761 27300 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:32.236332 27300 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:32.205121 27147 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.249672 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.235816 27292 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.260910 27292 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.262581 27218 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.168924 27269 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.081s
I20260709 12:18:32.225047 27042 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 3 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:32.275810 27325 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.510s	user 0.009s	sys 0.006s
I20260709 12:18:32.276381 27325 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.280256 27325 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:32.284734 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.227356 27326 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.178896 27205 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.287174 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:32.283043 27168 consensus_meta.cc:287] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.576s	user 0.014s	sys 0.000s
I20260709 12:18:32.248171 27349 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:32.298791 24100 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:32.298398 27272 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.565s	user 0.012s	sys 0.002s
I20260709 12:18:32.303882 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:32.310674 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1882) took 1132 ms. Trace:
I20260709 12:18:32.311375 24250 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:32.319859 24097 raft_consensus.cc:606] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:32.320372 24097 raft_consensus.cc:614] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:32.319761 24167 rpcz_store.cc:276] 0709 12:18:31.177959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.302048 (+1124089us) service_pool.cc:224] Handling call
0709 12:18:32.302531 (+   483us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.302813 (+   282us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.302850 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:32.302915 (+    65us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:32.302961 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.310486 (+  7525us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.310605 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:32.297238 27168 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.324620 27205 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:32.325294 27168 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.328985 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:32.276953 27255 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.333505 24096 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:32.338784 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:32.340250 27326 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.340936 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1856) took 1681 ms. Trace:
I20260709 12:18:32.341355 24175 rpcz_store.cc:276] 0709 12:18:30.659818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.664415 (+  4597us) service_pool.cc:224] Handling call
0709 12:18:30.664907 (+   492us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.499388 (+834481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.340684 (+841296us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54003e03d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.340874 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917459712}
I20260709 12:18:32.358157 27255 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.363420 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:32.372560 27349 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:32.376216 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:32.376909 27084 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:32.377534 27084 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:32.359551 27390 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:18:32.380551 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1880) took 1210 ms. Trace:
I20260709 12:18:32.381076 24174 rpcz_store.cc:276] 0709 12:18:31.170589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:32.124149 (+953560us) service_pool.cc:224] Handling call
0709 12:18:32.129408 (+  5259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:32.131124 (+  1716us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:32.131158 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:32.133078 (+  1920us) log.cc:844] Serialized 26 byte log entry
0709 12:18:32.309259 (+176181us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:32.361112 (+ 51853us) log.cc:844] Serialized 14 byte log entry
0709 12:18:32.377516 (+ 16404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.379279 (+  1763us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:32.379333 (+    54us) raft_consensus.cc:1685] finished
0709 12:18:32.379521 (+   188us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.380483 (+   962us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16159,"prepare.queue_time_us":46597,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":16382,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":13104,"thread_start_us":227235,"threads_started":2,"wal-append.queue_time_us":221892}
I20260709 12:18:32.383914 24093 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:32.384065 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.391923 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2099) took 1021 ms. Trace:
I20260709 12:18:32.392541 24100 rpcz_store.cc:276] 0709 12:18:31.370494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.477404 (+106910us) service_pool.cc:224] Handling call
0709 12:18:31.477715 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.322299 (+844584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.391545 (+ 69246us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b5400329954. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.391796 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1887846272}
I20260709 12:18:32.394582 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2078) took 2244 ms. Trace:
I20260709 12:18:32.395027 24095 rpcz_store.cc:276] 0709 12:18:30.150399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.257691 (+107292us) service_pool.cc:224] Handling call
0709 12:18:30.257956 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:30.563174 (+305218us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:30.827624 (+264450us) log.cc:844] Serialized 14 byte log entry
0709 12:18:31.222761 (+395137us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.222820 (+    59us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:31.222868 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:31.380684 (+157816us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b1800366040. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1
0709 12:18:31.403186 (+ 22502us) spinlock_profiling.cc:243] Waited 35.5 ms on lock 0x7b1800366040. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:32.394288 (+991102us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b540011a654. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.394353 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.394493 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67335,"prepare.queue_time_us":244940,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":71789,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":38000,"spinlock_wait_cycles":791643264,"thread_start_us":565144,"threads_started":2,"wal-append.queue_time_us":406000}
I20260709 12:18:32.397502 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2093) took 1040 ms. Trace:
I20260709 12:18:32.397894 24098 rpcz_store.cc:276] 0709 12:18:31.356621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.469061 (+112440us) service_pool.cc:224] Handling call
0709 12:18:31.469597 (+   536us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:32.025869 (+556272us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.397100 (+371231us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54002661d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.397430 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170127232}
I20260709 12:18:32.399693 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1862) took 1738 ms. Trace:
I20260709 12:18:32.400099 24176 rpcz_store.cc:276] 0709 12:18:30.661836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.904345 (+242509us) service_pool.cc:224] Handling call
0709 12:18:30.904752 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.350646 (+445894us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.399425 (+1048779us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54003b1354. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.399617 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889604864}
I20260709 12:18:32.406530 27257 raft_consensus.cc:3055] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:32.413305 24095 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:32.414575 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.422230 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:32.422771 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 2088) took 1068 ms. Trace:
I20260709 12:18:32.423321 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:32.423187 24099 rpcz_store.cc:276] 0709 12:18:31.354659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.391004 (+ 36345us) service_pool.cc:224] Handling call
0709 12:18:32.422512 (+1031508us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400391554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:32.422690 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":724723968}
I20260709 12:18:32.409474 27257 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:32.432464 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1574) took 1418 ms. Trace:
I20260709 12:18:32.433125 24250 rpcz_store.cc:276] 0709 12:18:31.010493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.013257 (+  2764us) service_pool.cc:224] Handling call
0709 12:18:31.065232 (+ 51975us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.322562 (+1257330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.428986 (+106424us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54001dd8d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.429209 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2865231232}
I20260709 12:18:32.378850 27084 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:32.446534 27172 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:32.447278 27172 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:32.448361 27172 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:32.450191 24101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1688) took 1596 ms (client timeout 1846 ms). Trace:
I20260709 12:18:32.450920 24172 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:32.450695 24101 rpcz_store.cc:269] 0709 12:18:30.854278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.990568 (+136290us) service_pool.cc:224] Handling call
0709 12:18:32.449932 (+1459364us) spinlock_profiling.cc:243] Waited 66.3 ms on lock 0x7b540032a354. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:32.450115 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":152398720}
W20260709 12:18:32.459510 24169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1870) took 1777 ms (client timeout 1602 ms). Trace:
I20260709 12:18:32.435470 27389 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:18:32.432536 27350 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
W20260709 12:18:32.460142 24169 rpcz_store.cc:269] 0709 12:18:30.673568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.707104 (+ 33536us) service_pool.cc:224] Handling call
0709 12:18:32.450294 (+1743190us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b540016e9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:32.450487 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":128605056}
I20260709 12:18:32.435036 27205 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:18:32.455361 27172 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:32.469969 24812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 468) took 1399 ms. Trace:
I20260709 12:18:32.470432 24812 rpcz_store.cc:276] 0709 12:18:31.070750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.071943 (+  1193us) service_pool.cc:224] Handling call
0709 12:18:31.072309 (+   366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.383707 (+311398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.469687 (+1085980us) spinlock_profiling.cc:243] Waited 310 ms on lock 0x7b5400600ed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.469898 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":713767168}
I20260709 12:18:32.435150 27155 consensus_queue.cc:1059] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:18:32.487370 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1873) took 1812 ms. Trace:
I20260709 12:18:32.487991 24173 rpcz_store.cc:276] 0709 12:18:30.674492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.473844 (+799352us) service_pool.cc:224] Handling call
0709 12:18:31.474110 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.506944 (+ 32834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:31.507022 (+    78us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:31.507084 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:31.508036 (+   952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.486960 (+978924us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b54003f8254. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.487057 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:32.487258 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74858880}
I20260709 12:18:32.492198 27155 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:32.492694 27155 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:32.493669 27155 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.488873 27380 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.495445 27155 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.495436 27380 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.498906 27380 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:32.499543 27086 raft_consensus.cc:3055] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:32.500131 27086 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:32.500792 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.501439 27086 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:32.455343 27257 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.503785 27257 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.491091 27218 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:18:32.523854 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.519162 27086 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.512197 27380 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:18:32.520613 27218 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:32.532538 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.534420 27218 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.536322 27218 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.535840 27288 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.549566 27288 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.550091 27288 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.550742 27253 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.552186 27309 raft_consensus.cc:3055] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:32.552677 27309 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:32.553994 27288 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.553653 27309 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:32.555279 27309 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.561810 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 457) took 1624 ms. Trace:
I20260709 12:18:32.562299 24170 rpcz_store.cc:276] 0709 12:18:30.937819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.976078 (+ 38259us) service_pool.cc:224] Handling call
0709 12:18:32.561552 (+1585474us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b54002571d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:32.561730 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218141568}
I20260709 12:18:32.562665 27239 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.565544 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1557) took 2612 ms. Trace:
I20260709 12:18:32.565958 24246 rpcz_store.cc:276] 0709 12:18:29.952887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:30.594131 (+641244us) service_pool.cc:224] Handling call
0709 12:18:30.594435 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.061588 (+467153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.565228 (+1503640us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54003d7054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.565470 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056398592}
I20260709 12:18:32.567435 27286 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:32.568019 27286 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.573005 27128 raft_consensus.cc:993] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:32.573596 27128 raft_consensus.cc:1081] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:32.583544 24810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 422) took 1471 ms. Trace:
I20260709 12:18:32.584056 24810 rpcz_store.cc:276] 0709 12:18:31.111653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.118726 (+  7073us) service_pool.cc:224] Handling call
0709 12:18:31.119175 (+   449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:31.435175 (+316000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.583270 (+1148095us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54005e01d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:32.583474 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":378776320}
I20260709 12:18:32.587503 27286 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:32.588099 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.588938 24101 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:32.589684 27239 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:32.590868 27239 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:32.591202 27239 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:32.591109 27300 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.592291 27300 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.592206 27239 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:32.593400 27380 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:32.592377 27121 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:32.593626 27239 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.594651 27121 raft_consensus.cc:3055] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:32.595050 27121 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:32.595886 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1484) took 1878 ms. Trace:
I20260709 12:18:32.595961 27121 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.596377 24172 rpcz_store.cc:276] 0709 12:18:30.717500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.483293 (+765793us) service_pool.cc:224] Handling call
0709 12:18:32.450695 (+967402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:32.456538 (+  5843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.595680 (+139142us) spinlock_profiling.cc:243] Waited 960 ms on lock 0x7b540016e9d0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:32.595811 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2207549184}
I20260709 12:18:32.598965 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:32.599982 27113 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:32.600306 24066 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:32.601548 27370 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:32.602113 27370 raft_consensus.cc:697] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:32.600436 27113 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.603384 27113 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.604540 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.605369 24168 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:32.605939 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 1883) took 1387 ms. Trace:
I20260709 12:18:32.606281 24168 rpcz_store.cc:276] 0709 12:18:31.218154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.466131 (+247977us) service_pool.cc:224] Handling call
0709 12:18:32.604352 (+1138221us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:32.605845 (+  1493us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37984128}
I20260709 12:18:32.610203 27350 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:32.610970 27350 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 5 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:32.611939 27205 raft_consensus.cc:3055] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:32.612411 27205 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:32.613166 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.613303 27205 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.613927 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.614162 24098 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:32.613252 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.612725 27350 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:32.617062 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.617547 27350 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:32.616489 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.618603 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.619102 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.621946 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:32.622107 24244 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:32.622611 24243 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:32.623356 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.625928 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.625739 27042 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.614857 27205 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.630337 24250 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:32.632519 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.633279 27084 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:32.633955 24092 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 3. Current term is 4. Ops: []
I20260709 12:18:32.634613 27144 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:32.635053 27144 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:32.635390 27113 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.635974 27144 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.636494 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:32.637336 24250 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:32.637818 27144 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.626890 27042 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:32.647884 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.649161 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.649605 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.650038 24095 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:32.650102 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.650916 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.651796 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.652349 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.652853 24093 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:32.648763 24096 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:32.654173 24094 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:18:32.613462 27370 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.663678 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.665153 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.669107 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.672510 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.673503 24092 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:32.674544 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.676074 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.676826 24101 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
W20260709 12:18:32.684685 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.687318 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.688254 27390 raft_consensus.cc:3055] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:32.688673 27390 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:32.689531 27390 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:32.690963 24170 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:32.694733 24100 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
W20260709 12:18:32.698181 27403 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:18:32.698872 24248 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
W20260709 12:18:32.701261 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.703781 24241 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:32.703956 24245 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:18:32.707464 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:32.718302 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.720165 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:32.723783 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:32.729105 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.730059 24100 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:32.732041 24249 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:32.716217 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:18:32.718276 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56977.6us
I20260709 12:18:32.736268 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.738054 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.739913 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.740270 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.740756 24169 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:32.741739 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.742467 24169 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:32.743336 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.744488 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.745819 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.737632 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:32.746919 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.748636 24175 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:32.749488 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.750090 24175 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:32.751610 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.752936 24169 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:32.739116 24173 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:32.753914 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.747821 24092 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:32.788476 24173 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:18:32.759809 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.789542 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:32.792732 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69037.5us
I20260709 12:18:32.792894 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:32.757441 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.794446 24174 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.795836 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:32.713227 27390 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.802305 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:32.802409 24216 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:32.733522 27353 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 1.124s	user 0.007s	sys 0.013s
I20260709 12:18:32.817312 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.818181 24168 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:32.806037 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:32.808353 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.812863 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:32.822365 24170 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:32.815496 24092 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:32.733654 27255 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:32.755957 27225 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:32.825487 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:32.755507 27205 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:32.788717 27380 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:32.839556 24174 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:32.798259 27113 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.761909 27288 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:32.808738 27253 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:32.820848 27353 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 1.227s	user 0.013s	sys 0.018s
I20260709 12:18:32.800812 27272 raft_consensus.cc:2764] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:18:32.809124 27286 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:32.844619 24168 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:32.819157 27251 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:32.854050 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:32.857079 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.827284 27360 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:32.756206 27389 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:32.875566 27389 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:32.807523 27330 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:18:32.877715 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.878657 24249 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.870828 27172 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:32.877820 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.880213 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.880437 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.879889 24174 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:32.882043 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.883460 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.884868 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.886212 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.839542 27255 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.887606 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:32.888316 24168 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:32.888700 24168 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.891199 24176 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:32.892561 24167 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:32.841632 27348 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:32.840885 27115 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:32.844465 27218 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:32.893988 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:32.917893 24249 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:32.882894 24172 raft_consensus.cc:2376] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7. Re-sending same reply.
I20260709 12:18:32.886943 24173 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:32.917049 24168 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.920718 24173 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:32.856099 27253 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.909795 24175 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:32.910353 24174 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:32.909843 27144 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:32.899940 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:32.916904 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:32.840919 27374 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.047s	sys 0.066s
I20260709 12:18:32.924127 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:32.929023 24172 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:32.931190 24140 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:32.932245 24170 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:32.936014 27144 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:32.928483 27253 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.936548 27144 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.936551 24172 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:32.940274 24174 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:18:32.864454 27251 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:32.846904 27205 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:32.949975 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:32.946846 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 79889.7us
I20260709 12:18:32.904599 27348 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:32.942291 24174 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:32.950971 24168 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.952911 27294 consensus_queue.cc:1059] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:32.955149 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.919498 27218 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:32.958454 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:32.939157 27374 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.047s	sys 0.067s
I20260709 12:18:32.865489 27288 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.978603 27239 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:32.985008 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:32.906167 27359 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:18:32.986508 24241 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:32.990549 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:32.990679 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:32.986502 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.948207 27272 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:32.993450 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.948493 27331 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:32.918848 26965 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:18:32.948825 27251 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:32.991693 24241 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:32.987367 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.860049 27380 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:32.962584 27348 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:32.919137 27140 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:18:33.000350 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.000458 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:32.996997 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:32.985190 27218 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:32.963369 27318 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:33.001936 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:32.957080 27299 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:32.997047 27086 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:18:32.949087 27353 tablet_copy_client.cc:323] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:18:32.996908 27239 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:33.005153 27272 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:33.007277 27205 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:33.008571 27288 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:32.957682 27121 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.021471 27272 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.025015 27251 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:32.985526 27374 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:32.995211 27387 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:33.018512 27239 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.026822 27374 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:33.028575 27239 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.030172 27251 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:33.019104 27318 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.033347 27318 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.034137 27380 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:33.019384 27299 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.034869 27299 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.035938 27144 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.038162 27144 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:33.061494 27348 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:33.096979 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.100678 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.105623 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1864) took 2442 ms. Trace:
I20260709 12:18:33.107649 24241 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
W20260709 12:18:33.112452 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 127368us
W20260709 12:18:33.115782 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.096979 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 150239us
I20260709 12:18:33.106544 24171 rpcz_store.cc:276] 0709 12:18:30.662470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.002559 (+340089us) service_pool.cc:224] Handling call
0709 12:18:31.002977 (+   418us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:31.036874 (+ 33897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:31.036913 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:31.056872 (+ 19959us) log.cc:844] Serialized 26 byte log entry
0709 12:18:32.537120 (+1480248us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b18000e7fa0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:18:32.744906 (+207786us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:32.744969 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:32.745081 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:33.104430 (+359349us) raft_consensus.cc:1685] finished
0709 12:18:33.104489 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:33.105187 (+   698us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63471,"raft.queue_time_us":33856,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11661,"spinlock_wait_cycles":10971520,"thread_start_us":207517,"threads_started":1,"wal-append.queue_time_us":1889003}
I20260709 12:18:33.117650 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.120406 24066 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:33.124769 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:33.127621 24173 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:33.129252 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.129895 24066 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.012509 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.010685 24247 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:33.130501 24241 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:33.167867 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.136155 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.175887 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46313.7us
I20260709 12:18:33.158612 24243 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:18:33.154481 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.211724 24243 pending_rounds.cc:85] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 3
I20260709 12:18:33.221947 27292 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:33.223557 27296 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.224915 27296 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:33.226773 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:33.187983 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet b29f161fe0e24b51ad5c1903bdc5112c from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:18:33.232188 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet b29f161fe0e24b51ad5c1903bdc5112c from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-b29f161fe0e24b51ad5c1903bdc5112c
I20260709 12:18:33.233644 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:33.235427 24066 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.239282 27239 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:33.239428 26965 consensus_queue.cc:1059] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:33.240144 27239 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:33.241341 24249 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:33.241895 27239 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:33.243863 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.245189 27128 raft_consensus.cc:993] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:33.248770 27218 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.250384 24243 pending_rounds.cc:107] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:18:33.250823 24243 raft_consensus.cc:2889] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:33.222805 27292 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.257632 27292 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.279911 27140 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:33.281622 23994 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 191) took 16519 ms (client timeout 15000 ms). Trace:
I20260709 12:18:33.293383 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.296340 27370 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:33.296676 27352 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:33.297266 27352 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.297907 23995 catalog_manager.cc:5697] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 2 to 7, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 7 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:33.284610 24248 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:33.313856 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 161155us
I20260709 12:18:33.315541 27168 raft_consensus.cc:3055] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:33.316131 27168 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.317534 27168 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.298877 27352 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:33.307045 24140 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:33.329224 27352 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:33.343628 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 71458.6us
I20260709 12:18:33.326954 27318 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.315600 27172 raft_consensus.cc:1081] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:33.349928 27318 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.355172 27255 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.356262 27318 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.358973 24250 raft_consensus.cc:2410] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:33.360015 27348 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:33.360651 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.285212 23994 rpcz_store.cc:269] 0709 12:18:16.762396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:16.767178 (+  4782us) service_pool.cc:224] Handling call
0709 12:18:33.281212 (+16514034us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:27.440195 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:27.451036 (+ 10841us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:27.451130 (+    94us) write_op.cc:435] Acquired schema lock
0709 12:18:27.451159 (+    29us) tablet.cc:662] Decoding operations
0709 12:18:27.611068 (+159909us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:27.611144 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:27.611185 (+    41us) tablet.cc:685] Acquiring locks for 42 operations
0709 12:18:27.627505 (+ 16320us) tablet.cc:701] Row locks acquired
0709 12:18:27.627547 (+    42us) write_op.cc:260] PREPARE: finished
0709 12:18:27.627737 (+   190us) write_op.cc:270] Start()
0709 12:18:27.627916 (+   179us) write_op.cc:276] Timestamp: P: 1783599507627663 usec, L: 0
0709 12:18:27.627936 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:18:27.628766 (+   830us) log.cc:844] Serialized 16402 byte log entry
0709 12:18:29.336601 (+1707835us) spinlock_profiling.cc:243] Waited 40.5 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:30.417802 (+1081201us) op_driver.cc:464] REPLICATION: finished
0709 12:18:30.830526 (+412724us) write_op.cc:301] APPLY: starting
0709 12:18:30.830659 (+   133us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:30.834841 (+  4182us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:30.834893 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:30.968006 (+133113us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:30.968518 (+   512us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=42
0709 12:18:30.968571 (+    53us) write_op.cc:312] APPLY: finished
0709 12:18:31.199274 (+230703us) log.cc:844] Serialized 271 byte log entry
0709 12:18:31.199562 (+   288us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:31.199959 (+   397us) write_op.cc:454] Released schema lock
0709 12:18:31.200083 (+   124us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:31.200615 (+   532us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:31.200645 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21821,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":382002,"apply.run_cpu_time_us":11801,"apply.run_wall_time_us":370077,"num_ops":42,"prepare.queue_time_us":295846,"prepare.run_cpu_time_us":17046,"prepare.run_wall_time_us":284036,"raft.queue_time_us":611180,"raft.run_cpu_time_us":17184,"raft.run_wall_time_us":318294,"replication_time_us":2789655,"spinlock_wait_cycles":93042048,"thread_start_us":894093,"threads_started":4,"wal-append.queue_time_us":373064,"wal-append.run_cpu_time_us":51506,"wal-append.run_wall_time_us":4193639}]]}
I20260709 12:18:33.367708 27168 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.369634 24259 tablet_copy_source_session.cc:215] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:18:33.339582 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:33.327780 27140 raft_consensus.cc:697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.371423 27218 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:33.383430 27416 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:33.384250 27416 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.384739 27416 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.387250 24242 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:33.342329 27370 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.393508 27128 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:33.394610 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 127472us
W20260709 12:18:33.395479 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 138681us
I20260709 12:18:33.396629 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.396864 24140 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:33.404788 27255 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:33.405365 27255 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.405776 27255 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:33.407189 27225 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:33.408070 24243 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:33.409118 27389 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:33.410068 24244 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:33.410739 27253 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.411973 27140 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:33.413911 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 122626us
I20260709 12:18:33.413825 27370 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.408107 27225 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.415474 24169 raft_consensus.cc:2368] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8.
I20260709 12:18:33.425020 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.425926 24243 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
I20260709 12:18:33.413779 27253 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.432502 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.433897 27113 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:33.434026 27299 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.418867 27128 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.435133 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:33.435617 24241 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: [6.5-8.6]
I20260709 12:18:33.444685 24249 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:33.445832 24244 raft_consensus.cc:2393] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:33.444028 27113 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.447774 27113 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.450057 27292 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.450941 27299 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.452437 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.454511 27269 raft_consensus.cc:3055] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:33.447916 27128 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.455019 27269 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:33.456789 27113 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:33.456384 27269 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.458148 27269 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:33.459388 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.459885 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.461234 24244 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
W20260709 12:18:33.465224 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 68539.6us
I20260709 12:18:33.466285 24140 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:33.467456 27272 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:33.473116 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44896.6us
I20260709 12:18:33.475858 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:33.476073 27115 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.476878 27115 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.479826 24245 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:18:33.500180 27422 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.500662 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:33.501070 27422 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.502326 24100 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:33.506083 27422 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.515765 24249 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:33.479871 27115 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.539908 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:33.541294 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.551976 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.554728 24249 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:33.563367 27272 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.566234 27272 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.567468 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.568228 24245 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:33.569633 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.570410 24244 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:33.571820 24249 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:33.572948 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.573271 24243 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:33.561460 27115 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:18:33.574601 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:33.575700 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:33.576465 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:33.576788 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:33.578604 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:33.582639 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 116569us
I20260709 12:18:33.589954 24099 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:33.591395 24248 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.582451 27253 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:33.613283 24093 raft_consensus.cc:2393] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:33.609331 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:33.597178 27253 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.614667 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:33.619139 27330 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:33.620199 27330 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.626360 24066 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.626251 27172 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:33.627323 27421 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:33.628775 27172 consensus_queue.cc:1059] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:33.630059 27172 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:33.630409 27172 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.630609 27421 raft_consensus.cc:3055] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:33.631084 27421 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.631575 27172 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.632247 27421 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.633294 27172 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.633800 27421 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:33.635819 27225 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.635895 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:33.636555 27225 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:33.637513 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47668.4us
I20260709 12:18:33.639367 27168 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:33.638774 27408 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:33.654407 27225 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.622691 27330 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.658651 24092 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:33.653139 24066 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.669209 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.669960 27370 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:33.670383 27370 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.670779 27370 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.662204 27168 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.640458 27253 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:33.677230 27331 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:33.678865 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.679563 27416 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.654907 27239 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:33.675562 27140 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:33.687096 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.682765 27416 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.671993 27292 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.676278 27168 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.721120 27299 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:18:33.723548 27420 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.157s
I20260709 12:18:33.683074 27239 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:33.743556 27424 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
I20260709 12:18:33.686403 27408 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:33.707125 27140 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:33.755837 27408 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:33.756826 27416 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:33.762135 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:33.763096 27140 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:33.763398 27145 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:33.764190 27145 consensus_queue.cc:1059] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:33.765187 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:33.766487 24248 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
W20260709 12:18:33.767717 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:33.772032 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.751080 27239 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.774153 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:33.774843 24247 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.765620 27145 raft_consensus.cc:3055] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:33.786489 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:33.791118 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 190285us
I20260709 12:18:33.783407 27145 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:33.798657 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.728708 27255 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.797206 27145 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:33.801100 27145 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:33.802246 24247 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:33.807389 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:33.820250 27272 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.821059 27299 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:33.822137 27299 raft_consensus.cc:697] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.822921 27239 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:33.823577 27239 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:33.824656 27239 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.827612 27385 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:33.820258 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:33.829005 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 63921.2us
I20260709 12:18:33.823590 27299 consensus_queue.cc:237] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.847153 27301 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:33.847975 27301 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:33.850536 27301 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:33.833925 27420 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:18:33.848587 24216 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.602s (SENT)
W20260709 12:18:33.860458 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:33.852165 27255 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:33.863862 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:33.869591 27378 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.863001 27420 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:33.908723 27301 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:33.923838 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:33.883620 27269 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:18:33.924201 26965 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:33.946710 26965 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:33.949913 24175 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:33.950244 26965 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:33.951157 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 102747us
I20260709 12:18:33.954190 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:33.955065 24245 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:33.956453 27269 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:33.957216 27269 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.912725 27378 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:33.967497 27378 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:33.971249 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 113997us
I20260709 12:18:33.967461 27168 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.972662 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:33.973865 27269 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:33.973778 27420 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:33.974279 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:33.975304 27416 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:33.976922 27416 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:33.990367 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.001994 27168 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:34.001832 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:34.003247 24098 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:34.004761 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.005779 27269 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:34.006203 27269 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.006563 27269 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.013509 27272 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.014194 27272 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:34.016774 27272 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:34.002725 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:34.029762 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:34.030894 24244 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:34.035902 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61729.4us
I20260709 12:18:34.031934 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:34.038367 24241 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:33.977581 27416 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:34.033538 24245 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:34.026811 27269 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.048209 27353 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b29f161fe0e24b51ad5c1903bdc5112c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:18:34.054005 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.049319 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:34.055172 24244 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:34.057982 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:34.059136 24247 raft_consensus.cc:2393] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:34.059342 24242 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
W20260709 12:18:34.063027 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.069689 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:34.070254 24092 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.068063 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:34.075070 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47520us
I20260709 12:18:34.076349 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:34.086670 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:34.087852 24245 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:34.088330 27121 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.088943 27121 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.090059 24140 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:34.077843 27255 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:18:34.057029 27253 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.101317 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.107650 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:34.108560 24242 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:18:34.109543 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:34.060698 27370 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.113330 27330 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:34.113519 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:34.082415 27269 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:34.117192 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:34.124817 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.126853 24248 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
W20260709 12:18:34.128321 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46948.6us
I20260709 12:18:34.128757 27330 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:34.129665 27330 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:34.135381 24247 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:34.136178 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.115841 27255 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:34.139215 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:34.120308 27225 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:34.142405 24242 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.092031 27331 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:18:34.130191 27330 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:18:34.157179 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.143316 27255 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:18:34.157202 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:34.160655 27282 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:34.161214 27282 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.161597 27282 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:34.162711 27432 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.210s	user 0.002s	sys 0.000s
I20260709 12:18:34.185789 27374 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260709 12:18:34.166831 27121 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:34.202486 27309 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.203188 27309 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:34.206461 27309 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:34.211149 27378 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:34.213692 27253 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:34.227035 27330 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:34.247243 27435 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:18:34.256616 27440 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.123s	user 0.000s	sys 0.004s
I20260709 12:18:34.214762 27253 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:34.271539 27253 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.272083 27253 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:34.277705 24247 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:18:34.234645 24242 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
W20260709 12:18:34.284541 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.296871 27168 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:34.297708 27168 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:34.298660 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:34.286475 27370 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:34.292784 24249 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:34.299420 24095 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
W20260709 12:18:34.293358 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.300746 27370 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:34.301340 27370 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:34.307246 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.293330 24242 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:34.316658 24244 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:34.319662 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:34.336247 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.336972 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 206714us
I20260709 12:18:34.335718 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:34.347585 24247 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:34.350288 24092 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:34.353268 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:34.353981 24095 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:34.357788 24214 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:34.358843 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.349807 27145 consensus_meta.cc:287] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.537s	user 0.009s	sys 0.007s
I20260709 12:18:34.416050 24247 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:34.423786 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:34.339192 27121 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:34.430380 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 324078us
W20260709 12:18:34.402249 27140 consensus_meta.cc:287] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.005s
I20260709 12:18:34.296193 27282 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:34.402526 26965 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:34.445338 24245 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:34.447409 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:34.356392 27239 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:34.418323 27168 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:34.469484 24242 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:34.417235 27128 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:18:34.427660 27318 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:18:34.448154 27145 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.450248 27301 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:34.208077 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:34.487715 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 374370us
I20260709 12:18:34.499275 24779 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:34.500929 27387 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.501543 27387 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:34.448391 27121 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.503957 27387 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:34.505455 27121 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:34.506168 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:34.506835 27128 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:34.507093 27239 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.511116 27239 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:34.507465 27128 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:34.513108 27128 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.514590 27128 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.515357 27251 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.516079 27251 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:34.517905 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.518508 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.518630 27251 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:34.522758 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:34.560133 24175 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:34.493737 27301 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.561631 27301 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:34.526146 24067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.731s (SENT) [suppressed 26 similar messages]
I20260709 12:18:34.563301 27269 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.564131 27269 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:34.496804 27145 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.568778 27145 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:34.530020 27282 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:34.530570 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 120656us
I20260709 12:18:34.531512 27377 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:34.575258 27377 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.575773 27377 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.446888 27140 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.579540 27140 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:34.582231 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:34.533691 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:34.583163 24100 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.584085 27449 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:34.584651 27449 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:34.585111 27449 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:34.585287 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 227622us
I20260709 12:18:34.534327 27453 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:34.586953 27453 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:34.587515 27453 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.587435 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:34.588627 24092 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:34.535676 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:34.589741 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 54144.9us
I20260709 12:18:34.590611 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.591698 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.536247 27416 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:34.592394 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:34.592932 27416 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:34.593468 27416 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:34.593910 27416 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.595249 27225 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:34.595958 27225 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:34.597174 27225 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.598628 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:34.599485 24092 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:34.600883 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:34.601231 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:34.601565 24246 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:34.601878 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:34.602492 27451 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:34.602919 27451 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:34.603030 24247 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:18:34.603576 24247 pending_rounds.cc:85] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 4
I20260709 12:18:34.603856 24247 pending_rounds.cc:107] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:18:34.604143 24247 raft_consensus.cc:2889] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:34.603969 27451 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.603030 27459 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.605860 27451 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.606232 27459 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.602638 24249 raft_consensus.cc:2393] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:34.551048 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:34.608389 24173 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
W20260709 12:18:34.612366 27444 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.429s	user 0.003s	sys 0.000s
I20260709 12:18:34.613076 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.616359 27251 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:34.616482 27448 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:34.617077 27251 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:34.617497 27437 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.521s	user 0.003s	sys 0.000s
I20260709 12:18:34.617266 27448 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.618222 27251 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:34.621709 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.625902 27272 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:34.626458 27272 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:34.629842 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.639632 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:34.640738 24807 raft_consensus.cc:2368] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13.
I20260709 12:18:34.642558 24066 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.645440 27459 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:34.646313 27460 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:34.648594 24214 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.652541 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:34.655236 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:34.657574 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 124007us
I20260709 12:18:34.670284 24245 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:34.662593 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 70993.8us
I20260709 12:18:34.664322 27421 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:34.665885 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.670640 24244 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:34.670771 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:34.675536 27460 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.686898 27460 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.687002 27448 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:34.687402 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:34.688078 24098 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:34.616489 27370 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:34.696244 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.699263 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:34.699924 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.698060 24781 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:34.679068 27331 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:34.689098 27255 consensus_meta.cc:287] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.513s	user 0.013s	sys 0.006s
I20260709 12:18:34.681936 27121 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:34.710834 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:34.712101 24249 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:34.723155 27144 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:34.724004 27144 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:34.692941 27421 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:34.733134 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:34.737468 24244 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:34.746155 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:34.659626 27272 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.711535 27168 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:34.717402 27374 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:34.710625 27330 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:34.719857 27121 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:34.776166 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 62687.1us
W20260709 12:18:34.778842 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53241.7us
W20260709 12:18:34.791111 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.717948 27370 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.055s
W20260709 12:18:34.848459 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 137680us
I20260709 12:18:34.754290 27269 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:34.719596 27255 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:34.769028 27374 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:34.755040 27239 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:34.798882 27121 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:34.867018 27253 consensus_meta.cc:287] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.587s	user 0.007s	sys 0.010s
I20260709 12:18:34.931121 23998 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 4 to 5, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 5 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:34.991174 27461 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.224s
I20260709 12:18:34.993571 27458 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:18:34.997278 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 87266.4us
I20260709 12:18:34.773159 27168 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.006850 27476 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:35.003952 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 274732us
W20260709 12:18:35.028923 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.029438 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.008050 27480 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:35.009302 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.011588 27475 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.013710 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet c29a1bdc82674a4ab1ad6c3b54c69e25 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:40964
I20260709 12:18:35.016587 27458 raft_consensus.cc:697] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:35.018193 27473 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.018196 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:34.910827 27374 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:34.907998 27269 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:35.021991 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 294646us
I20260709 12:18:34.897580 27331 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:35.047178 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:35.003324 27272 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:34.924247 27448 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:35.087582 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:34.922147 27330 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.089663 24244 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:34.922851 27239 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.081645 23998 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:35.030056 27476 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.025756 27461 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.050678 24241 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:35.043015 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 243992us
I20260709 12:18:35.094367 23998 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:35.095213 24100 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.511s	user 0.015s	sys 0.004s
W20260709 12:18:35.095502 23995 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 191) took 25681 ms (client timeout 15000 ms). Trace:
I20260709 12:18:35.031667 27251 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:35.004928 27253 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.100359 24100 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
W20260709 12:18:35.103538 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.088444 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:35.105527 23998 catalog_manager.cc:5697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 7 to 8, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 8 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:35.035166 27480 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.094096 27292 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.118697 27479 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:35.128496 27485 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:35.128386 27292 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.118465 27458 consensus_queue.cc:237] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.128990 27485 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:35.129438 27485 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:35.130250 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.084841 27086 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:18:35.123148 27486 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:35.124554 27471 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:18:35.123812 23998 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 5 to 6, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 6 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:35.125607 27255 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.110009 27461 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.144308 23998 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 5 to 7, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 7 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:35.110930 27251 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:35.109432 27128 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.558s	user 0.012s	sys 0.000s
W20260709 12:18:35.139843 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.102778 27476 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.147379 27251 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:35.147976 27251 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.148506 27251 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.112674 27480 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.160157 27168 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.096728 27269 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.163203 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:35.130965 27292 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.181095 27253 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.047695 27421 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.104276 27448 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.081040 27475 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.082149 27473 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:35.100457 23995 rpcz_store.cc:269] 0709 12:18:09.404811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:09.469980 (+ 65169us) service_pool.cc:224] Handling call
0709 12:18:35.086086 (+25616106us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:33.549084 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:33.549920 (+   836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:33.549974 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:18:33.549992 (+    18us) tablet.cc:662] Decoding operations
0709 12:18:33.550391 (+   399us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:33.550464 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:33.550491 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:33.550776 (+   285us) tablet.cc:701] Row locks acquired
0709 12:18:33.550848 (+    72us) write_op.cc:260] PREPARE: finished
0709 12:18:33.551480 (+   632us) write_op.cc:270] Start()
0709 12:18:33.551664 (+   184us) write_op.cc:276] Timestamp: P: 1783599513550974 usec, L: 0
0709 12:18:33.551700 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:18:33.554350 (+  2650us) log.cc:844] Serialized 536 byte log entry
0709 12:18:33.951685 (+397335us) op_driver.cc:464] REPLICATION: finished
0709 12:18:34.178659 (+226974us) write_op.cc:301] APPLY: starting
0709 12:18:34.178784 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:34.178921 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:34.179092 (+   171us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:34.179504 (+   412us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:34.179874 (+   370us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:18:34.179949 (+    75us) write_op.cc:312] APPLY: finished
0709 12:18:34.180360 (+   411us) log.cc:844] Serialized 23 byte log entry
0709 12:18:34.180637 (+   277us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:34.180775 (+   138us) write_op.cc:454] Released schema lock
0709 12:18:34.180863 (+    88us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:34.181525 (+   662us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:34.181551 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":232228,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":213962,"apply.run_cpu_time_us":2817,"apply.run_wall_time_us":2817,"num_ops":1,"prepare.queue_time_us":181040,"prepare.run_cpu_time_us":41056,"prepare.run_wall_time_us":186341,"raft.queue_time_us":105368,"raft.run_cpu_time_us":66626,"raft.run_wall_time_us":127663,"replication_time_us":399773,"thread_start_us":348473,"threads_started":4,"wal-append.queue_time_us":215985}]]}
I20260709 12:18:35.221318 24244 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:18:35.194020 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:35.212456 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:35.198205 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.182850 24250 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:18:35.221658 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 127042us
I20260709 12:18:35.223234 24098 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:35.233247 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:35.159792 27144 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:35.206851 27449 consensus_meta.cc:287] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.621s	user 0.014s	sys 0.000s
I20260709 12:18:35.152006 27486 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.209671 27352 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:35.255295 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.204594 27330 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:35.248044 27301 consensus_meta.cc:287] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.686s	user 0.020s	sys 0.000s
W20260709 12:18:35.260228 26965 consensus_meta.cc:287] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.808s	user 0.018s	sys 0.003s
W20260709 12:18:35.280426 24245 consensus_meta.cc:287] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.604s	user 0.010s	sys 0.003s
I20260709 12:18:35.281003 24245 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:35.209833 27331 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.301234 27486 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.303416 27475 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.306102 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.242556 27449 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.313232 27449 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.260052 27352 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.314450 24098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
W20260709 12:18:35.315049 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.315424 24098 raft_consensus.cc:606] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:35.315634 27352 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:35.315940 24098 raft_consensus.cc:614] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:35.316378 24093 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
W20260709 12:18:35.318748 27377 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.742s	user 0.011s	sys 0.000s
I20260709 12:18:35.281975 26965 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:35.278581 27301 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.284132 27481 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.282254 27282 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:35.313359 27269 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:35.328809 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.340099 24099 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:35.341238 24242 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:35.285740 27458 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:35.342893 24241 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 4.
W20260709 12:18:35.345440 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 76895.3us
I20260709 12:18:35.347648 27481 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.298103 27482 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.206s
I20260709 12:18:35.351536 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:35.398041 27482 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:35.322925 27353 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33918 (request call id 467) took 4252 ms. Trace:
I20260709 12:18:35.398432 24244 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:35.375438 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.380470 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:35.400326 24100 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:35.346563 27377 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:35.376552 24067 leader_election.cc:336] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.564s (SENT)
I20260709 12:18:35.378297 24092 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
W20260709 12:18:35.337990 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 54755us
W20260709 12:18:35.380295 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.403785 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.350477 27458 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.323298 27239 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.404597 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:35.322484 27453 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.734s	user 0.004s	sys 0.009s
I20260709 12:18:35.407778 24246 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:18:35.409498 24216 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.602s (SENT)
I20260709 12:18:35.417101 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:35.411768 24214 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:35.379209 27422 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.415661 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:35.445590 24100 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:35.418218 27145 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:35.420435 27448 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.421460 27487 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.423647 27377 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:35.425874 27269 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:35.425889 27461 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.426493 27499 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:35.447001 27487 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.456574 27487 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:35.458050 27416 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.864s	user 0.004s	sys 0.008s
I20260709 12:18:35.396824 27301 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:35.442574 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.398476 27482 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:35.449398 24092 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:35.448750 27269 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.310864 27374 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.477617 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1388d59244114d37a482e6205f04c237"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
W20260709 12:18:35.478295 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 101782us
I20260709 12:18:35.478575 24099 raft_consensus.cc:606] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:35.479210 24099 raft_consensus.cc:614] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:35.460726 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 360836us
I20260709 12:18:35.469524 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:35.481634 24173 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.415071 27253 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.410848 27121 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.348855 27282 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.486927 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.458570 27416 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.491818 24246 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:35.493291 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:35.501755 24812 raft_consensus.cc:2393] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:35.494891 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:35.506266 27121 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:35.531641 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.532647 24807 raft_consensus.cc:2368] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:18:35.507299 24249 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:18:35.533457 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:35.535404 24169 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:35.538322 27501 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:18:35.540647 27448 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:35.483368 27269 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.543881 24242 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:35.581271 27374 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.443199 27453 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.554044 24169 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:35.583664 24171 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:35.585652 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:35.585911 24100 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
W20260709 12:18:35.586428 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.586719 24247 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 10
W20260709 12:18:35.588287 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45483us
I20260709 12:18:35.398928 27353 rpcz_store.cc:276] 0709 12:18:31.070350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.073043 (+  2693us) service_pool.cc:224] Handling call
0709 12:18:31.401205 (+328162us) ts_tablet_manager.cc:934] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
0709 12:18:32.564360 (+1163155us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c024710ac 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248acaa 00007f4c0248abd2 00007f4c0a4ef131
0709 12:18:33.924156 (+1359796us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:18:34.845188 (+921032us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:34.867322 (+ 22134us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:18:35.321644 (+454322us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:18:35.322110 (+   466us) tablet_replica.cc:206] Creating consensus instance
0709 12:18:35.322499 (+   389us) ts_tablet_manager.cc:989] Replica registered.
0709 12:18:35.322771 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":85988,"spinlock_wait_cycles":34015616,"tablet-copy.queue_time_us":277983,"thread_start_us":1490640,"threads_started":2}
I20260709 12:18:35.585343 24781 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:35.448845 27422 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:35.571313 27451 consensus_meta.cc:287] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.965s	user 0.009s	sys 0.011s
W20260709 12:18:35.535429 27503 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.067s	user 0.002s	sys 0.000s
I20260709 12:18:35.596741 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:35.601841 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:35.508673 27253 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.603183 24100 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.605990 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:35.607551 27502 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:18:35.607928 27453 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:35.607929 27458 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.609717 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:35.611641 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:35.612269 24066 leader_election.cc:400] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13.
I20260709 12:18:35.612635 24066 leader_election.cc:403] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:35.612272 24094 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.580314 27481 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:35.604005 24214 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:35.615307 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:35.541312 27448 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.619258 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:35.601608 27378 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:35.624811 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.624953 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:35.628988 24099 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:35.617945 27451 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:18:35.635733 27251 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:35.636121 27500 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:35.635066 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:35.639390 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.639559 27353 tablet_copy_client.cc:806] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:18:35.621155 27239 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:18:35.640563 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet c29a1bdc82674a4ab1ad6c3b54c69e25 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:18:35.551383 27482 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.645040 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.651467 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:35.652459 24245 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:35.621454 27458 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13.
I20260709 12:18:35.631469 27481 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:35.673022 24246 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:18:35.653699 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.739145 24250 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
W20260709 12:18:35.676910 27476 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.529s	user 0.011s	sys 0.003s
I20260709 12:18:35.628424 27488 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:35.664299 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.733321 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 71455.2us
I20260709 12:18:35.665875 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:35.653223 24247 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
W20260709 12:18:35.736924 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 113034us
W20260709 12:18:35.677599 27272 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.003s
W20260709 12:18:35.741882 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 128200us
I20260709 12:18:35.658008 27282 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.653473 27378 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:35.657636 27451 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:35.668673 27459 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:35.759721 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.644675 27448 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:35.738090 27309 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260709 12:18:35.675424 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.776459 24067 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.768s (SENT)
I20260709 12:18:35.746120 27481 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:35.778420 24215 leader_election.cc:400] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:18:35.654619 27253 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.763634 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.805038 24246 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:35.781965 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:35.804486 24215 leader_election.cc:403] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:35.783285 24175 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:35.807621 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:35.735932 27269 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.810253 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.732120 27447 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:18:35.810959 24246 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:35.798878 27416 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:35.811792 27445 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:18:35.812502 27474 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.812780 27481 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:35.815448 27480 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.007s
I20260709 12:18:35.799881 24067 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:35.816045 27480 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
W20260709 12:18:35.819291 27485 consensus_meta.cc:287] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.689s	user 0.013s	sys 0.002s
I20260709 12:18:35.647119 27331 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.120s
I20260709 12:18:35.785892 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:35.800551 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.854809 24812 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:35.854938 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:35.738329 23985 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 97953.5us
I20260709 12:18:35.813107 27474 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.784430 24214 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:35.820433 27451 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.784511 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.728796 27500 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.747587 27239 consensus_queue.cc:1243] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:18:35.782729 27488 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.788285 27459 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:35.829867 27378 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.833324 24242 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:18:35.841358 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.843523 24094 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:35.847940 24173 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:35.849054 24100 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:35.855756 24249 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
W20260709 12:18:35.896061 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 111705us
I20260709 12:18:35.854310 27421 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:35.787484 27460 consensus_meta.cc:287] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.100s	user 0.013s	sys 0.004s
I20260709 12:18:35.827255 27494 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:18:35.902797 24245 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:35.906212 24092 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:35.910187 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:35.795327 27353 tablet_copy_client.cc:670] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:18:35.904074 27461 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:35.914140 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 66558us
W20260709 12:18:35.914707 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 106099us
I20260709 12:18:35.916749 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:35.926035 24094 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.916608 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:35.903052 27445 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:35.769750 27476 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:35.924237 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.922869 24214 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:35.915508 27488 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:35.927927 24245 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:18:35.918740 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 142335us
I20260709 12:18:35.913594 27459 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:35.917263 27239 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.926870 24100 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:35.912200 27225 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.864137 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:35.895840 27416 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
W20260709 12:18:35.933719 24067 leader_election.cc:336] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.930s (SENT)
I20260709 12:18:35.941962 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:35.934842 27477 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.928814 24215 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:35.937740 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:35.934300 27490 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:35.946247 24092 raft_consensus.cc:606] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:35.946678 24092 raft_consensus.cc:614] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:35.955006 24094 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:35.921823 27421 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.925251 27460 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.860069 27485 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:35.945483 27121 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:18:35.967754 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:35.963820 27253 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:35.953037 27494 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:35.979558 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:35.980521 24216 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.804s (SENT)
I20260709 12:18:35.980917 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:35.984531 24100 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:35.985656 27253 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:35.988114 27253 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:35.989269 27490 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:35.989820 27490 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:35.952257 27448 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.990612 27253 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:35.967085 27301 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:18:35.941239 27239 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.006659 24100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:36.008788 24176 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:35.944598 27225 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:36.016008 27225 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:35.993198 27458 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:36.008018 24100 raft_consensus.cc:606] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:36.019076 27445 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:36.020927 27476 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.025677 24094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:36.026460 24094 raft_consensus.cc:606] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:36.026911 24094 raft_consensus.cc:614] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:36.035557 27499 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:35.992424 27494 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.042840 27272 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:35.957818 27477 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.038540 27251 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:36.040601 27499 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:36.054109 27484 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.021s	sys 0.058s
I20260709 12:18:36.006217 27121 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:36.002494 27448 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.043913 27494 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:36.069836 27484 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.060s	user 0.022s	sys 0.059s
I20260709 12:18:36.055285 27272 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.145130 27269 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:36.144609 27121 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.151962 27453 raft_consensus.cc:3055] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:36.152439 27453 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:36.153373 27453 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:36.168781 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 239796us
I20260709 12:18:36.154894 27453 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.163512 27500 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:36.220767 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 201861us
I20260709 12:18:36.157298 27499 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:36.225890 24216 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.111s (SENT)
I20260709 12:18:36.230453 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:36.230629 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:36.209508 27485 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:36.233851 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 300173us
I20260709 12:18:36.219759 27421 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:36.224258 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 282052us
I20260709 12:18:36.237998 27269 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:36.250309 24216 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.124s (SENT)
I20260709 12:18:36.251085 24216 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:36.257973 24066 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:36.269966 27480 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:36.239193 27239 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.239574 27460 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:36.285193 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:36.286070 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.287971 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.288877 24096 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
W20260709 12:18:36.293416 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 58851.6us
W20260709 12:18:36.296998 24067 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.521s (SENT)
I20260709 12:18:36.289520 27272 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.298686 24781 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:18:36.303531 24067 leader_election.cc:336] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.829s (SENT)
I20260709 12:18:36.304160 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:36.289953 27269 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:36.261603 27458 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
W20260709 12:18:36.315378 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 65135.4us
W20260709 12:18:36.319553 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.293463 27448 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.319314 27517 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.325043 27477 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.325634 27517 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.329700 27517 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.330622 27517 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:36.351183 27482 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.353762 27422 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.355559 27495 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:36.356227 27495 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:36.357571 27495 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:36.317605 27421 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:36.360515 27421 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:36.361816 27421 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.362906 27473 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:36.363179 27514 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.263s	user 0.004s	sys 0.000s
I20260709 12:18:36.363575 27473 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:36.364073 27473 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.366297 27473 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:36.385916 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 90319.5us
I20260709 12:18:36.396490 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:36.397357 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:36.399526 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 74803.3us
I20260709 12:18:36.397634 24101 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:36.390769 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:36.402741 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:36.403453 24812 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
W20260709 12:18:36.404745 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.406643 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.409471 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:36.398566 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:36.411743 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.402318 24066 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:36.412498 24214 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:36.414534 24066 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:36.420686 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 117193us
I20260709 12:18:36.425442 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:36.425760 24067 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.046s (SENT)
I20260709 12:18:36.426079 24101 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.426331 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:36.420372 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.311143 27515 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:36.421382 24066 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:36.431160 24092 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:36.434134 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.411180 27422 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:18:36.436757 27488 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:36.410905 27518 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:36.419832 27460 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:36.444097 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 495) took 1025 ms. Trace:
I20260709 12:18:36.449854 24176 rpcz_store.cc:276] 0709 12:18:35.418848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.419033 (+   185us) service_pool.cc:224] Handling call
0709 12:18:35.442194 (+ 23161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.009433 (+567239us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:36.440319 (+430886us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54002ae9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:36.444009 (+  3690us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1298069888}
I20260709 12:18:36.423904 27461 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:36.454843 24810 raft_consensus.cc:2393] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:36.457755 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.428803 27529 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:18:36.455330 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.461925 27458 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:18:36.431123 27495 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.471740 24242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "984475bb8f024d469921acdc98196b93"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:36.472455 24242 raft_consensus.cc:606] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:36.472844 24242 raft_consensus.cc:614] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:36.475925 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.460638 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:36.430914 27524 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:36.447649 27474 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:36.464659 27530 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:36.506371 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:36.486794 27489 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:36.451292 27518 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.492089 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.515642 24094 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:36.492431 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.492925 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.493647 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:36.517031 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 56540.3us
I20260709 12:18:36.488554 27490 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:36.495042 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 65484.3us
I20260709 12:18:36.495488 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.495971 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.445710 27515 raft_consensus.cc:697] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:36.464395 27529 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.458133 27461 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.474896 27460 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:36.514489 24096 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:18:36.517072 24093 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.521205 24098 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.521636 24214 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:36.525485 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.513981 24101 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:36.528764 27524 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:36.540540 27524 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.544740 27515 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:36.505582 27272 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:36.547127 27499 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.547495 27272 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.549842 27272 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.533349 24096 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: [8.4-8.4]
I20260709 12:18:36.531461 24099 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:36.510442 27448 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:36.528760 27474 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:36.510377 27453 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:36.511333 27530 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:36.566207 24169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:36.585801 27530 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:36.567133 27460 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:36.534966 27480 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:36.537144 27473 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:18:36.537930 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:36.584717 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:36.593555 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.594355 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.528596 27461 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.517807 27518 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.571074 24092 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:36.557209 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:36.557721 24779 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:36.605118 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:36.609383 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 51769.8us
I20260709 12:18:36.558017 24248 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:18:36.561730 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.554838 24097 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:36.563342 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.564404 24099 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:36.613330 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:36.562065 24098 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:36.584097 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:36.515793 27416 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:36.564677 27459 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.612s	user 0.013s	sys 0.001s
I20260709 12:18:36.565685 27488 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.586069 24169 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:36.590560 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:36.529788 27529 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:36.602451 24216 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.890s (SENT)
I20260709 12:18:36.603436 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:36.620764 24169 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:36.568862 27474 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:36.626657 24097 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:36.627029 27474 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:36.619407 24096 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 4: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:36.589953 27494 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:36.564124 27490 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:36.615706 24242 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:36.621203 27272 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:36.621398 27239 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:18:36.619200 27439 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:36.625569 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.619277 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:36.655800 24094 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:36.656415 24246 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:36.635418 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:36.644929 24169 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.632982 27459 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:36.658002 24168 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:18:36.593973 27453 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:36.675177 24169 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.676555 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:36.677362 24169 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:36.678510 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:36.659713 27272 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:36.679708 24169 raft_consensus.cc:2368] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9.
I20260709 12:18:36.680464 27272 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:36.666023 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.621505 27497 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:36.611337 27121 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:18:36.669502 24172 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:36.671504 27459 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:36.671813 27494 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:36.672008 24250 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:36.674094 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:36.702174 24168 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:36.632304 27416 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.680828 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:36.655719 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 229971us
W20260709 12:18:36.725566 24067 leader_election.cc:336] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.100s (SENT)
I20260709 12:18:36.568498 27448 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.691614 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:36.698794 24094 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:18:36.728421 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.729319 24094 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:36.676699 27453 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:36.726549 24169 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:36.734328 24174 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:36.738937 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:36.740032 24174 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:36.740981 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:36.737674 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:36.743912 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:36.741679 24174 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:36.744866 24169 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:36.745514 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:36.746961 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:36.734937 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:36.750139 24099 raft_consensus.cc:2368] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
W20260709 12:18:36.750824 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 148429us
I20260709 12:18:36.753476 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:36.758114 24167 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:36.760017 24167 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:18:36.760370 24167 pending_rounds.cc:85] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 4
I20260709 12:18:36.760622 24167 pending_rounds.cc:107] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:18:36.760856 24167 raft_consensus.cc:2889] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:36.761655 24170 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:36.764580 27448 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.765486 27474 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.765995 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:36.766681 24247 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:36.766820 24243 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 10: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:36.766952 24168 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:36.767714 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:36.768824 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:36.769826 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:36.770459 24247 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:36.772579 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:36.772629 24169 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:36.773496 24246 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:36.774322 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:36.779485 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.700842 27481 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:36.780684 24094 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
W20260709 12:18:36.767879 27528 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:18:36.778564 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:36.761165 24167 pending_rounds.cc:107] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:18:37.510347 24167 raft_consensus.cc:2889] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:36.839892 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 149963us
I20260709 12:18:37.395916 27416 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:37.513376 27416 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:37.510486 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:37.514500 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.792318 24093 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
W20260709 12:18:37.515465 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.513900 27416 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.516016 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1722) took 1023 ms. Trace:
I20260709 12:18:37.516400 27416 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:37.516688 24093 rpcz_store.cc:276] 0709 12:18:36.492358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.492659 (+   301us) service_pool.cc:224] Handling call
0709 12:18:37.515915 (+1023256us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:37.518492 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 792924us
W20260709 12:18:37.519276 24216 leader_election.cc:336] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.543s (SENT)
I20260709 12:18:37.505082 27474 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:37.519950 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:37.520259 27474 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.520915 27474 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:37.514559 27499 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.967s	user 0.013s	sys 0.001s
W20260709 12:18:37.534539 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 756017us
W20260709 12:18:37.536978 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:36.944551 27495 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:37.540793 27495 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:36.839543 27517 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.703s
I20260709 12:18:37.542204 27554 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.543206 27554 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.725061 27497 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:37.545814 27497 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.546403 27554 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:37.244272 27494 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:37.559517 24247 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:37.115741 27485 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:36.972129 27482 consensus_meta.cc:287] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.620s	user 0.012s	sys 0.002s
I20260709 12:18:37.560774 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:37.549518 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:37.123116 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:37.562479 24171 raft_consensus.cc:2376] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8. Re-sending same reply.
I20260709 12:18:36.909600 27121 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:37.563028 27554 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:18:37.016317 27532 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.454s	user 0.001s	sys 0.001s
I20260709 12:18:37.553695 27557 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:37.563581 27121 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:37.564069 27557 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:36.839939 24170 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:37.554070 27269 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:37.554490 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.566892 27269 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:37.567531 24216 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.963s (SENT)
I20260709 12:18:37.568045 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:37.566439 27121 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:37.560798 27485 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.562583 24173 raft_consensus.cc:2410] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:37.573720 27485 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:37.574402 27485 consensus_queue.cc:1059] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:18:37.570443 27269 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:37.571240 27121 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.563053 27416 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.582748 27477 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:37.583393 27477 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:37.583897 27416 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:37.566435 27557 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:37.575412 24092 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.008s	sys 0.013s
W20260709 12:18:37.584939 24092 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.009s	sys 0.013s
I20260709 12:18:37.585671 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2189) took 1032 ms. Trace:
I20260709 12:18:37.585768 27477 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:37.575742 24248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.007s	sys 0.011s
W20260709 12:18:37.588327 24248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.698s	user 0.007s	sys 0.011s
I20260709 12:18:37.590020 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:37.590796 24248 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:37.575786 24095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.004s	sys 0.018s
W20260709 12:18:37.591825 24095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.004s	sys 0.018s
I20260709 12:18:37.592084 24169 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:18:36.965663 27538 log.cc:927] Time spent T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:37.559855 27494 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:37.205610 24245 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.018s	sys 0.019s
I20260709 12:18:37.511857 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:37.060393 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:36.781962 24214 leader_election.cc:400] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
W20260709 12:18:37.154675 24250 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1664) took 1314 ms (client timeout 1663 ms). Trace:
I20260709 12:18:37.599463 24214 leader_election.cc:403] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:18:37.146309 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:37.578121 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 58807.7us
I20260709 12:18:37.551131 27481 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.579073 24249 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:37.602751 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:37.602926 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 821152us
I20260709 12:18:37.603641 24249 raft_consensus.cc:2410] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:37.580817 27519 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:37.581105 27301 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:36.788904 27536 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
W20260709 12:18:37.476927 27540 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.547s	user 0.002s	sys 0.000s
I20260709 12:18:37.586105 24092 rpcz_store.cc:276] 0709 12:18:36.552896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.619344 (+ 66448us) service_pool.cc:224] Handling call
0709 12:18:36.619635 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:36.619874 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:36.648518 (+ 28644us) log.cc:844] Serialized 14 byte log entry
0709 12:18:37.585303 (+936785us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:37.585365 (+    62us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:37.585417 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.585493 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.585611 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":116614,"prepare.queue_time_us":28968,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":57660,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":25411,"thread_start_us":917924,"threads_started":1}
W20260709 12:18:37.598835 24245 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.974s	user 0.020s	sys 0.024s
I20260709 12:18:37.607362 24174 raft_consensus.cc:2410] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 12:18:37.599709 24250 rpcz_store.cc:269] 0709 12:18:35.746479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:35.746650 (+   171us) service_pool.cc:224] Handling call
0709 12:18:37.060623 (+1313973us) spinlock_profiling.cc:243] Waited 776 ms on lock 0x7b54003598d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:37.060783 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1784246016}
I20260709 12:18:37.607712 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:36.925122 27524 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:37.609534 24097 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:37.627094 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1672) took 1051 ms. Trace:
I20260709 12:18:37.627398 24169 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:18:37.575867 27272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.006s	sys 0.016s
I20260709 12:18:37.612269 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:37.613988 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:37.622457 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:37.616355 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:37.621465 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:37.627609 24245 rpcz_store.cc:276] 0709 12:18:36.575779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.575922 (+   143us) service_pool.cc:224] Handling call
0709 12:18:36.576238 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.591304 (+ 15066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.591338 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.591788 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.626554 (+1034766us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:37.626629 (+    75us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.626735 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:37.626802 (+    67us) raft_consensus.cc:1685] finished
0709 12:18:37.626820 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:37.627010 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30539,"raft.queue_time_us":18693,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":7547,"thread_start_us":1001797,"threads_started":1,"wal-append.queue_time_us":899259}
I20260709 12:18:37.634012 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:37.637975 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:37.639046 24245 raft_consensus.cc:2410] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:37.639292 24810 raft_consensus.cc:2368] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:18:37.627997 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:37.631045 24170 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:37.640017 24243 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:37.634186 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:37.634415 27482 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:37.642678 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:37.632861 24093 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:37.633548 24249 raft_consensus.cc:2393] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:37.630656 24096 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:37.649330 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:37.649798 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:37.621603 27301 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:37.653618 27269 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:37.654223 27269 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.611538 27519 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.657261 27519 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:36.790100 27530 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.658245 24101 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:37.658519 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 146817us
W20260709 12:18:37.659651 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50341.9us
W20260709 12:18:37.632099 27272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.860s	user 0.006s	sys 0.016s
I20260709 12:18:37.671537 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:37.608225 27377 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:37.665546 24243 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:37.670257 24242 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:18:37.673280 24248 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:18:37.682750 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:37.682817 24250 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:37.687103 24097 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:18:37.689234 24216 leader_election.cc:336] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.583s (SENT)
I20260709 12:18:37.689888 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:37.691710 24170 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:18:37.641660 27485 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.715075 24097 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:18:37.715643 24216 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.610s (SENT)
I20260709 12:18:37.716135 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:37.645964 27482 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:37.701462 24101 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
W20260709 12:18:37.694212 27458 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.010s	sys 0.037s
W20260709 12:18:37.733477 27458 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.013s	sys 0.044s
I20260709 12:18:37.733983 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 2190) took 1163 ms. Trace:
I20260709 12:18:37.734400 24101 rpcz_store.cc:276] 0709 12:18:36.571137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.593282 (+ 22145us) service_pool.cc:224] Handling call
0709 12:18:37.733778 (+1140496us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001f54d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:37.733891 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2447038336}
I20260709 12:18:37.735682 24175 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:37.737458 27416 raft_consensus.cc:3055] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:37.737870 27416 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:37.737812 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:37.738337 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:37.739153 24170 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:37.739395 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:37.740168 24169 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:37.740079 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:37.740897 24171 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:37.742132 27481 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.742686 27481 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:37.745119 27481 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:37.752022 24093 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:37.713105 27121 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:18:37.720628 27353 tablet_copy_client.cc:538] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:18:37.694536 27461 consensus_meta.cc:287] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.064s	user 0.013s	sys 0.000s
I20260709 12:18:37.713371 27447 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:37.725284 27309 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:37.728905 27269 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:37.729856 27301 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:37.630200 27495 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:37.684620 27387 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.722424 27557 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:37.696919 27377 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:37.754122 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:37.754942 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.739648 27416 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.825186 27416 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.756167 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:37.756004 27456 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:18:37.806882 27439 consensus_meta.cc:287] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 1.139s	user 0.014s	sys 0.000s
I20260709 12:18:37.724921 27485 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.676708 27546 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:37.636655 27524 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:37.765420 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:37.772552 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 75954.2us
I20260709 12:18:37.773952 24215 leader_election.cc:400] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
W20260709 12:18:37.861370 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 87672.3us
I20260709 12:18:37.749706 27482 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.729662 27547 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:37.684952 27477 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:18:37.865185 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:37.760143 27481 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:37.807866 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:37.832059 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 115235us
I20260709 12:18:37.869444 24169 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:37.763059 27461 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:37.759577 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 43976.7us
W20260709 12:18:37.852025 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 97991.5us
I20260709 12:18:37.836287 24171 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
W20260709 12:18:37.859058 24098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.020s	sys 0.011s
I20260709 12:18:37.832217 27489 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:37.837651 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:37.887760 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:37.888640 24170 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:18:37.880910 24098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.020s	sys 0.011s
I20260709 12:18:37.858835 27439 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:37.859274 27546 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:37.858779 27561 raft_consensus.cc:2764] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:18:37.893311 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:37.904385 24216 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.862s (SENT)
I20260709 12:18:37.865584 27269 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.869732 27474 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:37.926304 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:37.915932 24100 raft_consensus.cc:2368] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:37.918766 24169 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:37.919384 24171 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:37.929066 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:37.919853 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:37.842130 27387 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:37.934051 24176 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:37.934470 27566 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:37.935042 27566 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.936582 27387 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:37.937368 27566 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:37.939527 24812 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:37.930338 24101 raft_consensus.cc:2410] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 14 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:18:37.944829 24249 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
W20260709 12:18:37.921903 24067 connection.cc:256] RPC call timeout handler was delayed by -1.5844876289997956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1948s for a response
W20260709 12:18:37.946813 24067 connection.cc:256] RPC call timeout handler was delayed by -1.565787612999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
I20260709 12:18:37.947892 24249 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 9. Ops: []
I20260709 12:18:37.950944 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:37.952189 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:37.947764 24067 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.731s (SENT)
W20260709 12:18:37.955585 27552 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:18:37.894795 27489 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:37.940562 27269 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:37.957926 27377 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:37.959080 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:37.959627 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:37.962430 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:37.963344 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:37.963778 24243 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:37.964184 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:37.964783 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:37.964929 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:37.965427 24095 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:37.965638 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:38.039321 24168 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:38.039547 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:37.966964 24215 consensus_peers.cc:597] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:18:38.040310 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 73543.7us
I20260709 12:18:37.964214 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:37.968303 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 202568us
W20260709 12:18:37.968582 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64270.4us
I20260709 12:18:37.972491 27562 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:37.909754 27546 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:37.973922 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:38.002475 24812 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:37.941196 27447 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:18:38.007328 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 59631.4us
W20260709 12:18:38.008267 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 119843us
I20260709 12:18:38.012496 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:37.971132 27530 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:38.008278 27518 consensus_meta.cc:287] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.386s	user 0.011s	sys 0.004s
I20260709 12:18:38.014148 24176 raft_consensus.cc:2376] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7. Re-sending same reply.
I20260709 12:18:38.015976 24173 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:37.963793 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:37.969765 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:38.040278 24247 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:38.006052 27481 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:18:38.010059 27458 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:18:38.013767 27456 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 12:18:38.277585 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.244586 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.283947 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.032474 27571 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.277s
I20260709 12:18:38.291402 27518 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:38.013496 27570 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.262s
W20260709 12:18:38.277778 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 304440us
I20260709 12:18:37.634544 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:38.319252 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.401949 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 432279us
W20260709 12:18:38.389308 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.268002 27499 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.540120 27499 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:38.542575 27499 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:38.543962 27269 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:38.544618 27269 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:38.546370 27529 consensus_meta.cc:287] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.910s	user 0.002s	sys 0.011s
I20260709 12:18:38.534548 27564 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 12:18:38.452196 27565 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.476s	user 0.001s	sys 0.000s
W20260709 12:18:38.325367 27569 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 12:18:38.268052 27547 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:38.289300 24175 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
W20260709 12:18:38.523501 24067 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.838s (SENT)
I20260709 12:18:38.558614 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:38.243340 27477 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:38.522245 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:38.515681 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.002s	sys 0.008s
W20260709 12:18:38.523586 24216 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.216s (SENT)
W20260709 12:18:38.561342 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.003s	sys 0.008s
W20260709 12:18:38.561993 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 683049us
I20260709 12:18:38.451747 27447 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:38.527360 27272 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.007s
I20260709 12:18:38.526335 27563 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.523162 27530 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:38.566220 24216 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:38.567786 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 45639.4us
W20260709 12:18:38.565570 27272 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.006s	sys 0.007s
I20260709 12:18:38.546933 27529 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:38.573410 27353 tablet_bootstrap.cc:492] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
W20260709 12:18:38.577291 27482 consensus_meta.cc:287] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.702s	user 0.010s	sys 0.001s
I20260709 12:18:38.560811 27485 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:38.522672 27497 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.584052 27461 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:38.595651 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 75543us
W20260709 12:18:38.584148 24242 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.004s	sys 0.012s
W20260709 12:18:38.622442 24242 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.004s	sys 0.013s
I20260709 12:18:38.592393 27524 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:38.623232 24214 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:38.632418 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1782) took 1056 ms. Trace:
I20260709 12:18:38.632863 24245 rpcz_store.cc:276] 0709 12:18:37.575893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.716655 (+140762us) service_pool.cc:224] Handling call
0709 12:18:37.719210 (+  2555us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:37.726708 (+  7498us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.726746 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:37.727754 (+  1008us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.812310 (+ 84556us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:37.812368 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.812971 (+   603us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.632138 (+819167us) raft_consensus.cc:1685] finished
0709 12:18:38.632163 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.632334 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":21437,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":81231,"threads_started":1,"wal-append.queue_time_us":212134}
W20260709 12:18:38.643781 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 365622us
I20260709 12:18:38.579396 27477 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:38.568590 27547 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:38.618448 27458 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.632910 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:38.621675 27576 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.635445 27524 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:38.664067 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 140503us
I20260709 12:18:38.655445 27489 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:38.594688 27563 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:38.613132 27530 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:38.628930 27572 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:38.642769 27557 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:38.621810 27482 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:38.666712 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 144199us
W20260709 12:18:38.665083 27567 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.624s	user 0.002s	sys 0.000s
I20260709 12:18:38.657366 27518 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:38.710739 24171 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:38.626847 27497 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:38.709187 24216 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.218s (SENT)
I20260709 12:18:38.720072 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:38.722749 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:38.732223 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:38.712507 27481 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:38.734637 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 90047.7us
W20260709 12:18:38.740829 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.739652 24067 connection.cc:256] RPC call timeout handler was delayed by -1.2689997850000054s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1515s for a response
W20260709 12:18:38.742458 24067 connection.cc:256] RPC call timeout handler was delayed by -1.2572997849999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
W20260709 12:18:38.740666 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 143266us
W20260709 12:18:38.744976 24067 connection.cc:256] RPC call timeout handler was delayed by -1.2351707169998463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 12:18:38.745350 24067 connection.cc:256] RPC call timeout handler was delayed by -1.1415707169999223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
W20260709 12:18:38.745723 24067 connection.cc:256] RPC call timeout handler was delayed by -1.0455329489998348s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3191s for a response
I20260709 12:18:38.724349 27572 raft_consensus.cc:697] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:38.745738 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:38.738574 27416 consensus_meta.cc:287] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.913s	user 0.014s	sys 0.002s
I20260709 12:18:38.665807 27576 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:38.779107 24067 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.515s (SENT)
I20260709 12:18:38.784065 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:38.786588 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 63157.9us
W20260709 12:18:38.790803 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 81850us
I20260709 12:18:38.747026 27458 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.795861 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:38.738185 27581 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:38.771847 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:38.797675 24170 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:18:38.826179 24170 pending_rounds.cc:85] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 3
I20260709 12:18:38.826604 24170 pending_rounds.cc:107] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:18:38.826936 24170 raft_consensus.cc:2889] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:38.827437 24170 pending_rounds.cc:107] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:18:38.827816 24170 raft_consensus.cc:2889] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:38.822573 24067 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.870s (SENT)
I20260709 12:18:38.781570 27519 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:38.838495 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 330) took 2061 ms. Trace:
I20260709 12:18:38.817348 27458 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:38.844372 27530 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:38.847966 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 430) took 2212 ms. Trace:
W20260709 12:18:38.863946 27586 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:18:38.864224 24098 rpcz_store.cc:276] 0709 12:18:36.605062 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.623838 (+ 18776us) service_pool.cc:224] Handling call
0709 12:18:36.632572 (+  8734us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:36.654305 (+ 21733us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:36.654336 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:36.966839 (+312503us) spinlock_profiling.cc:243] Waited 13.5 ms on lock 0x7b2c000014c8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2
0709 12:18:36.967616 (+   777us) log.cc:844] Serialized 26 byte log entry
0709 12:18:37.894162 (+926546us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:37.894208 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:37.894281 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:38.796048 (+901767us) raft_consensus.cc:1685] finished
0709 12:18:38.796080 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.816962 (+ 20882us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32095,"raft.queue_time_us":69060,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":41021,"spinlock_wait_cycles":31161600,"thread_start_us":924201,"threads_started":1,"wal-append.queue_time_us":973429}
I20260709 12:18:38.865713 27494 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:38.866894 27482 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:38.847018 24241 rpcz_store.cc:276] 0709 12:18:36.777049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.526045 (+748996us) service_pool.cc:224] Handling call
0709 12:18:37.561703 (+ 35658us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:37.561910 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:37.884339 (+322429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:37.884373 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:37.884416 (+    43us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:18:37.884461 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:38.838086 (+953625us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b54003589d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:38.838173 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:38.838395 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820339328}
I20260709 12:18:38.791426 27272 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:38.856784 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:38.860210 27576 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:38.860846 27582 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.147s	user 0.002s	sys 0.000s
I20260709 12:18:38.862742 27563 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:38.878305 24098 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:38.863272 27458 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:38.863431 27594 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:38.791174 27557 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:38.874578 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:38.795732 27524 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.798260 27461 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:38.871280 24095 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 4.
W20260709 12:18:38.890031 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.888612 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 164653us
I20260709 12:18:38.897970 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:38.868193 27519 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:38.909185 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:38.910002 24242 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:38.880375 27572 consensus_queue.cc:237] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:38.888233 27594 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:38.914021 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:38.912873 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 90340.6us
I20260709 12:18:38.904349 27481 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:38.965934 27547 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:38.992296 24244 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:38.966370 27477 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:38.967197 27529 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:38.971706 27272 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:18:38.967864 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:38.922616 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:38.919596 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:18:39.002286 24216 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.001s (SENT)
W20260709 12:18:39.002890 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:38.916067 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.005190 27547 consensus_queue.cc:1059] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:18:39.007433 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:39.009541 24216 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.106s (SENT)
W20260709 12:18:39.013511 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.014508 24067 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.033s (SENT)
I20260709 12:18:39.017633 24067 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:38.966358 27497 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:39.019148 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.020752 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.021291 24171 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:39.021656 24175 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:38.995594 27517 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:18:38.965875 27557 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.031368 27477 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:39.068276 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53806.2us
W20260709 12:18:39.073817 24067 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.089s (SENT)
I20260709 12:18:39.039309 27458 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:18:39.087638 24067 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:39.118342 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.121294 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48331.4us
I20260709 12:18:39.122370 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:38.993642 27481 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.077354 27574 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.143759 24244 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
W20260709 12:18:39.151350 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.124327 27519 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:39.153350 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 79609.2us
W20260709 12:18:39.154143 24067 leader_election.cc:336] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.168s (SENT)
I20260709 12:18:39.154016 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:39.154922 24095 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
W20260709 12:18:39.155435 24067 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.244s (SENT)
I20260709 12:18:39.156023 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:39.160748 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:39.161499 24246 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:39.169446 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:39.172761 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:39.174286 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:39.175020 27599 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:39.175555 27599 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:39.175976 27599 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.177590 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:39.178854 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:39.179598 24245 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 4.
W20260709 12:18:39.134128 27546 consensus_meta.cc:287] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.889s	user 0.015s	sys 0.000s
I20260709 12:18:39.180500 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:39.180429 27546 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.181135 24242 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
W20260709 12:18:39.181257 24100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1721) took 2689 ms (client timeout 1646 ms). Trace:
W20260709 12:18:39.181855 24100 rpcz_store.cc:269] 0709 12:18:36.492013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.492149 (+   136us) service_pool.cc:224] Handling call
0709 12:18:39.180947 (+2688798us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400391554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:39.181130 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3216874752}
I20260709 12:18:39.133001 27583 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:39.189980 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:39.194380 24242 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:39.127079 27596 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.193445 27546 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:39.075737 27477 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.199898 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:39.199844 27458 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:39.202205 24246 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
W20260709 12:18:39.267730 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 67944.8us
I20260709 12:18:39.287192 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:39.257340 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:39.288130 24247 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:39.227306 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:39.227111 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:39.289072 24241 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.221069 27596 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.276933 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:39.327126 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50273.6us
I20260709 12:18:39.328769 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:39.278903 27477 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:39.242383 27460 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:39.208238 24067 leader_election.cc:336] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 3.417s (SENT)
W20260709 12:18:39.245046 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 230509us
I20260709 12:18:39.282035 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:39.241849 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:39.285959 27377 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:39.331203 27495 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:39.263151 27594 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:39.334169 27596 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:39.319794 27546 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:39.336762 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:39.340386 24246 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:39.285804 27572 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.360951 24247 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:39.391175 24241 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:39.390673 24246 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
W20260709 12:18:39.401157 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 64463.9us
I20260709 12:18:39.348206 27377 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:39.389321 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 192498us
I20260709 12:18:39.301088 27458 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.345788 27461 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:39.419129 24066 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:39.349073 27460 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.414214 27377 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:39.431691 27604 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:18:39.410926 27447 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:18:39.434962 24066 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:39.436388 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:39.437251 27574 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:39.425379 27461 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.437772 27574 raft_consensus.cc:697] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:39.438338 27461 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:39.438355 27529 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:39.439822 27529 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:39.439116 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:39.440960 27529 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.442552 27518 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:39.443370 27272 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:39.443943 27272 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.433441 27583 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:39.412569 27561 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:18:39.458560 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.455241 27561 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.471606 27561 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:39.476532 27458 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:39.478080 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:39.481043 27578 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.858s	user 0.006s	sys 0.002s
I20260709 12:18:39.478240 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:39.439086 27574 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.488997 24241 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:39.427873 27546 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:18:39.456534 27583 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:39.499540 27272 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:39.504657 27460 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:39.504387 27583 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:39.508034 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.490928 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 138955us
I20260709 12:18:39.410250 27572 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.482689 27599 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.521953 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:39.525858 27599 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:39.529387 24781 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:39.530476 27617 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:39.530977 27617 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:39.531426 27617 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:39.535823 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:39.536592 27591 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.676s	user 0.000s	sys 0.003s
W20260709 12:18:39.539129 24067 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 3.522s (SENT)
I20260709 12:18:39.539619 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:39.543710 27599 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:39.544679 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:39.545327 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.546028 27561 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.539772 27563 raft_consensus.cc:3055] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:18:39.542622 27416 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.008s	sys 0.034s
W20260709 12:18:39.553187 27416 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.008s	sys 0.035s
I20260709 12:18:39.549211 27460 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:39.565625 24241 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:39.568014 27485 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.569208 27561 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:39.550628 27563 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:39.555514 27547 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:39.579636 24067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.608s (SENT) [suppressed 52 similar messages]
I20260709 12:18:39.595669 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:39.598177 24241 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:39.599390 24780 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:39.570114 27377 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.627219 24241 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
W20260709 12:18:39.629590 24216 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.546s (SENT)
I20260709 12:18:39.630144 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:39.630645 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:39.631451 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.577096 27461 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.574791 27460 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.576722 27485 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.608026 27599 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:39.587132 27547 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.642441 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.611346 27564 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:39.643162 24173 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:39.650938 24241 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:39.633750 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:39.649222 27461 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:39.633188 27596 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:39.654088 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:39.654767 24247 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:39.663743 24172 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 12:18:39.664232 24172 pending_rounds.cc:85] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 4
I20260709 12:18:39.664474 24172 pending_rounds.cc:107] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:18:39.664734 24172 raft_consensus.cc:2889] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:39.665477 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1560) took 1397 ms. Trace:
W20260709 12:18:39.653043 27611 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.236s	user 0.002s	sys 0.002s
I20260709 12:18:39.668129 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.665782 24172 rpcz_store.cc:276] 0709 12:18:38.271067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.640330 (+1369263us) service_pool.cc:224] Handling call
0709 12:18:39.656865 (+ 16535us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:39.665183 (+  8318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.665417 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:39.672051 24247 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:18:39.658108 27272 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:39.677570 27377 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:39.691956 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:39.680223 27485 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:39.694734 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.680378 27460 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:39.680905 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 360841us
I20260709 12:18:39.696702 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.683485 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:39.697746 24171 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:39.686172 24169 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:39.698158 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:39.631491 27563 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.649930 27599 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.693554 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.693266 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:39.702749 24173 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:39.671948 27572 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:39.698907 24174 raft_consensus.cc:2376] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7. Re-sending same reply.
I20260709 12:18:39.701834 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.697522 24176 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:39.711169 24096 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:18:39.711979 24167 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:39.701133 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:39.719651 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1559) took 1737 ms. Trace:
I20260709 12:18:39.720098 24170 rpcz_store.cc:276] 0709 12:18:37.982685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:38.031371 (+ 48686us) service_pool.cc:224] Handling call
0709 12:18:38.079496 (+ 48125us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:38.828508 (+749012us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:39.719400 (+890892us) spinlock_profiling.cc:243] Waited 718 ms on lock 0x7b5400199454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:39.719568 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1650566912}
W20260709 12:18:39.728120 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.735888 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.736836 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:39.737838 24093 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:39.694836 27272 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:39.746582 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:39.747709 24172 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:18:39.742774 24812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 497) took 2116 ms (client timeout 2131 ms). Trace:
W20260709 12:18:39.745661 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 90175.8us
I20260709 12:18:39.748708 24248 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 9. Ops: []
W20260709 12:18:39.749099 24812 rpcz_store.cc:269] 0709 12:18:37.614327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:37.615883 (+  1556us) service_pool.cc:224] Handling call
0709 12:18:39.730432 (+2114549us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54008589d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:39.730535 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":686903552}
I20260709 12:18:39.752140 24248 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:39.752274 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:39.758570 24173 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:39.759837 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:18:39.761032 27623 log.cc:927] Time spent T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:18:39.763146 27572 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:39.763706 24170 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:39.764868 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:39.765623 24167 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:39.767117 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:39.767781 24250 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:39.768148 27547 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:39.769192 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.769268 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:39.769652 24248 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14. Ops: [11.9-13.10]
I20260709 12:18:39.770018 24176 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:39.773124 27353 tablet_bootstrap.cc:492] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:18:39.774547 27353 tablet_bootstrap.cc:492] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:18:39.775288 27619 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:39.776615 27619 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:18:39.776970 27619 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:39.777936 27619 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.780002 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:39.779906 27272 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.781077 24093 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:39.783382 27625 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:39.783826 27625 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:39.784173 27625 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:39.786639 24248 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:39.787016 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:39.775460 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.790426 24174 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:39.759677 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:39.797151 24216 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.976s (SENT)
W20260709 12:18:39.805794 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46210.5us
W20260709 12:18:39.805843 24216 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.988s (SENT)
I20260709 12:18:39.815397 24176 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:39.766952 27599 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:39.806927 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:39.824149 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:39.832491 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:39.833189 24174 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:18:39.818266 27353 ts_tablet_manager.cc:1403] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 1.245s	user 0.045s	sys 0.038s
I20260709 12:18:39.832904 27587 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:39.811712 27610 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:39.843731 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.812502 27561 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:39.828177 27546 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:18:39.849973 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.850889 24173 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
W20260709 12:18:39.851477 24067 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.931s (SENT)
I20260709 12:18:39.830456 27619 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:39.811342 27387 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:18:39.850634 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:39.853276 24176 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:39.862994 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.866953 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.867887 24173 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:39.866375 27546 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:39.873567 27546 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:39.847347 27587 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.875635 24808 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:18:39.886247 27547 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:39.886976 27547 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:39.887903 27485 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:39.888140 27547 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.888551 27485 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.891909 27485 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:39.894059 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.900292 24174 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:39.903219 24167 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:39.904800 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.905859 24174 raft_consensus.cc:2376] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9. Re-sending same reply.
I20260709 12:18:39.903518 27485 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:39.902921 27561 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:39.948982 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:39.949894 24174 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:39.952358 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 140139us
I20260709 12:18:39.959378 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:39.960266 24176 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
W20260709 12:18:39.965153 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:39.969305 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:39.976229 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.009133 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.010080 24173 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:39.966305 27587 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:40.011739 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 144304us
I20260709 12:18:40.016404 24174 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:39.962926 27610 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:40.021808 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:40.027040 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:40.028151 24092 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:40.028481 27610 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:39.993494 27562 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:39.961319 27485 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:40.032845 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:40.036998 24067 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.117s (SENT)
I20260709 12:18:40.050490 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:40.051716 24100 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
W20260709 12:18:40.061520 27630 log.cc:927] Time spent T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:18:40.067135 27561 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:40.071956 27485 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:40.073879 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:40.074767 24175 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:40.075862 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.077906 24175 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:40.077504 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.079942 24170 raft_consensus.cc:2376] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10. Re-sending same reply.
I20260709 12:18:40.080188 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:40.076670 24099 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:40.077035 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.081525 24171 raft_consensus.cc:2376] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7. Re-sending same reply.
I20260709 12:18:40.035753 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:40.084121 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:40.123013 24216 leader_election.cc:336] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.550s (SENT)
W20260709 12:18:40.123750 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.123883 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:40.168372 24067 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.248s (SENT)
I20260709 12:18:40.199746 27490 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:40.201314 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.202116 24168 raft_consensus.cc:2376] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8. Re-sending same reply.
I20260709 12:18:40.265820 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:40.265424 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 97152.3us
I20260709 12:18:40.266875 24098 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:40.081322 27562 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:40.281132 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 158202us
I20260709 12:18:40.215790 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:40.291605 24174 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:40.286087 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:40.291985 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.285368 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 248990us
W20260709 12:18:40.222976 27577 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 1.646s	user 0.000s	sys 0.009s
I20260709 12:18:40.316062 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.316498 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:40.321306 24168 raft_consensus.cc:2368] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10.
W20260709 12:18:40.311636 27625 consensus_meta.cc:287] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.527s	user 0.025s	sys 0.007s
I20260709 12:18:40.292605 27477 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.289135 27571 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:18:40.327267 24214 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:40.316807 27490 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:40.343842 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.344726 24168 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
W20260709 12:18:40.329095 27617 consensus_meta.cc:287] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.797s	user 0.024s	sys 0.000s
I20260709 12:18:40.326408 27474 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:40.375695 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.373001 24242 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:40.378301 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 1704) took 1105 ms. Trace:
I20260709 12:18:40.378355 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:40.379019 24246 rpcz_store.cc:276] 0709 12:18:39.272756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.286882 (+ 14126us) service_pool.cc:224] Handling call
0709 12:18:40.378126 (+1091244us) spinlock_profiling.cc:243] Waited 52.5 ms on lock 0x7b54001dd8d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:40.378238 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":120727296}
I20260709 12:18:40.389226 24246 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:40.341683 27490 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:40.354436 27553 raft_consensus.cc:2764] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:18:40.332090 27494 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:18:40.407980 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.410526 27458 raft_consensus.cc:3055] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:40.411036 24245 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:40.411134 27458 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:40.411626 27353 raft_consensus.cc:359] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 8 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:40.412503 27458 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:40.414309 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.338128 27625 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:40.415143 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.339380 27477 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:40.415354 27529 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:40.407316 27490 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:40.367643 27617 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:40.429212 24244 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:40.430243 24248 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:40.432603 24174 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:40.435654 24169 raft_consensus.cc:2393] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:40.416386 27642 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:40.448923 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:40.449746 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.450032 24168 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:40.418958 27517 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:40.451910 27517 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:40.454502 24244 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:18:40.457050 24093 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:40.413710 27458 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:40.460991 27634 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:18:40.418809 27353 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
W20260709 12:18:40.464947 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.512008 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.418740 27572 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:18:40.466204 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.501262 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:40.485791 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 158682us
W20260709 12:18:40.512722 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.465304 24216 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.666s (SENT)
I20260709 12:18:40.519112 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:40.520491 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55236.9us
I20260709 12:18:40.513303 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.462662 27563 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:18:40.513537 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.472705 24175 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:40.511121 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:40.541049 24170 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:40.523602 24174 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:40.525475 24171 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:40.526414 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:40.527181 27353 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:40.527805 27617 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:40.518028 27621 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
W20260709 12:18:40.523557 27583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.006s	sys 0.011s
I20260709 12:18:40.553403 24214 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:40.529345 27559 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:40.478188 27650 log.cc:927] Time spent T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:40.470536 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.543828 24168 raft_consensus.cc:2368] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9.
I20260709 12:18:40.545523 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.438946 27529 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:40.465967 27642 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:40.558722 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.909380 24176 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:40.554459 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:40.910918 24175 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:40.911499 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:40.912329 24171 raft_consensus.cc:2368] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:18:40.913552 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:40.913817 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:40.730019 27489 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:40.677876 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:40.915903 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 358809us
I20260709 12:18:40.915805 27559 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:40.555691 27625 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:40.916939 27642 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:40.557837 27353 ts_tablet_manager.cc:1434] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.714s	user 0.011s	sys 0.001s
W20260709 12:18:40.561808 27583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.928s	user 0.006s	sys 0.011s
W20260709 12:18:40.918073 27353 ts_tablet_manager.cc:1467] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Tablet startup took 1077ms
I20260709 12:18:40.581121 27553 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:18:40.745549 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.919620 24172 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:40.914831 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:40.606261 24216 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.813s (SENT)
I20260709 12:18:40.940470 24170 raft_consensus.cc:2368] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8.
W20260709 12:18:40.941071 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 334882us
I20260709 12:18:40.915318 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:40.943773 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:40.962157 24216 leader_election.cc:336] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.914s (SENT)
I20260709 12:18:40.948992 24172 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:18:40.522233 27474 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:40.952099 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.964283 24172 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:40.679253 27282 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:40.914796 27489 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:40.593092 27477 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:40.809099 27517 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:40.593871 27562 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:40.918962 27559 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:40.961161 27490 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.511s	user 0.014s	sys 0.000s
I20260709 12:18:40.948766 24249 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:18:41.065753 24214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.004s	sys 0.017s
I20260709 12:18:40.983578 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:41.075270 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.099460 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 536250us
I20260709 12:18:41.100158 24172 raft_consensus.cc:2410] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:18:41.035235 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 118442us
I20260709 12:18:41.065150 24175 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:40.956516 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:41.103528 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.105348 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 143230us
W20260709 12:18:41.106428 24216 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.927s (SENT)
I20260709 12:18:41.119711 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.121223 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:41.124166 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:40.919234 27553 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:41.103068 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 146672us
I20260709 12:18:41.118574 24781 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:18:41.260075 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 156544us
W20260709 12:18:41.094115 27648 log.cc:927] Time spent T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.684s	user 0.003s	sys 0.009s
I20260709 12:18:41.261160 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:41.319115 24175 raft_consensus.cc:2368] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8.
W20260709 12:18:41.300865 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 182442us
W20260709 12:18:40.918514 27353 ts_tablet_manager.cc:1469] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Trace:
0709 12:18:31.070350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:31.073043 (+  2693us) service_pool.cc:224] Handling call
0709 12:18:31.401205 (+328162us) ts_tablet_manager.cc:934] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
0709 12:18:32.564360 (+1163155us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c024710ac 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248acaa 00007f4c0248abd2 00007f4c0a4ef131
0709 12:18:33.924156 (+1359796us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:18:34.845188 (+921032us) tablet_metadata.cc:665] Metadata flushed
0709 12:18:34.867322 (+ 22134us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:18:35.321644 (+454322us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:18:35.322110 (+   466us) tablet_replica.cc:206] Creating consensus instance
0709 12:18:35.322499 (+   389us) ts_tablet_manager.cc:989] Replica registered.
0709 12:18:35.322771 (+   272us) inbound_call.cc:177] Queueing success response
0709 12:18:36.346615 (+1023844us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18002c7f40. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02408c0a 00007f4c0bb48219 00007f4c02332ed8 00007f4c0248dde2 00007f4c0a4f2d23 00007f4c0a4f255d 00007f4c0a58e3d8 00007f4c0a5bff4e 00007f4c0a5a4fdd
0709 12:18:38.572922 (+2226307us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:18:39.843440 (+1270518us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:18:40.006551 (+163111us) tablet_replica.cc:261] Starting instrumentation
0709 12:18:40.060900 (+ 54349us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":85988,"mutex_wait_us":68342,"raft.queue_time_us":13005,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":23645,"spinlock_wait_cycles":57191040,"tablet-copy.queue_time_us":277983,"tablet-download-pool.queue_time_us":42929,"tablet-download-pool.run_cpu_time_us":1634,"tablet-download-pool.run_wall_time_us":1705501,"thread_start_us":1490640,"threads_started":2}
I20260709 12:18:41.304837 27571 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:41.027632 27658 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:41.028486 27573 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.277s
I20260709 12:18:40.559899 27494 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:18:40.968572 27489 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:40.756491 27654 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.550s
I20260709 12:18:41.300959 27561 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:41.315614 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.317307 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:41.343786 24172 raft_consensus.cc:2410] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 12:18:41.300257 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 193871us
W20260709 12:18:41.315994 27458 consensus_meta.cc:287] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.793s	user 0.005s	sys 0.007s
I20260709 12:18:41.323145 27447 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:41.332455 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.353658 24175 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:41.332719 24094 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:41.333662 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 530) took 1405 ms. Trace:
I20260709 12:18:41.300633 27517 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:18:41.109603 27572 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:41.108665 27529 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:41.297885 27553 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:41.299834 27378 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.345098 24174 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:41.374794 27378 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:41.375567 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.376502 24174 raft_consensus.cc:2410] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:41.377329 27378 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:41.378165 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:41.377451 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.380707 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.381255 24174 raft_consensus.cc:2410] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:41.381356 24175 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:41.382475 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.108381 27282 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:41.360515 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:41.384375 24172 raft_consensus.cc:2368] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:18:41.361241 24249 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:18:41.386053 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44066 (request call id 528) took 1470 ms. Trace:
I20260709 12:18:41.355579 24167 rpcz_store.cc:276] 0709 12:18:39.928559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.928767 (+   208us) service_pool.cc:224] Handling call
0709 12:18:39.940699 (+ 11932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:39.944466 (+  3767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:39.944506 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:39.960416 (+ 15910us) log.cc:844] Serialized 26 byte log entry
0709 12:18:40.332968 (+372552us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:40.380855 (+ 47887us) log.cc:844] Serialized 14 byte log entry
0709 12:18:40.381193 (+   338us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.381303 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:40.529747 (+148444us) spinlock_profiling.cc:243] Waited 3.36 ms on lock 0x7b1800385d20. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:41.093215 (+563468us) spinlock_profiling.cc:243] Waited 4.21 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:41.333405 (+240190us) raft_consensus.cc:1685] finished
0709 12:18:41.333429 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:41.333591 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44874,"prepare.queue_time_us":52553,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":61,"raft.queue_time_us":5069,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":9260,"spinlock_wait_cycles":17410688,"thread_start_us":325436,"threads_started":1,"wal-append.queue_time_us":412491}
I20260709 12:18:41.108121 27490 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:41.373000 27447 raft_consensus.cc:697] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:41.387493 24246 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:41.388094 27447 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:41.389545 27490 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:41.390029 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1803) took 1096 ms. Trace:
I20260709 12:18:41.364990 27572 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:41.390841 27572 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:41.390482 24246 rpcz_store.cc:276] 0709 12:18:40.293510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.390385 (+ 96875us) service_pool.cc:224] Handling call
0709 12:18:40.390806 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.387888 (+997082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.389771 (+  1883us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b540008cad4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:41.389962 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291693440}
I20260709 12:18:41.383104 24174 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:41.348043 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:41.386523 24169 rpcz_store.cc:276] 0709 12:18:39.893602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.893758 (+   156us) service_pool.cc:224] Handling call
0709 12:18:41.364065 (+1470307us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54002ae9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:41.364301 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1223028096}
I20260709 12:18:41.352036 24095 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:18:41.338079 27658 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:41.316413 27559 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:18:41.298353 27477 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:18:41.352644 27561 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:41.452929 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:41.456595 24241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.098s	sys 0.221s
W20260709 12:18:41.458261 24241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.098s	sys 0.221s
I20260709 12:18:41.458355 24174 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:41.339486 27571 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:41.386462 27282 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:41.475399 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.476387 24167 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:41.474529 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:41.422513 27664 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.423898 27663 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:41.493489 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:41.481496 27563 consensus_meta.cc:287] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.937s	user 0.010s	sys 0.005s
I20260709 12:18:41.457476 27529 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.497138 24172 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
W20260709 12:18:41.517568 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.442286 27269 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
W20260709 12:18:41.502377 27460 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.018s	sys 0.080s
I20260709 12:18:41.553676 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:41.555800 27460 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.019s	sys 0.080s
W20260709 12:18:41.566648 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 443628us
I20260709 12:18:41.569388 27561 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:41.585681 27658 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:41.595664 27665 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 12:18:41.548332 27529 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:41.500447 27664 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:41.610213 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.502097 27663 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:41.614744 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 190286us
I20260709 12:18:41.622846 24099 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:41.624708 24246 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:18:41.626237 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 256903us
W20260709 12:18:41.627486 24216 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.994s (SENT)
I20260709 12:18:41.627660 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:41.628539 24172 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:41.627694 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:41.630595 24249 raft_consensus.cc:2410] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 12:18:41.631234 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 331747us
W20260709 12:18:41.633090 24216 leader_election.cc:336] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.039s (SENT)
W20260709 12:18:41.637295 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:41.637156 24216 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.179s (SENT)
I20260709 12:18:41.639679 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:41.640244 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:41.646658 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.657073 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:41.626575 27662 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:41.631812 27559 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:41.631956 27642 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:41.620065 27517 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:18:41.702279 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:41.709667 24814 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:41.702572 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:41.711129 24246 raft_consensus.cc:2393] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:41.676656 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:41.617904 27652 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:18:41.704181 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 537) took 1160 ms. Trace:
I20260709 12:18:41.705705 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:41.644233 27562 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:41.721581 24172 raft_consensus.cc:2368] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9.
I20260709 12:18:41.715886 24171 rpcz_store.cc:276] 0709 12:18:40.543953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.960362 (+416409us) service_pool.cc:224] Handling call
0709 12:18:40.960731 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:40.960965 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:18:41.359263 (+398298us) log.cc:844] Serialized 14 byte log entry
0709 12:18:41.703796 (+344533us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:41.703854 (+    58us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:41.703916 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.703989 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:41.704104 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":540598,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":3568,"thread_start_us":739406,"threads_started":3}
I20260709 12:18:41.726449 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:41.660602 27477 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:18:41.769184 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.776002 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:41.808039 24812 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:41.906131 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 274171us
I20260709 12:18:41.907436 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:41.709865 27559 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:41.931591 27574 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:41.932646 27574 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:41.714003 27642 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:41.775563 27571 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:41.707808 27662 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:41.768576 27562 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.033804 24248 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:42.030731 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:41.998937 24814 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:18:41.940702 27671 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:42.047436 27671 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.048702 27652 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:42.049338 27652 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:42.050318 27664 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.051203 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:42.052358 27673 log.cc:927] Time spent T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:18:41.993187 27571 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:42.050738 27671 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:42.079746 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 172454us
I20260709 12:18:42.063242 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.043913 27670 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:42.069428 24099 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:42.082772 24172 raft_consensus.cc:2368] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:18:42.083091 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:42.067960 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 300171us
I20260709 12:18:42.084825 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:42.089592 27674 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
W20260709 12:18:42.091207 27675 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:18:42.099341 27570 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:42.103432 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-b29f161fe0e24b51ad5c1903bdc5112c received from {username='slave'} at 127.0.0.1:59766
I20260709 12:18:42.104195 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-b29f161fe0e24b51ad5c1903bdc5112c on tablet b29f161fe0e24b51ad5c1903bdc5112c with peer c090031f610346ed82285cd847bca6d6
I20260709 12:18:42.107448 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.107744 27662 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.108330 24167 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:42.109459 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.109944 27559 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.110208 24167 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:42.082126 27477 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:42.111450 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.112707 24175 raft_consensus.cc:2410] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:42.113893 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.061547 27529 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:42.115381 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.119973 27642 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:42.121593 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.122833 24171 raft_consensus.cc:2410] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:42.123951 27691 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:42.125090 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.069586 27666 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.460s	user 0.000s	sys 0.002s
I20260709 12:18:42.134459 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.135306 24171 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:42.114679 24175 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
W20260709 12:18:42.141609 24216 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.533s (SENT)
I20260709 12:18:42.082038 27571 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.112068 27477 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:42.129143 27553 consensus_meta.cc:287] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.676s	user 0.009s	sys 0.003s
I20260709 12:18:42.147511 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.147863 24215 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:42.137671 27670 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:18:42.151644 24216 leader_election.cc:336] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.577s (SENT)
I20260709 12:18:42.087837 27664 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:42.158049 24175 raft_consensus.cc:2410] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:18:42.159696 27553 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.161868 27664 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.162930 27477 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:42.164216 27664 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.164727 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1808) took 1625 ms. Trace:
I20260709 12:18:42.165132 24241 rpcz_store.cc:276] 0709 12:18:40.539399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.539578 (+   179us) service_pool.cc:224] Handling call
0709 12:18:40.563239 (+ 23661us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:40.729484 (+166245us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:40.729538 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:40.874185 (+144647us) log.cc:844] Serialized 26 byte log entry
0709 12:18:41.458701 (+584516us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:41.458750 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:41.458830 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.164444 (+705614us) raft_consensus.cc:1685] finished
0709 12:18:42.164466 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.164649 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":184827,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":55413,"thread_start_us":655727,"threads_started":2,"wal-append.queue_time_us":618615}
I20260709 12:18:42.167234 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.168810 27562 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.170003 24175 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:42.171244 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:42.176791 24216 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.807s (SENT)
W20260709 12:18:42.178318 24216 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.815s (SENT)
I20260709 12:18:42.178913 24216 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:42.180403 24216 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.859s (SENT)
I20260709 12:18:42.174115 24167 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
W20260709 12:18:42.184525 24216 leader_election.cc:336] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.865s (SENT)
I20260709 12:18:42.185395 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.186131 24216 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:42.187304 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.169837 27678 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:42.188769 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.169497 27663 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.175069 27686 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:42.216005 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.191088 24171 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:42.180035 27664 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:42.217725 24175 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:42.221537 24216 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.869s (SENT)
I20260709 12:18:42.237588 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.239022 24167 raft_consensus.cc:2410] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:42.149976 27693 consensus_queue.cc:1059] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 12:18:42.241043 24216 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.929s (SENT)
I20260709 12:18:42.242082 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.191907 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:42.242944 27692 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:42.244681 27695 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:42.243912 27664 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:42.189937 27572 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.798s	user 0.012s	sys 0.005s
I20260709 12:18:42.285557 24168 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:42.286363 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1906) took 1809 ms. Trace:
I20260709 12:18:42.288738 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:42.289558 24246 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:18:42.286680 24168 rpcz_store.cc:276] 0709 12:18:40.476690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.944405 (+467715us) service_pool.cc:224] Handling call
0709 12:18:42.285091 (+1340686us) spinlock_profiling.cc:243] Waited 5.18 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:42.285321 (+   230us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.286108 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.286304 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11907456}
I20260709 12:18:42.290603 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:42.292512 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:42.293094 24246 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 10: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:42.293241 24244 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:42.294296 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:42.294924 24246 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:42.295811 24170 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:18:42.296439 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1608) took 1822 ms. Trace:
I20260709 12:18:42.297109 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:42.246097 24216 leader_election.cc:336] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.097s (SENT)
I20260709 12:18:42.246799 24241 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:18:42.244416 24171 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:42.247970 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.303297 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.303355 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.304533 24171 raft_consensus.cc:2410] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:18:42.296732 24170 rpcz_store.cc:276] 0709 12:18:40.473657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.943676 (+470019us) service_pool.cc:224] Handling call
0709 12:18:42.295278 (+1351602us) spinlock_profiling.cc:243] Waited 5.54 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:42.295482 (+   204us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.296186 (+   704us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.296383 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12741504}
I20260709 12:18:42.307394 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.257385 27664 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:42.258490 23998 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 100) took 27692 ms (client timeout 15000 ms). Trace:
I20260709 12:18:40.705497 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:42.292512 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.312812 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:42.246389 27494 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.745s	user 0.011s	sys 0.007s
I20260709 12:18:42.259577 27670 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:42.326823 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 461) took 1878 ms. Trace:
I20260709 12:18:42.328522 24093 rpcz_store.cc:276] 0709 12:18:40.423993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.424437 (+   444us) service_pool.cc:224] Handling call
0709 12:18:40.424742 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:40.457638 (+ 32896us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.302358 (+1844720us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b540011b054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:42.302579 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73197824}
I20260709 12:18:42.260356 27695 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.262317 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:42.235178 27686 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.263149 24811 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 8 LEARNER]: Advancing to term 9
I20260709 12:18:42.260969 27553 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.263775 27693 consensus_queue.cc:1243] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:18:42.268206 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:42.271549 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 340) took 2503 ms. Trace:
I20260709 12:18:42.340447 24250 rpcz_store.cc:276] 0709 12:18:39.768393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:39.774754 (+  6361us) service_pool.cc:224] Handling call
0709 12:18:40.533125 (+758371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:40.533315 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:40.533340 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:40.533377 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:40.533407 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:40.533457 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.271285 (+1737828us) spinlock_profiling.cc:243] Waited 758 ms on lock 0x7b5400270bd0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:42.271454 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1743301376}
I20260709 12:18:42.272879 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.262830 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:42.184187 27562 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.304219 24169 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:42.342408 24173 raft_consensus.cc:2376] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9. Re-sending same reply.
I20260709 12:18:42.322010 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.313879 24168 raft_consensus.cc:2376] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9. Re-sending same reply.
I20260709 12:18:42.343812 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.323479 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.337903 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.343561 24170 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:42.354494 24173 raft_consensus.cc:2410] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:18:42.366201 24175 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
W20260709 12:18:42.386718 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.392463 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:42.426286 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.431488 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.428701 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.407069 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.408268 24244 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:42.437461 24175 raft_consensus.cc:2376] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9. Re-sending same reply.
W20260709 12:18:42.315214 23998 rpcz_store.cc:269] 0709 12:18:14.566559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:14.566875 (+   316us) service_pool.cc:224] Handling call
0709 12:18:42.258401 (+27691526us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:35.228676 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:35.229577 (+   901us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:35.229629 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:18:35.229689 (+    60us) tablet.cc:662] Decoding operations
0709 12:18:35.230868 (+  1179us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:35.232778 (+  1910us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:35.236545 (+  3767us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:18:35.308117 (+ 71572us) tablet.cc:701] Row locks acquired
0709 12:18:35.308151 (+    34us) write_op.cc:260] PREPARE: finished
0709 12:18:35.308430 (+   279us) write_op.cc:270] Start()
0709 12:18:35.308576 (+   146us) write_op.cc:276] Timestamp: P: 1783599515308333 usec, L: 0
0709 12:18:35.308609 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 12:18:35.309689 (+  1080us) log.cc:844] Serialized 2452 byte log entry
0709 12:18:36.088165 (+778476us) op_driver.cc:464] REPLICATION: finished
0709 12:18:36.452603 (+364438us) write_op.cc:301] APPLY: starting
0709 12:18:36.457616 (+  5013us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:36.516475 (+ 58859us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:36.524073 (+  7598us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:36.532380 (+  8307us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:36.532606 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:18:36.532674 (+    68us) write_op.cc:312] APPLY: finished
0709 12:18:36.532946 (+   272us) log.cc:844] Serialized 53 byte log entry
0709 12:18:36.533139 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:36.533284 (+   145us) write_op.cc:454] Released schema lock
0709 12:18:36.533342 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:36.533777 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:36.533804 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":486377,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":325544,"apply.run_cpu_time_us":3928,"apply.run_wall_time_us":90597,"num_ops":6,"prepare.queue_time_us":78550,"prepare.run_cpu_time_us":26594,"prepare.run_wall_time_us":239859,"raft.queue_time_us":401438,"raft.run_cpu_time_us":27635,"raft.run_wall_time_us":230293,"replication_time_us":747628,"thread_start_us":495942,"threads_started":4,"wal-append.queue_time_us":158253,"wal-append.run_cpu_time_us":26352,"wal-append.run_wall_time_us":2117594}]]}
W20260709 12:18:42.435408 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 189351us
I20260709 12:18:42.437038 24171 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:42.439236 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.441067 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.431406 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:42.439422 24216 leader_election.cc:336] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.131s (SENT)
I20260709 12:18:42.442804 24216 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:42.442238 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.442636 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.442813 24173 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:42.444077 24067 connection.cc:256] RPC call timeout handler was delayed by -1.7228552310000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15280000000000002s for a response
I20260709 12:18:42.444777 24167 raft_consensus.cc:2410] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 8 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:18:42.444700 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.445412 24171 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:42.323379 27572 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:42.446409 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:42.451736 24216 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.589s (SENT)
I20260709 12:18:42.452265 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:42.432538 27692 raft_consensus.cc:3055] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:42.432272 27695 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:42.517691 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.495808 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:42.697151 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.515882 24172 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:42.503469 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.693347 24807 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:42.529935 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.456127 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.496167 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:42.574379 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 122672us
I20260709 12:18:42.604496 24173 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:42.626955 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.711836 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:42.712774 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.713173 24095 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:42.511126 27661 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.556s	user 0.004s	sys 0.012s
I20260709 12:18:42.715695 27654 consensus_queue.cc:1059] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:42.716632 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.717413 24092 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:42.479399 27559 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:42.718163 27559 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.719492 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:42.721163 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:42.721323 27571 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.722025 24096 raft_consensus.cc:2368] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:18:42.508975 27686 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.463945 27664 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:42.718647 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.720592 27559 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.714409 24173 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:42.503533 27693 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:42.725219 27693 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.725680 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.727092 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.479038 27676 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:42.729319 24173 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:42.729364 27676 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.730582 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.732004 24173 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:42.693019 24176 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:42.693794 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2240) took 1011 ms. Trace:
I20260709 12:18:42.728229 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.728024 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:42.734998 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1898) took 2261 ms. Trace:
I20260709 12:18:42.735704 24176 rpcz_store.cc:276] 0709 12:18:40.474044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:40.943978 (+469934us) service_pool.cc:224] Handling call
0709 12:18:42.692486 (+1748508us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b58000da198. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:18:42.692777 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.734615 (+ 41838us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.734898 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12411648}
I20260709 12:18:42.737597 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.738368 24176 raft_consensus.cc:2376] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8. Re-sending same reply.
W20260709 12:18:42.702839 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:42.621070 27494 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59764 (request call id 8) took 15130 ms. Trace:
I20260709 12:18:42.728075 27693 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:42.757682 27654 consensus_queue.cc:1243] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:18:42.758044 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.734229 24094 rpcz_store.cc:276] 0709 12:18:41.682967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.848337 (+165370us) service_pool.cc:224] Handling call
0709 12:18:41.976549 (+128212us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.042662 (+ 66113us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.042694 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.043250 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.395095 (+351845us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:42.395160 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.395271 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.637718 (+242447us) raft_consensus.cc:1685] finished
0709 12:18:42.637752 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.693711 (+ 55959us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52172,"raft.queue_time_us":58088,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":264061,"threads_started":1,"wal-append.queue_time_us":397286}
I20260709 12:18:42.762035 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.762701 24176 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:42.758713 24171 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:42.754942 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.763757 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.765435 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.767066 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:42.768919 24095 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:42.769104 24098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2232) took 1409 ms. Trace:
I20260709 12:18:42.771960 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.773152 24171 raft_consensus.cc:2410] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:18:42.769692 24098 rpcz_store.cc:276] 0709 12:18:41.360260 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.360424 (+   164us) service_pool.cc:224] Handling call
0709 12:18:41.360754 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:41.409645 (+ 48891us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:41.775544 (+365899us) log.cc:844] Serialized 14 byte log entry
0709 12:18:42.035164 (+259620us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:42.035253 (+    89us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:42.035332 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.768761 (+733429us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54001f40d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:42.768834 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.769017 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47167,"prepare.queue_time_us":753367,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":49566,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":12716,"spinlock_wait_cycles":111687936,"thread_start_us":577304,"threads_started":2,"wal-append.queue_time_us":464846}
I20260709 12:18:42.501986 27662 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:42.635367 27572 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:42.703063 27692 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:42.456298 27678 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:42.781255 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.783382 24176 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:42.795315 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.796012 24176 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:42.797031 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.798333 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.788347 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.790555 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.791553 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:42.800534 24173 raft_consensus.cc:2410] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:42.801832 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.802585 24171 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:42.803648 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.804352 24171 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:42.805359 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.806051 24171 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
W20260709 12:18:42.808471 24216 leader_election.cc:336] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.228s (SENT)
I20260709 12:18:42.810822 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.832105 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:42.833134 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:42.832994 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.832422 24172 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:42.834609 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.807142 24176 raft_consensus.cc:2376] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7. Re-sending same reply.
I20260709 12:18:42.835323 24094 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:42.836169 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.837222 24176 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:42.837606 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:42.838192 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.815424 27570 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:18:42.839421 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.840006 27574 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:42.840056 24095 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:42.841199 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.815239 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.841879 24095 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:42.842113 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:42.836373 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.843150 24780 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:42.843734 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 52255.4us
I20260709 12:18:42.830246 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1745) took 1188 ms. Trace:
W20260709 12:18:42.844457 24216 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.291s (SENT)
W20260709 12:18:42.844836 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:42.816828 24099 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 2236) took 1393 ms (client timeout 1527 ms). Trace:
I20260709 12:18:42.832998 27553 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:42.842748 24169 raft_consensus.cc:2376] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8. Re-sending same reply.
I20260709 12:18:42.829305 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1750) took 1124 ms. Trace:
I20260709 12:18:42.834779 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.851142 24172 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:42.844749 24247 rpcz_store.cc:276] 0709 12:18:41.642040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.642229 (+   189us) service_pool.cc:224] Handling call
0709 12:18:41.642627 (+   398us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.043079 (+400452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.043127 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:42.043190 (+    63us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:42.043239 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.829937 (+786698us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540035a7d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:42.830004 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.830165 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920298752}
W20260709 12:18:42.846333 24099 rpcz_store.cc:269] 0709 12:18:41.423383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.423644 (+   261us) service_pool.cc:224] Handling call
0709 12:18:42.816554 (+1392910us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54002d6ed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:42.816728 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":332252416}
I20260709 12:18:42.817445 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.853415 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.854468 24176 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:18:42.855023 24176 pending_rounds.cc:85] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 3
I20260709 12:18:42.856436 24176 pending_rounds.cc:107] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:18:42.856702 24176 raft_consensus.cc:2889] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:42.857995 24176 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:42.841504 27662 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:42.858577 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 544) took 1398 ms. Trace:
I20260709 12:18:42.854955 24780 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:42.859776 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.861145 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:42.850255 24242 rpcz_store.cc:276] 0709 12:18:41.705005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.297867 (+592862us) service_pool.cc:224] Handling call
0709 12:18:42.298183 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.298555 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.298583 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.299206 (+   623us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.456200 (+156994us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:42.456277 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.456380 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.828942 (+372562us) raft_consensus.cc:1685] finished
0709 12:18:42.828982 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.829200 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":168,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":156566,"threads_started":1,"wal-append.queue_time_us":491265}
I20260709 12:18:42.862828 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.864848 24173 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:42.867388 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.868484 24094 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:42.873167 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:42.881249 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:42.882427 24171 raft_consensus.cc:2376] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7. Re-sending same reply.
I20260709 12:18:42.859058 24174 rpcz_store.cc:276] 0709 12:18:41.460550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.460727 (+   177us) service_pool.cc:224] Handling call
0709 12:18:41.461226 (+   499us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.608835 (+147609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.608873 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.648122 (+ 39249us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.841633 (+1193511us) spinlock_profiling.cc:243] Waited 28.5 ms on lock 0x7b18003ebf60. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1
0709 12:18:42.841805 (+   172us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:42.841842 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.841915 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:42.841959 (+    44us) raft_consensus.cc:1685] finished
0709 12:18:42.841971 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.858505 (+ 16534us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":448774,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":51152,"spinlock_wait_cycles":65618176,"thread_start_us":397327,"threads_started":2,"wal-append.queue_time_us":524769}
I20260709 12:18:42.901379 24174 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:42.903056 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.904397 24095 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:42.905977 24174 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:42.907821 24174 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:42.908203 24174 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:42.828688 27652 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:42.859688 27378 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:42.912124 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.912533 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:42.797513 27671 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:42.913149 24171 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:42.913830 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:42.928637 24173 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:42.859449 27653 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:42.860816 27489 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:18:42.933349 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 78477.8us
I20260709 12:18:42.941313 24099 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:42.930233 27378 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.871449 27692 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:42.939543 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72763.4us
I20260709 12:18:42.860842 24176 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:18:42.949230 27378 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:42.949898 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:42.909456 24174 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:42.957422 24174 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:42.953533 24176 pending_rounds.cc:85] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 4
I20260709 12:18:42.960892 24176 pending_rounds.cc:107] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:18:42.961237 24176 raft_consensus.cc:2889] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:42.939070 27585 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:42.940986 27653 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:42.946436 27489 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:42.843184 27678 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:42.754894 27494 rpcz_store.cc:276] 0709 12:18:27.490816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:27.490969 (+   153us) service_pool.cc:224] Handling call
0709 12:18:27.512624 (+ 21655us) log.cc:844] Serialized 506 byte log entry
0709 12:18:29.094391 (+1581767us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b540016a420. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054fbb26 00007f4c054f549a 00007f4c054f4714 00007f4c054d4eaa 00007f4c054dbd53 00007f4c054dbcd9 00007f4c054dbc69 00007f4c054dbc31 00007f4c054dadfd 0000000000388634
0709 12:18:29.295233 (+200842us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b540016a420. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054f4142 00007f4c054d4eaa 00007f4c054dbd53 00007f4c054dbcd9 00007f4c054dbc69 00007f4c054dbc31 00007f4c054dadfd 0000000000388634 0000000000388479 00007f4c0248e475
0709 12:18:29.487235 (+192002us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b1800055a80. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054fbb26 00007f4c054f549a 00007f4c054f4714
0709 12:18:30.067117 (+579882us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b540016a420. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054fbb26 00007f4c054f549a 00007f4c054f4714 00007f4c054d4eaa 00007f4c054dbd53 00007f4c054dbcd9 00007f4c054dbc69 00007f4c054dbc31 00007f4c054dadfd 0000000000388634
0709 12:18:30.416459 (+349342us) spinlock_profiling.cc:243] Waited 46.8 ms on lock 0x7b4c0035b5c0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03847a20 00007f4c03858a29 00007f4c0385913f 00007f4c0381d2ab 00007f4c0384af3c 00007f4c0384b3fe 00007f4c03ad850b 00007f4c054d7381 00007f4c054d526b 00007f4c054dbd53 00007f4c054dbcd9
0709 12:18:42.585243 (+12168784us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73694,"raft.queue_time_us":9276,"raft.run_cpu_time_us":71819,"raft.run_wall_time_us":6091322,"spinlock_wait_cycles":172876544,"thread_start_us":69653,"threads_started":1,"wal-append.queue_time_us":75557,"wal-append.run_cpu_time_us":1880,"wal-append.run_wall_time_us":1042782}
I20260709 12:18:42.974838 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 466) took 1341 ms. Trace:
W20260709 12:18:42.961798 27681 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:18:42.997877 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:42.999068 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:42.998946 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:43.004674 24242 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:18:43.001463 24097 rpcz_store.cc:276] 0709 12:18:41.633972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.634159 (+   187us) service_pool.cc:224] Handling call
0709 12:18:41.634638 (+   479us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.038311 (+403673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.038362 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:42.038423 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:42.038470 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.974579 (+936109us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b540025ba54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:42.974628 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:42.974765 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":927743744}
W20260709 12:18:43.007553 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.015738 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:43.019557 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:43.019757 24094 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:43.020689 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:43.021356 24094 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:43.022207 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:43.024287 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:43.026615 24067 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.063s	sys 0.075s
W20260709 12:18:43.028045 24067 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.064s	sys 0.075s
I20260709 12:18:42.987860 27585 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:43.029589 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 584526us
I20260709 12:18:43.000245 27653 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.030961 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:43.035933 24067 connection.cc:256] RPC call timeout handler was delayed by -1.6400552309999057s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 12:18:43.006104 27489 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:42.999879 27631 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:43.008894 27692 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.040107 24096 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:43.042290 24094 raft_consensus.cc:2410] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 10 because replica has last-logged OpId of term: 9 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
W20260709 12:18:43.042410 24067 connection.cc:256] RPC call timeout handler was delayed by -1.5590552310000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
I20260709 12:18:43.049916 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1747) took 1389 ms. Trace:
I20260709 12:18:43.044463 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:43.050081 24067 connection.cc:256] RPC call timeout handler was delayed by -1.5291785599999912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2197s for a response
I20260709 12:18:43.050474 24248 rpcz_store.cc:276] 0709 12:18:41.660788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.660987 (+   199us) service_pool.cc:224] Handling call
0709 12:18:41.661453 (+   466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.034508 (+373055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.049656 (+1015148us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54003d7054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:43.049845 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855272832}
I20260709 12:18:43.052665 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:43.054275 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:43.053540 24067 connection.cc:256] RPC call timeout handler was delayed by -1.3557759759999044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260709 12:18:43.055419 24067 connection.cc:256] RPC call timeout handler was delayed by -1.32595523100008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19690000000000002s for a response
W20260709 12:18:43.055721 24067 connection.cc:256] RPC call timeout handler was delayed by -1.3160552310000639s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260709 12:18:43.056018 24067 connection.cc:256] RPC call timeout handler was delayed by -1.2305552309999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
W20260709 12:18:43.056313 24067 connection.cc:256] RPC call timeout handler was delayed by -1.1620877849998124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1774s for a response
W20260709 12:18:43.056537 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.049518 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:43.056821 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:43.057083 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:43.057987 24067 connection.cc:256] RPC call timeout handler was delayed by -1.1198714349998227s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260709 12:18:43.058446 24067 connection.cc:256] RPC call timeout handler was delayed by -1.005995159999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
W20260709 12:18:43.058756 24067 connection.cc:256] RPC call timeout handler was delayed by -1.0041951599998811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260709 12:18:43.061736 24174 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:18:43.067965 24174 pending_rounds.cc:85] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 5
I20260709 12:18:43.068540 24174 pending_rounds.cc:107] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:18:43.069005 24174 raft_consensus.cc:2889] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:43.072993 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.075148 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:43.076154 24094 raft_consensus.cc:2376] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9. Re-sending same reply.
I20260709 12:18:43.057744 24097 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
W20260709 12:18:43.053512 24813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 447) took 1383 ms (client timeout 1672 ms). Trace:
W20260709 12:18:43.059581 24067 leader_election.cc:336] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.528s (SENT)
W20260709 12:18:43.080277 24067 leader_election.cc:336] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.608s (SENT)
W20260709 12:18:43.081846 24067 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.678s (SENT)
I20260709 12:18:43.082352 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:43.067809 24214 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:43.079034 24813 rpcz_store.cc:269] 0709 12:18:41.670430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.670572 (+   142us) service_pool.cc:224] Handling call
0709 12:18:43.052443 (+1381871us) spinlock_profiling.cc:243] Waited 8.48 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:43.053421 (+   978us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19505024}
I20260709 12:18:43.040403 27585 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:43.091857 24067 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.737s (SENT)
W20260709 12:18:43.096689 24067 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.739s (SENT)
W20260709 12:18:43.097667 24067 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.766s (SENT)
I20260709 12:18:43.098201 24098 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:43.092459 24097 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 12:18:43.098838 24067 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.796s (SENT)
I20260709 12:18:43.103442 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:43.111426 24097 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:43.113305 24097 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:18:43.046893 27631 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:43.117527 24098 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 4. Current term is 5. Ops: []
I20260709 12:18:43.119293 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:43.109978 24140 connection.cc:256] RPC call timeout handler was delayed by -5.8878749549999156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
I20260709 12:18:43.120785 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:43.120872 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:43.127053 24140 connection.cc:256] RPC call timeout handler was delayed by -5.8518749550000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 12:18:43.127467 24140 connection.cc:256] RPC call timeout handler was delayed by -5.8266749550000441s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260709 12:18:43.127838 24140 connection.cc:256] RPC call timeout handler was delayed by -5.8104749550000179s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 12:18:43.128188 24140 connection.cc:256] RPC call timeout handler was delayed by -5.7564749549999306s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
W20260709 12:18:43.128309 24067 leader_election.cc:336] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.838s (SENT)
W20260709 12:18:43.128608 24140 connection.cc:256] RPC call timeout handler was delayed by -5.7447749549999116s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 12:18:43.128870 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:43.129109 24140 connection.cc:256] RPC call timeout handler was delayed by -5.727674954999884s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1784s for a response
W20260709 12:18:43.129561 24140 connection.cc:256] RPC call timeout handler was delayed by -5.6988749550000648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
W20260709 12:18:43.129923 24140 connection.cc:256] RPC call timeout handler was delayed by -5.6673749550000139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18510000000000001s for a response
W20260709 12:18:43.130280 24140 connection.cc:256] RPC call timeout handler was delayed by -5.5818749549998756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 12:18:43.130638 24140 connection.cc:256] RPC call timeout handler was delayed by -5.5269749550000142s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20070000000000002s for a response
I20260709 12:18:43.121729 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:43.122486 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:43.132299 24810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 446) took 1462 ms. Trace:
I20260709 12:18:43.132720 24810 rpcz_store.cc:276] 0709 12:18:41.669958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.670171 (+   213us) service_pool.cc:224] Handling call
0709 12:18:43.120701 (+1450530us) spinlock_profiling.cc:243] Waited 8.7 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:18:43.132217 (+ 11516us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20020992}
I20260709 12:18:43.133154 27642 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:43.136471 27652 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.136970 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:43.137161 27652 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:43.137825 27652 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:43.138204 27652 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:43.138616 27652 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:43.140213 27662 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:43.140823 27662 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:43.141328 27662 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.100425 27547 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:43.120134 27574 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:18:43.147950 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.149788 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:43.140287 24067 leader_election.cc:336] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.868s (SENT)
W20260709 12:18:43.151042 24140 connection.cc:256] RPC call timeout handler was delayed by -5.4558749549998993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2086s for a response
W20260709 12:18:43.151641 24140 connection.cc:256] RPC call timeout handler was delayed by -5.3550749549999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2198s for a response
W20260709 12:18:43.151799 24067 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.948s (SENT)
W20260709 12:18:43.152101 24140 connection.cc:256] RPC call timeout handler was delayed by -4.8933749549998993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2711s for a response
W20260709 12:18:43.152577 24140 connection.cc:256] RPC call timeout handler was delayed by -4.6134749549999015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3022s for a response
W20260709 12:18:43.153858 24067 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.032s (SENT)
I20260709 12:18:43.154423 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:43.093169 27683 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:43.166296 24067 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.036s (SENT)
I20260709 12:18:43.166795 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:43.167707 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 321488us
I20260709 12:18:43.113050 27490 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:43.172106 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:43.175813 24140 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:43.176443 24100 raft_consensus.cc:2368] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
W20260709 12:18:43.173043 24216 leader_election.cc:336] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.195s (SENT)
I20260709 12:18:43.185837 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:43.188160 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.141112 27676 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:43.189783 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.170001 27460 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:43.175324 27517 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:43.170154 27642 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:43.200861 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:43.206724 24216 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.794s (SENT)
I20260709 12:18:43.207144 24168 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:43.207739 24096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:43.208433 24096 raft_consensus.cc:606] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:43.209023 24096 raft_consensus.cc:614] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:43.189953 27474 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:43.211588 27574 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:43.212486 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46237.9us
W20260709 12:18:43.213848 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 259181us
W20260709 12:18:43.215406 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 76507.7us
W20260709 12:18:43.257474 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.226050 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.195709 27490 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:43.208379 24216 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.876s (SENT)
I20260709 12:18:43.170682 27683 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:43.200925 27460 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:43.267861 24067 leader_election.cc:336] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.084s (SENT)
I20260709 12:18:43.275309 24067 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:43.265079 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:43.258622 27707 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:43.307000 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:43.277307 27460 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.246109 27642 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.297820 27678 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:43.253122 27494 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:18:43.258023 27688 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.071s	user 0.005s	sys 0.000s
W20260709 12:18:43.325817 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 240865us
W20260709 12:18:43.338497 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 137761us
I20260709 12:18:43.326726 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:43.199815 27631 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:43.342912 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 134559us
W20260709 12:18:43.343252 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.344758 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.350725 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:43.351557 24248 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.324211 27671 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:43.355077 24242 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
W20260709 12:18:43.342510 27716 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:18:43.353946 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1943) took 1189 ms. Trace:
I20260709 12:18:43.367837 24167 rpcz_store.cc:276] 0709 12:18:42.164672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.850856 (+686184us) service_pool.cc:224] Handling call
0709 12:18:42.856044 (+  5188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:42.856255 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:18:42.871327 (+ 15072us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.353452 (+482125us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:43.353538 (+    86us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:43.353614 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.353711 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.353863 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15827,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":7226,"spinlock_wait_cycles":1185536,"thread_start_us":481551,"threads_started":2,"wal-append.queue_time_us":419042}
I20260709 12:18:43.297267 27378 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.290529 27720 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
I20260709 12:18:43.300420 27546 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:18:43.398699 24248 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:43.347215 27553 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:43.380903 27642 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:43.369632 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 104585us
I20260709 12:18:43.443005 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2238) took 1781 ms. Trace:
I20260709 12:18:43.362713 27631 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.391346 27730 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:43.366155 27490 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:43.400336 27683 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:43.417364 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:43.444352 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 176534us
I20260709 12:18:43.458868 24099 raft_consensus.cc:2376] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10. Re-sending same reply.
I20260709 12:18:43.443526 24101 rpcz_store.cc:276] 0709 12:18:41.662002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.662161 (+   159us) service_pool.cc:224] Handling call
0709 12:18:41.662523 (+   362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:41.697269 (+ 34746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:41.697319 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:41.697934 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.055552 (+357618us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:18:42.055592 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:42.055666 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.041193 (+985527us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:43.407957 (+366764us) raft_consensus.cc:1685] finished
0709 12:18:43.407991 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.442888 (+ 34897us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35840,"raft.queue_time_us":38118,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":4877,"spinlock_wait_cycles":61866752,"thread_start_us":331191,"threads_started":1,"wal-append.queue_time_us":440705}
W20260709 12:18:43.444707 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 166373us
I20260709 12:18:43.452121 24811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 511) took 1741 ms. Trace:
I20260709 12:18:43.460273 24811 rpcz_store.cc:276] 0709 12:18:41.700347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:41.807456 (+107109us) service_pool.cc:224] Handling call
0709 12:18:42.145481 (+338025us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:42.553710 (+408229us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:42.553768 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:42.554389 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:18:42.809301 (+254912us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b1800338440. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:18:43.096882 (+287581us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:43.096941 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.097043 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.407286 (+310243us) raft_consensus.cc:1685] finished
0709 12:18:43.407309 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.442061 (+ 34752us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7861,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":8278,"spinlock_wait_cycles":4104960,"thread_start_us":287287,"threads_started":1,"wal-append.queue_time_us":691017}
W20260709 12:18:43.462543 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 115080us
I20260709 12:18:43.455219 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 1945) took 1289 ms. Trace:
I20260709 12:18:43.455264 27474 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:43.459671 24067 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.197s (SENT)
I20260709 12:18:43.467373 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:43.473630 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1759) took 1311 ms. Trace:
I20260709 12:18:43.473896 24140 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:43.474141 24249 rpcz_store.cc:276] 0709 12:18:42.162008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.340229 (+178221us) service_pool.cc:224] Handling call
0709 12:18:42.349161 (+  8932us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:42.447399 (+ 98238us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:18:42.764915 (+317516us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.122644 (+357729us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:43.164656 (+ 42012us) log.cc:844] Serialized 52 byte log entry
0709 12:18:43.164838 (+   182us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:43.164870 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.164933 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.473320 (+308387us) raft_consensus.cc:1685] finished
0709 12:18:43.473349 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.473545 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126565,"prepare.queue_time_us":164871,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":65,"raft.queue_time_us":98345,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":36284,"thread_start_us":550741,"threads_started":2,"wal-append.queue_time_us":487967}
W20260709 12:18:43.464279 27713 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:18:43.458001 27677 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:43.466220 24172 rpcz_store.cc:276] 0709 12:18:42.165666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:42.851846 (+686180us) service_pool.cc:224] Handling call
0709 12:18:42.856018 (+  4172us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:42.914954 (+ 58936us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:42.915027 (+    73us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:42.943893 (+ 28866us) log.cc:844] Serialized 52 byte log entry
0709 12:18:43.233404 (+289511us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:43.448895 (+215491us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.449450 (+   555us) log.cc:844] Serialized 14 byte log entry
0709 12:18:43.454787 (+  5337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:43.454885 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:43.454931 (+    46us) raft_consensus.cc:1685] finished
0709 12:18:43.454947 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:43.455141 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6817,"prepare.queue_time_us":43456,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":2857,"raft.queue_time_us":71787,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":10947,"thread_start_us":463128,"threads_started":2,"wal-append.queue_time_us":336396}
W20260709 12:18:43.613798 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.644503 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.663589 24246 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:18:43.674269 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.470485 27474 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:43.469707 27377 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.210s
I20260709 12:18:43.688884 24241 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:43.691615 27477 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:43.526860 27653 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.474308 27489 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.695459 24814 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:18:43.499490 27662 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:43.697409 24245 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:43.691977 27387 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:18:43.701133 27489 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:43.702072 27662 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:43.704108 27631 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:43.705055 27653 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:43.718122 24247 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:43.495736 27735 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:18:43.540580 27378 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:43.491084 27460 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:43.730698 24244 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:43.676829 24811 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:18:43.472980 27637 raft_consensus.cc:3055] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:43.732082 27637 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:43.730409 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:43.733620 27637 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:43.736442 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.737090 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:43.737444 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.724718 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:43.743489 24246 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.494055 27585 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.749151 27585 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:43.541633 27652 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.741550 27637 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.731364 24094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:43.774106 24094 raft_consensus.cc:606] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:43.774633 24094 raft_consensus.cc:614] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:43.775754 24168 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:18:43.723652 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 58176.5us
I20260709 12:18:43.777273 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:43.789835 27460 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:43.799998 24214 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:43.804103 24094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:43.804322 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:43.804987 24094 raft_consensus.cc:606] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:43.806146 27693 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:43.806905 24167 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:43.806901 27693 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:43.809892 27693 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:43.805447 24094 raft_consensus.cc:614] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:43.811046 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.811118 24168 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:43.818866 27652 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:43.823928 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:43.837124 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:43.838229 24241 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:18:43.846827 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47159.3us
I20260709 12:18:43.850517 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:43.855813 27697 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:43.865573 24246 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
W20260709 12:18:43.831735 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 314204us
I20260709 12:18:43.885881 27692 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:43.886951 24094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:43.887836 24094 raft_consensus.cc:606] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:43.880827 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 300869us
I20260709 12:18:43.873099 27460 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:43.896795 27692 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:43.927772 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 467983us
I20260709 12:18:43.927603 27692 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:43.931800 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 457856us
I20260709 12:18:43.931828 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:43.935781 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:43.939771 27747 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:43.940543 27747 raft_consensus.cc:697] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:43.940591 27631 raft_consensus.cc:2764] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:18:43.943178 24140 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:43.942270 27747 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.954538 27748 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:18:43.938315 24067 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.368s (SENT)
I20260709 12:18:43.933439 27474 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.944608 27631 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:43.959695 27631 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:43.960237 27631 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:43.946136 27572 consensus_queue.cc:1059] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:43.946770 27741 consensus_queue.cc:1059] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:43.951216 27490 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:43.965962 24245 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:43.964986 27490 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:43.967343 23995 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 8, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:43.969885 27490 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:43.971081 27637 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:43.971237 27572 consensus_queue.cc:1243] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:18:43.970163 23995 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:43.971932 27572 raft_consensus.cc:3055] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:43.972617 27693 raft_consensus.cc:1064] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:18:43.972857 23995 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:43.971993 27741 raft_consensus.cc:3055] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:43.975154 27741 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:43.971180 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:43.976620 24246 raft_consensus.cc:2410] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 9 because replica has last-logged OpId of term: 8 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:18:43.976550 27741 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:43.978143 27741 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:43.973330 27637 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.972539 27572 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:43.984899 23995 catalog_manager.cc:5697] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 9, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 9 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:43.989873 24140 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:43.990339 27474 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:43.990025 23995 catalog_manager.cc:5697] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:43.991056 27748 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:43.992369 27572 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:43.991921 23995 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 10, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 10 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:43.994498 27572 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:43.961645 27631 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:44.003989 27631 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:43.995754 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57524.8us
I20260709 12:18:43.996080 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:44.007726 24067 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.534s (SENT)
W20260709 12:18:44.009218 24067 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.698s (SENT)
W20260709 12:18:43.997239 27752 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:18:43.996527 23995 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 8, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 8 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:43.998858 27693 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:43.999392 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:44.002638 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.015036 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:44.029570 24167 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:44.037904 24241 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:44.039366 24245 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:44.010741 27637 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:44.056499 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:44.014523 27697 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:18:44.059937 27460 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.066150 24814 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:44.069211 24216 leader_election.cc:336] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.977s (SENT)
I20260709 12:18:44.069748 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:44.072073 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.074293 27692 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:44.076020 24810 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:44.076644 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:44.076988 24781 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:44.078614 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:44.065848 27460 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:44.081851 27460 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:44.082710 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:44.064098 23995 catalog_manager.cc:5697] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 9, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 9 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.085624 23995 catalog_manager.cc:5697] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 10, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.090092 23995 catalog_manager.cc:5697] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:44.091744 27637 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:44.092327 27637 raft_consensus.cc:697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:18:44.092543 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 102941us
I20260709 12:18:44.093127 23995 catalog_manager.cc:5697] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 7, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 7 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:44.091354 27741 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:18:44.074783 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.105598 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:44.117797 24094 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:44.121873 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:44.123571 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:44.125151 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:44.125600 24245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:44.127187 24780 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:44.129282 27447 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:44.129920 27447 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:44.130782 27734 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:44.131050 27447 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:44.134146 27749 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:44.135461 27751 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:44.136499 27734 consensus_queue.cc:1243] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:44.137761 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:44.142230 24097 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:44.143247 27617 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:44.144335 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:44.144536 27617 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:44.145193 24097 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:44.145108 27617 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:44.122807 24248 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:18:44.167217 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:44.168282 24098 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:44.171190 27748 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:18:44.175566 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 81485.3us
I20260709 12:18:44.176129 27617 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:44.177634 24140 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:44.180398 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:44.093515 27637 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:44.177788 27617 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:44.188356 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:44.189457 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:44.190259 27636 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:44.200732 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:44.200374 27636 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:44.203828 27636 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:44.207154 24101 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:44.211619 27740 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:44.213125 27652 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:44.214931 27652 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:44.216491 27652 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:44.218245 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:44.223915 27734 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:44.229259 24813 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:18:44.232520 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 67211.4us
I20260709 12:18:44.232621 27740 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:44.239598 27747 raft_consensus.cc:3055] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:44.240109 27747 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:18:44.240569 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.241225 27747 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:44.251369 24092 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:44.257537 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:44.265687 24093 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:18:44.274296 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48090.1us
I20260709 12:18:44.284212 27693 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:44.289494 24096 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:44.153816 23995 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:44.300472 24098 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:44.293022 27693 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:44.313198 24101 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:18:44.314334 24092 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:18:44.280464 27747 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:44.293752 27460 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:18:44.344262 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:44.353030 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.362073 24097 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:44.374603 27751 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:44.377866 27571 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:44.378546 27571 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:44.333946 23995 catalog_manager.cc:5697] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:44.345522 27692 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:44.379480 27692 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:44.380023 23995 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 5, term changed from 6 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to <none>, VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:44.381987 23995 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 9, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 9 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.384563 24094 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
W20260709 12:18:44.393894 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.399073 27636 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:44.401214 24814 raft_consensus.cc:2393] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:18:44.401661 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 224201us
W20260709 12:18:44.403970 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.388906 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:44.421290 27749 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:44.406198 27652 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
W20260709 12:18:44.440763 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 51948.5us
I20260709 12:18:44.446274 24813 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:18:44.434063 23995 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 9, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 9 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.447664 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:44.421618 27585 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:18:44.438179 27741 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.479509 27736 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:44.436305 27734 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:18:44.461316 27692 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:44.469147 27636 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:44.453994 27751 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
W20260709 12:18:44.503866 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 252762us
I20260709 12:18:44.488255 27572 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:18:44.535919 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:44.494876 27741 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:44.552277 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.557708 24245 raft_consensus.cc:606] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:44.558267 24245 raft_consensus.cc:614] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:44.530074 27636 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:44.484560 27571 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:44.572237 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.573792 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 229651us
I20260709 12:18:44.577387 24813 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:44.574793 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:44.584132 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:44.563433 27636 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:44.566658 27662 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:44.585291 24216 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.635s (SENT) [suppressed 39 similar messages]
I20260709 12:18:44.590382 23995 catalog_manager.cc:5697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 8, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:44.625036 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:44.628270 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 135798us
W20260709 12:18:44.630278 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 71898.4us
I20260709 12:18:44.631929 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:44.589156 27693 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:18:44.669294 27766 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:18:44.671150 27686 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:44.672005 27686 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:44.660912 24101 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:18:44.692854 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 167324us
I20260709 12:18:44.694033 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:44.695772 27762 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:18:44.699331 27693 raft_consensus.cc:697] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:44.700536 27693 consensus_queue.cc:237] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:44.705862 27778 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:18:44.649924 27692 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:44.708537 27692 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:44.634374 27631 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:18:44.673990 23995 catalog_manager.cc:5697] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 7, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 7 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:18:44.739158 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 153894us
I20260709 12:18:44.709209 27662 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:44.753124 23995 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.760564 27781 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:18:44.731447 27636 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:44.791253 24806 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: [11.11-11.11]
W20260709 12:18:44.791846 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 118174us
I20260709 12:18:44.789958 23995 catalog_manager.cc:5697] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 2 to 8. New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:44.796062 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 167583us
W20260709 12:18:44.803622 27767 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:18:44.815887 23995 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:44.791288 27572 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:44.823503 27572 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:44.825052 27774 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:44.825802 27774 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:44.826316 27572 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:44.828167 27774 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:44.787819 27741 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:44.818020 23995 catalog_manager.cc:5697] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 5, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 5 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:44.844028 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 150145us
W20260709 12:18:44.849208 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.851866 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:44.852594 24243 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:44.847311 27572 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:18:44.862078 24140 leader_election.cc:400] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:44.862483 24140 leader_election.cc:403] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:44.863732 27741 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
W20260709 12:18:44.865667 27777 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 12:18:44.845322 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 171833us
I20260709 12:18:44.868011 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:44.855084 27461 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:18:44.794845 27736 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:18:44.842890 27686 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:44.877154 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:44.883744 23995 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 8, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:44.887424 24246 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:18:44.889638 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:44.893539 27794 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:44.894059 27794 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:44.894727 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:44.896013 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54072.1us
I20260709 12:18:44.897289 24140 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:44.881450 27636 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:44.899211 27572 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:18:44.902390 27747 consensus_meta.cc:287] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.005s
I20260709 12:18:44.903476 24175 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:44.905128 27662 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:44.798715 27692 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:44.877889 27617 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.005s
I20260709 12:18:44.911791 24244 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:44.913010 23995 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 6, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 6 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:44.893790 27741 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:18:44.925981 24216 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.736s (SENT)
I20260709 12:18:44.898816 24140 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:44.928932 27741 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:44.933781 27686 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:18:44.938174 27772 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.119s	user 0.000s	sys 0.002s
I20260709 12:18:44.881093 27750 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:18:44.940382 27794 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:44.941630 27794 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:44.966470 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:44.968648 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:44.970292 24243 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:18:44.973316 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:44.974797 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:44.986027 24806 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 15: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:44.930634 24140 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:44.978037 24093 raft_consensus.cc:606] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:44.974435 24067 connection.cc:256] RPC call timeout handler was delayed by -1.1114463300002626s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260709 12:18:44.995890 24067 connection.cc:256] RPC call timeout handler was delayed by -1.0673463300001913s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
W20260709 12:18:44.996330 24067 connection.cc:256] RPC call timeout handler was delayed by -1.0187463300001127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 12:18:44.991308 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 63311.3us
I20260709 12:18:45.003775 27786 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:45.005151 27786 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:45.005558 27786 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:18:45.029168 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:44.999940 27747 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:45.006567 27786 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:45.059026 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 128541us
I20260709 12:18:45.048261 27747 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:45.078389 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.051541 27751 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:45.096166 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:45.097641 27784 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:45.098199 27784 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:45.069576 27786 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:45.103444 27652 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:45.103955 27784 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:45.051885 27778 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:18:45.114463 24140 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.078929 27747 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:45.108167 27652 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:18:45.130750 24216 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.527s (SENT)
I20260709 12:18:45.130316 27447 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
W20260709 12:18:45.139853 24216 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.580s (SENT)
I20260709 12:18:45.140388 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:45.141944 24216 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.991s (SENT)
I20260709 12:18:45.143949 27693 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:45.145188 27652 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:45.146489 27652 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:45.147452 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 81408.3us
I20260709 12:18:45.114964 27751 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:45.172435 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:45.175524 24814 raft_consensus.cc:1217] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[7.7-14.10]   Dedup: 11.9->[14.10-14.10]
I20260709 12:18:45.176226 24814 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 14. Current term is 15. Ops: [7.7-14.10]
W20260709 12:18:45.175999 27796 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:18:45.206463 27804 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:18:45.211208 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:18:45.211346 27805 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:18:45.214402 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:45.215363 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 145483us
I20260709 12:18:45.221048 24140 leader_election.cc:400] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:18:45.221475 24140 leader_election.cc:403] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:45.222972 24140 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.224679 27806 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:18:45.224902 27751 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:45.225636 27806 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:45.229146 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47480.1us
I20260709 12:18:45.252164 24168 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:18:45.252714 27803 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.165s	user 0.000s	sys 0.001s
I20260709 12:18:45.254465 27637 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:45.255897 27798 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 12:18:45.169798 27741 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:45.277125 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.279074 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.282214 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59420.4us
W20260709 12:18:45.315830 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.324910 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.349591 24246 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:45.352289 27740 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:45.352798 27740 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:45.353794 27740 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:45.348984 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 249559us
I20260709 12:18:45.371088 24806 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:18:45.371563 24092 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:45.376087 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.374254 24101 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 5 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:45.364480 27806 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.369477 27741 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:45.407948 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.403946 27771 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.258214 27474 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index 5 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:45.397715 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:45.453060 24098 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:45.413146 27740 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:45.461828 27631 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.462706 27631 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:45.466102 27631 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:45.475070 27769 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:18:45.482440 27797 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.395s	user 0.009s	sys 0.003s
I20260709 12:18:45.454707 27741 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:45.489666 27741 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:45.454967 27801 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:45.412163 27806 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:45.506392 27585 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:45.434213 27771 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:45.517589 27771 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:45.535346 27747 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:45.537364 24169 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:45.539634 27806 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:45.545073 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.548166 24216 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.056s (SENT)
I20260709 12:18:45.548987 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:45.550141 27678 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:45.594368 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:45.597108 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 229634us
I20260709 12:18:45.593456 27678 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:18:45.601263 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:45.601989 24094 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:18:45.602564 27818 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:45.604929 27818 raft_consensus.cc:3055] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:45.605340 27818 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:45.607786 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:45.608942 27785 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:45.609365 27785 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:45.609721 27785 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:45.602886 27806 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.615515 27806 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:45.616966 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 68882.8us
I20260709 12:18:45.623170 27447 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:18:45.627655 27794 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.686s	user 0.014s	sys 0.000s
I20260709 12:18:45.628394 24097 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:18:45.629187 24099 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:18:45.559747 27747 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:45.630089 24814 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 5 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:45.591777 27740 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.644640 27740 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:45.618772 27806 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:45.649693 24169 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
W20260709 12:18:45.649989 27820 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
W20260709 12:18:45.642236 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.650148 24169 pending_rounds.cc:85] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 10
I20260709 12:18:45.652068 24169 pending_rounds.cc:107] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:18:45.652422 24169 raft_consensus.cc:2889] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:45.654009 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.655452 27771 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:45.655786 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.657187 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:45.633848 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:45.660593 27740 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:45.685063 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:45.690294 24098 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:45.692319 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:45.684038 27741 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:45.676509 27678 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:18:45.693747 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:45.695112 27747 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.695030 27662 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:18:45.676105 27490 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:45.686944 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:45.646353 27818 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:45.715340 27816 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:45.715759 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:45.716130 27816 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:45.718586 27816 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:45.722517 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:45.699024 27490 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:45.759909 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:45.776050 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 120441us
I20260709 12:18:45.778584 24248 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:18:45.778903 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.756019 27490 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:45.761354 27740 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:45.782548 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.793676 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.794800 27816 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.795650 27816 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.797221 24140 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.799685 27816 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:45.800036 27824 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:18:45.781005 27818 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:45.806677 27826 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:18:45.809691 27740 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:45.785663 27785 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:45.829480 24806 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
W20260709 12:18:45.839421 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:45.802765 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.849439 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:45.862797 27740 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:45.831036 27785 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:45.874208 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:45.887079 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:45.887840 27740 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:45.877718 27447 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
W20260709 12:18:45.910490 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 107914us
I20260709 12:18:45.912190 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.913759 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:45.916777 27828 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.125s	user 0.003s	sys 0.001s
I20260709 12:18:45.921417 27816 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.922395 27816 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.951838 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:18:45.953831 24216 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.534s (SENT)
I20260709 12:18:45.954061 27740 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:45.954432 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:45.957659 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:45.958573 27778 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:45.959254 27778 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:45.960503 27775 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:45.960705 27740 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:45.964753 27816 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:45.961158 27740 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:45.966750 27775 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 12:18:45.972591 27740 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:45.975788 27678 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:18:45.976316 27678 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:45.977324 27678 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:45.978639 27678 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:45.967715 27816 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:45.999361 24140 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:45.968837 27490 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.008070 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:46.016390 27572 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:46.023679 27490 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:46.025189 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:46.026185 24806 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 15: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:46.026089 27740 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.029711 27740 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:46.037388 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 65250.4us
I20260709 12:18:46.041478 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.043571 27818 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:18:46.053719 27778 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:46.060082 27829 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.251s	user 0.001s	sys 0.002s
I20260709 12:18:46.070431 27816 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:46.073633 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:46.083853 24811 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:46.085974 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.087199 27740 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:46.090875 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:46.099028 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:46.100246 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:46.135372 24141 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:46.136597 27740 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:46.139127 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.141736 27447 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:46.143009 27740 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:46.143342 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.145107 27572 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:46.145069 24140 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.148967 27572 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:46.151742 24168 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:46.153232 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.155814 27784 consensus_queue.cc:1059] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:46.156998 27585 raft_consensus.cc:3055] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:46.157433 27585 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:46.158509 27585 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.160121 27585 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:46.147415 27740 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:46.165361 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.166446 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.176779 27572 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:46.176873 24099 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:18:46.178892 27572 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:18:46.179745 27572 consensus_queue.cc:1243] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer 729aa4b1ccec48b588c14e67652c61e1 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:18:46.180347 27816 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:18:46.180708 27816 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:46.181711 27816 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:46.188040 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:46.195657 27693 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:46.196352 27693 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:46.197510 27693 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.202076 27816 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:18:46.221228 27778 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.222038 27778 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.224299 24140 leader_election.cc:400] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:18:46.224736 24140 leader_election.cc:403] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:46.231920 27778 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:46.234265 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:46.233791 23996 catalog_manager.cc:5697] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 3 to 5, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 5 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:46.236284 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:46.237051 24099 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:46.238641 27572 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:18:46.238955 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.240409 27585 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:46.240478 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.240744 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.241282 24168 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:46.241432 24172 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:46.242511 24167 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:46.243541 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.243662 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.238005 23996 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 6 to 8, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:46.244204 24174 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:46.244534 24176 raft_consensus.cc:2410] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:18:46.242707 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.240917 27585 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.242456 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.245235 27585 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:46.245579 24175 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:46.246377 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.248097 24170 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:46.249830 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:46.250422 24170 raft_consensus.cc:2376] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9. Re-sending same reply.
I20260709 12:18:46.251784 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.253355 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:46.253962 24170 raft_consensus.cc:2376] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10. Re-sending same reply.
I20260709 12:18:46.257594 27585 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.255017 23996 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 5 to 8, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 8 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:46.259399 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:46.260314 24170 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:46.262560 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:46.263226 24099 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:46.262933 23996 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 7 to 8, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:46.274672 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:46.275280 27585 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:46.281327 24169 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:18:46.281731 24169 pending_rounds.cc:85] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 3
I20260709 12:18:46.281982 24169 pending_rounds.cc:107] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:18:46.282210 24169 raft_consensus.cc:2889] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:46.284073 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:46.284729 24168 raft_consensus.cc:2376] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7. Re-sending same reply.
I20260709 12:18:46.277369 24099 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:18:46.286062 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:46.286705 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.287966 27585 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:46.288664 27585 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:46.289553 27585 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.280118 23996 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 6 to 7, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 7 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:46.291859 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.292303 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.292675 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:46.293002 24175 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:46.293509 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.294051 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.294790 24172 raft_consensus.cc:2376] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8. Re-sending same reply.
I20260709 12:18:46.294129 24174 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:46.295472 24176 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:46.292678 24169 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:46.293072 23996 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 6 to 8, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 8 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:46.297739 24168 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:18:46.298542 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.298002 23996 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 2 to 6, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:46.282366 23995 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 192) took 9975 ms. Trace:
I20260709 12:18:46.306260 23995 rpcz_store.cc:276] 0709 12:18:36.348192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:36.355294 (+  7102us) service_pool.cc:224] Handling call
0709 12:18:46.282240 (+9926946us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:45.429490 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:45.430294 (+   804us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:45.430358 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:18:45.430394 (+    36us) tablet.cc:662] Decoding operations
0709 12:18:45.432369 (+  1975us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:45.432459 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:45.432487 (+    28us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:18:45.600293 (+167806us) tablet.cc:701] Row locks acquired
0709 12:18:45.600352 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:18:45.600582 (+   230us) write_op.cc:270] Start()
0709 12:18:45.600762 (+   180us) write_op.cc:276] Timestamp: P: 1783599525600507 usec, L: 0
0709 12:18:45.600792 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:18:45.648271 (+ 47479us) log.cc:844] Serialized 9465 byte log entry
0709 12:18:45.936209 (+287938us) spinlock_profiling.cc:243] Waited 7.56 ms on lock 0x7b18002f0aa0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c05576e28 00007f4c08fb1581 00007f4c08fb0d58
0709 12:18:45.952823 (+ 16614us) op_driver.cc:464] REPLICATION: finished
0709 12:18:46.028215 (+ 75392us) spinlock_profiling.cc:243] Waited 46.2 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c05576e28 00007f4c08fb1581 00007f4c08fb0d58 00007f4c08fb59f1 00007f4c08fb59a9 00007f4c08fb5939 00007f4c08fb5901 00007f4c08fb4b2d 0000000000388634 0000000000388479
0709 12:18:46.080017 (+ 51802us) write_op.cc:301] APPLY: starting
0709 12:18:46.080175 (+   158us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:46.080724 (+   549us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:46.080769 (+    45us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:46.148867 (+ 68098us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:46.149375 (+   508us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=24
0709 12:18:46.149429 (+    54us) write_op.cc:312] APPLY: finished
0709 12:18:46.150075 (+   646us) log.cc:844] Serialized 164 byte log entry
0709 12:18:46.150300 (+   225us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:46.150561 (+   261us) write_op.cc:454] Released schema lock
0709 12:18:46.150698 (+   137us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:46.167342 (+ 16644us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:46.167388 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":82568,"apply.run_cpu_time_us":10430,"apply.run_wall_time_us":115043,"num_ops":24,"prepare.queue_time_us":280173,"prepare.run_cpu_time_us":19198,"prepare.run_wall_time_us":598984,"raft.queue_time_us":152154,"raft.run_cpu_time_us":14410,"raft.run_wall_time_us":45887,"replication_time_us":343884,"spinlock_wait_cycles":123773824,"thread_start_us":282285,"threads_started":4,"wal-append.queue_time_us":35999}]]}
I20260709 12:18:46.311061 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.311324 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.313544 24168 raft_consensus.cc:2376] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5. Re-sending same reply.
I20260709 12:18:46.310199 23996 catalog_manager.cc:5697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 5 to 7, now has a pending config: VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193), VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194), VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195), NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 7 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:18:46.322508 23996 catalog_manager.cc:5697] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:46.350839 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.351052 27693 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:46.351816 27693 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.366611 27693 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:46.372186 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:46.372558 24067 leader_election.cc:336] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.620s (SENT)
I20260709 12:18:46.372967 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:46.373142 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:46.373716 24099 raft_consensus.cc:2368] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:18:46.375080 27783 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:46.375382 24214 leader_election.cc:400] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:18:46.375787 24214 leader_election.cc:403] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:18:46.379660 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.348716 23996 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 5 to 4, term changed from 7 to 6, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195), c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193), VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194), VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195), VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:46.426868 27585 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.427659 27585 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.431058 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:46.431671 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:46.432000 24099 raft_consensus.cc:2410] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:18:46.434721 27585 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:46.435297 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.443598 27585 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:46.438068 23996 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 8 to 9, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 9 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:46.393159 27693 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:18:46.462301 24067 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.710s (SENT)
I20260709 12:18:46.467502 24099 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:46.470814 27678 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:46.471876 27678 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:46.472213 27678 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:46.473194 27678 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:46.474715 27678 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:46.491863 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 108908us
I20260709 12:18:46.501427 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:46.530241 24067 leader_election.cc:336] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.774s (SENT)
W20260709 12:18:46.531435 24216 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 3.109s (SENT)
I20260709 12:18:46.532116 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:46.500284 27693 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:18:46.543324 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.544174 24176 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:46.545276 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.545893 24176 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:46.547025 27692 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:46.546707 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.563434 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.564306 24167 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
W20260709 12:18:46.567106 24216 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.635s (SENT)
I20260709 12:18:46.567636 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:46.569379 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.570142 24169 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:46.558434 27783 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:46.571301 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45916.3us
I20260709 12:18:46.571323 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.575955 27780 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:46.589522 27585 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:46.590248 27585 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:46.591238 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.593312 27585 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:46.594884 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:46.595991 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:46.599709 24067 leader_election.cc:336] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.816s (SENT)
I20260709 12:18:46.631137 24167 raft_consensus.cc:2410] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:18:46.711313 24099 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
W20260709 12:18:46.715734 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 149813us
W20260709 12:18:46.723291 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 156231us
I20260709 12:18:46.598518 27783 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:46.727460 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 125145us
I20260709 12:18:46.731876 24811 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:18:46.738154 24216 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.687s (SENT)
I20260709 12:18:46.737216 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:46.738714 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:46.748672 24216 leader_election.cc:336] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 3.186s (SENT)
I20260709 12:18:46.749248 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:46.753616 27783 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:46.754628 24167 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:18:46.779728 27850 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:18:46.797731 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 224634us
W20260709 12:18:46.803421 24067 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.969s (SENT)
I20260709 12:18:46.791213 27780 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:46.790899 27775 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:46.819845 27490 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:46.828601 24067 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:46.841300 24779 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:46.845355 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:46.827699 27849 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260709 12:18:46.851306 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.853855 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.846174 24250 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
W20260709 12:18:46.853669 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.834896 27490 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:46.858907 27490 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:46.860484 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.860592 27785 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:46.861085 27785 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:46.861210 24176 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:46.861522 27785 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:18:46.860643 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 46093.6us
I20260709 12:18:46.795616 27741 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
W20260709 12:18:46.893642 27847 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:46.850951 27783 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:46.893421 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.895466 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.896343 24173 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 5: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:46.898751 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.899435 24168 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:46.901088 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:46.905702 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:46.909904 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:46.889910 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.910753 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:46.916121 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 116584us
I20260709 12:18:46.918546 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:46.922811 24067 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.980s (SENT)
I20260709 12:18:46.919275 24167 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:46.926345 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.928349 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.931300 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:46.945129 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.948083 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.946256 24170 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:46.964349 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:46.967938 24067 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.506s (SENT)
I20260709 12:18:46.968935 24067 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:46.929756 27780 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:18:46.972203 24094 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:18:46.977169 24173 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:46.979462 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.981227 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:46.982199 24173 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:46.984344 24170 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:18:46.985411 23996 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 192) took 12467 ms (client timeout 15000 ms). Trace:
I20260709 12:18:46.986137 27740 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:46.995321 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 105204us
I20260709 12:18:47.003834 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.005020 24093 raft_consensus.cc:2393] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:47.005621 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:47.006564 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 158681us
I20260709 12:18:47.007340 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:46.995749 23996 rpcz_store.cc:269] 0709 12:18:34.517921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.518223 (+   302us) service_pool.cc:224] Handling call
0709 12:18:46.985328 (+12467105us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:46.450371 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:46.450938 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:46.450975 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:18:46.451017 (+    42us) tablet.cc:662] Decoding operations
0709 12:18:46.452049 (+  1032us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:46.452112 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:46.452140 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:18:46.453135 (+   995us) tablet.cc:701] Row locks acquired
0709 12:18:46.453157 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:18:46.453326 (+   169us) write_op.cc:270] Start()
0709 12:18:46.453439 (+   113us) write_op.cc:276] Timestamp: P: 1783599526453279 usec, L: 0
0709 12:18:46.453459 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:18:46.454172 (+   713us) log.cc:844] Serialized 4958 byte log entry
0709 12:18:46.457366 (+  3194us) op_driver.cc:464] REPLICATION: finished
0709 12:18:46.457978 (+   612us) write_op.cc:301] APPLY: starting
0709 12:18:46.458108 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:46.458443 (+   335us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:46.458566 (+   123us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:46.459914 (+  1348us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:46.460151 (+   237us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0709 12:18:46.460196 (+    45us) write_op.cc:312] APPLY: finished
0709 12:18:46.460529 (+   333us) log.cc:844] Serialized 83 byte log entry
0709 12:18:46.460697 (+   168us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:46.460851 (+   154us) write_op.cc:454] Released schema lock
0709 12:18:46.460905 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:46.461344 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:46.461562 (+   218us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":114688,"reported_tablets":53,"child_traces":[["op",{"apply.queue_time_us":332,"apply.run_cpu_time_us":3290,"apply.run_wall_time_us":3300,"num_ops":11,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":4130,"prepare.run_wall_time_us":4130,"replication_time_us":3732}]]}
W20260709 12:18:47.010079 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 200880us
I20260709 12:18:47.012490 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:47.013176 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.000948 27749 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.013592 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.017095 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.017725 24168 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:47.014125 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.014539 24093 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:18:47.021067 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 58323.4us
W20260709 12:18:47.022081 24067 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.555s (SENT)
I20260709 12:18:47.008909 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.025722 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.027155 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.029163 24176 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:47.022475 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.030591 24168 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:47.034117 24168 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:18:47.044274 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:47.001631 27740 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.055444 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.056571 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.056994 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.056413 27793 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:47.060441 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.056878 27692 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:18:47.074362 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.076006 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.086581 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:47.087409 24097 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:47.088277 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.090541 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.091585 24813 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:18:47.093700 27775 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:47.094584 27775 consensus_queue.cc:1243] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:18:47.098249 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.099063 27785 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:47.100386 24811 raft_consensus.cc:2368] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8.
I20260709 12:18:47.101598 27785 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.104230 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.106678 24175 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:47.108415 24097 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:18:47.111706 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.113724 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.116780 24813 raft_consensus.cc:1217] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[7.7-15.11]   Dedup: 11.9->[14.10-15.11]
I20260709 12:18:47.117365 24813 pending_rounds.cc:85] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Aborting all ops after (but not including) 9
I20260709 12:18:47.117628 24813 pending_rounds.cc:107] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:18:47.117887 24813 raft_consensus.cc:2889] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:47.118364 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.126458 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:47.102612 23994 catalog_manager.cc:5697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 6 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 7 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
W20260709 12:18:47.126375 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 104324us
I20260709 12:18:47.127287 24176 raft_consensus.cc:2376] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8. Re-sending same reply.
W20260709 12:18:47.134357 27863 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:18:47.137224 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.138474 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.138728 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.139971 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.140934 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.142577 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.145810 24172 raft_consensus.cc:2376] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10. Re-sending same reply.
I20260709 12:18:47.154441 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.154543 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.156991 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.157888 24176 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
W20260709 12:18:47.158625 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 305637us
I20260709 12:18:47.159785 24173 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:47.160701 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.163416 24096 raft_consensus.cc:2410] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:18:47.164772 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:47.166198 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.190907 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.195981 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:47.197966 24175 raft_consensus.cc:2376] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10. Re-sending same reply.
I20260709 12:18:47.194969 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.199584 24176 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 5.
I20260709 12:18:47.196903 24215 leader_election.cc:400] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8.
I20260709 12:18:47.203742 24215 leader_election.cc:403] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:47.205809 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.192867 24167 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:47.206473 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.206882 24176 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:47.209807 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:47.196033 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 308791us
I20260709 12:18:47.211175 24168 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:47.148803 27793 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.055s
I20260709 12:18:47.211308 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.215265 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:47.225843 27860 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:47.226498 27860 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.226900 27860 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.227517 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:47.232353 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.207999 27740 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.236150 24096 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:18:47.229641 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.212925 27838 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:18:47.238569 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.203101 27783 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:47.245996 23994 catalog_manager.cc:5697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 4 to 7, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 7 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.245747 27740 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.216619 27749 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
W20260709 12:18:47.259658 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48452.5us
I20260709 12:18:47.259760 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.261391 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.262598 24140 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.270433 24140 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:47.283344 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.267778 27861 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.254856 23994 catalog_manager.cc:5697] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 5 to 8, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:47.274295 27572 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.268082 27859 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:18:47.283708 27740 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:47.325757 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64982.8us
I20260709 12:18:47.330286 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.286324 27775 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.037s
I20260709 12:18:47.295979 23994 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 4 to 5, term changed from 6 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to <none>, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193), VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194), VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195), VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 7 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:18:47.340870 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 121335us
I20260709 12:18:47.332839 27749 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:47.322412 27686 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:18:47.354768 24170 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:47.335166 27870 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:18:47.361347 23994 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:18:47.368320 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 98011.2us
I20260709 12:18:47.369683 24171 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:47.369306 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:47.357045 27869 log.cc:927] Time spent T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:18:47.374766 24067 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.374322 27810 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:47.361029 27693 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.347270 27749 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:47.390594 27860 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.370863 27870 consensus_queue.cc:1243] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer 5d0f174a97494d0cbf08ae81ec4c807a log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:18:47.408430 24140 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.408033 23994 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:47.376438 27741 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.396291 27749 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.406617 27879 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.378233 27810 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:47.410956 27859 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.403604 27693 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:47.379766 27474 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:18:47.380810 27678 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 12:18:47.414233 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 43994.3us
I20260709 12:18:47.480829 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.452906 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:47.485780 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.487027 24094 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
W20260709 12:18:47.412405 27873 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:18:47.412724 27877 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.411706 24140 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.424063 27810 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.440661 27693 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:47.496786 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 100908us
W20260709 12:18:47.496918 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 85324.3us
I20260709 12:18:47.498525 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:47.483856 27871 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.504730 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:47.509759 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48942.3us
W20260709 12:18:47.511157 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 129236us
I20260709 12:18:47.512660 24140 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.515635 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:47.518144 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:47.518852 24811 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:18:47.522883 27862 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.523010 27740 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:47.501852 27741 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.514339 27693 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:18:47.531508 27693 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.531900 27693 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:47.533200 27883 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:47.533635 27883 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:47.533995 27883 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.514223 27871 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:47.550426 27871 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:47.552296 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:47.553135 24171 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
W20260709 12:18:47.560542 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 44995.6us
I20260709 12:18:47.561630 24140 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.570040 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1646) took 1153 ms. Trace:
I20260709 12:18:47.587285 24169 rpcz_store.cc:276] 0709 12:18:46.416483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:46.731895 (+315412us) service_pool.cc:224] Handling call
0709 12:18:46.732301 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:46.783648 (+ 51347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:46.783688 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:46.784251 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:18:47.014724 (+230473us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:47.044526 (+ 29802us) log.cc:844] Serialized 14 byte log entry
0709 12:18:47.044825 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:47.044919 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:47.141165 (+ 96246us) spinlock_profiling.cc:243] Waited 1.59 ms on lock 0x7b18001e0880. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:47.556280 (+415115us) raft_consensus.cc:1685] finished
0709 12:18:47.569819 (+ 13539us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:47.569966 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50394,"prepare.queue_time_us":33052,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":51057,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":248,"spinlock_wait_cycles":3664640,"thread_start_us":229978,"threads_started":1,"wal-append.queue_time_us":342242}
I20260709 12:18:47.520171 27879 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:47.592036 24094 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:47.586097 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:18:47.596308 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 85769.8us
I20260709 12:18:47.601830 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:47.612090 27860 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.593720 27740 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.571743 27741 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.618166 27693 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:47.623735 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 101390us
I20260709 12:18:47.574689 27678 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:18:47.601331 27865 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:47.635030 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:47.638954 24096 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:47.627902 27886 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.599498 27862 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:18:47.632862 27686 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.019s
W20260709 12:18:47.655597 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 58478.1us
I20260709 12:18:47.657567 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.657989 27838 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8.
I20260709 12:18:47.658500 27860 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:47.659003 27860 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:47.626827 27741 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.659446 27860 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.661155 27741 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.638741 27865 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:47.676544 27862 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.676883 27865 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.677264 27862 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.680054 27862 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.683759 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1388d59244114d37a482e6205f04c237"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:47.684551 24097 raft_consensus.cc:606] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:47.684974 24097 raft_consensus.cc:614] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:47.688257 27889 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:47.691574 27693 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:47.688398 27883 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.693418 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:47.694097 27883 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.698457 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:47.699195 24813 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:18:47.700179 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:47.694093 24092 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:18:47.701040 27883 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.701494 24067 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.702332 27883 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:47.694448 24101 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:47.704066 27810 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.705245 24093 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:47.705757 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.706462 27810 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.706553 27794 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:47.707070 27794 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:47.707484 27794 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.666320 27749 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.702749 27883 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:47.719487 24096 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:47.719208 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30d4ada45d4b4872986993abc4470158"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:47.720613 24097 raft_consensus.cc:606] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:47.720983 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.721875 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.722652 24096 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:47.636641 24216 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.723898 24067 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:47.724072 27883 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:47.727706 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 91218.1us
I20260709 12:18:47.728855 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.729801 27678 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.730429 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.731412 27678 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:47.732694 24216 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.733566 27890 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:47.735745 27741 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.736320 27741 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.741163 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:47.741295 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.742686 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.743922 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.749249 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:47.751417 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:47.752079 24245 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:47.755159 24095 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:47.747236 27741 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.764216 24092 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:18:47.768654 24779 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:47.769907 24245 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:47.726492 27810 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:47.726662 27793 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:47.782459 24214 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:47.748169 27870 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:47.790827 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66996us
I20260709 12:18:47.739861 27889 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:18:47.799015 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 63373.5us
I20260709 12:18:47.800019 24216 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.747032 27784 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:18:47.740824 27838 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:18:47.805639 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:47.788259 27785 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:47.813043 27749 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.822259 24092 raft_consensus.cc:606] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:47.834223 24092 raft_consensus.cc:614] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:47.796398 27678 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:18:47.741557 27865 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:47.841027 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.845078 27785 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:47.851269 27775 raft_consensus.cc:3055] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:47.851715 27775 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:47.852046 27785 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:47.852623 27775 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.854012 27775 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.855206 27885 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:47.857853 27838 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:47.858244 27838 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:47.861472 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 61544us
I20260709 12:18:47.862469 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.864114 27885 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:47.865299 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.866169 27693 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:47.866781 27693 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:47.870702 27693 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:47.871472 27693 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.872766 27838 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.874593 27838 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.845327 27862 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:47.875644 27862 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.822165 27572 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:47.879153 27572 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.884940 27859 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:47.885151 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.834322 27741 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:47.885576 27859 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.887017 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.887933 27859 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.888001 27474 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:47.885980 27889 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:47.888711 27889 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:47.889096 27889 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.889189 27865 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:47.889446 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.890288 27474 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:47.891364 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:47.891995 24170 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:47.895009 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:47.899209 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:47.899077 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.901254 24170 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:18:47.903007 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:47.899540 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.923979 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.886291 27741 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.926234 24095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:47.941027 24095 raft_consensus.cc:606] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:47.940160 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.895807 27474 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:47.951501 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 107142us
I20260709 12:18:47.916015 27678 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:47.922564 27572 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.931769 27878 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:47.962949 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:47.943815 27693 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:47.971410 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:47.972990 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.974138 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:47.965250 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 170322us
I20260709 12:18:47.985365 27692 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:47.985656 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:47.985960 27678 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:47.975404 27780 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:47.968006 27890 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:18:47.990136 27890 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:47.990500 27890 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:47.991096 27572 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:47.991437 27890 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.991767 27572 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.992899 27890 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:47.994316 27572 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.970700 27885 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:47.995378 27885 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:47.997709 27885 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:47.998149 27741 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:47.999377 27866 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:47.981877 27474 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:18:47.999944 27866 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:48.000928 27866 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.002081 27860 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.004530 27877 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:48.004412 27883 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.981982 27686 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:18:48.005705 24099 raft_consensus.cc:2410] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:48.007242 24096 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:48.009187 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.975737 27878 raft_consensus.cc:697] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:48.012650 27878 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:48.017378 24242 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8665b055009a4659b6d86621874dddbd"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:48.017774 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:48.018062 24242 raft_consensus.cc:606] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:48.021368 27889 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:47.975936 27870 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:48.023198 27741 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:48.023427 27870 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:48.023876 27870 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:48.023842 27741 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.027019 27741 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:48.028441 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:47.979172 27862 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:48.035137 27794 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:48.038002 27794 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:48.038239 27860 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:48.038789 24095 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:48.006739 27883 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:48.041314 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 59199.9us
W20260709 12:18:48.044094 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66332.3us
I20260709 12:18:48.054241 24813 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:18:48.063941 24173 pending_rounds.cc:85] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 3
I20260709 12:18:48.080330 24173 pending_rounds.cc:107] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 7.4
I20260709 12:18:48.080636 24173 raft_consensus.cc:2889] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:48.083388 24092 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:48.087891 24095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:48.088759 24095 raft_consensus.cc:606] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:48.097035 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.097733 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.100535 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:48.102077 27886 raft_consensus.cc:993] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:48.102638 27886 raft_consensus.cc:1081] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:48.104018 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:48.106854 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:48.112239 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:48.119422 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:48.127120 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:48.132499 27678 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.133198 27678 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.135654 27678 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:48.120126 27692 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:18:48.157902 24215 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:48.098994 27693 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:18:48.196005 24172 raft_consensus.cc:872] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }.
  Pending config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }: 
  New config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:48.203529 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:48.204239 24169 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:48.123334 27686 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 12:18:48.196557 24172 raft_consensus.cc:1579] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Could not prepare op 'term: 9 index: 7' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }.
  Pending config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }: 
  New config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:48.194316 27889 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:48.235975 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:48.236284 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:48.236996 24092 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:18:48.237375 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:48.259125 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:48.220503 27775 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:48.208202 27915 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:48.274495 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:48.275410 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:48.279623 24250 raft_consensus.cc:2410] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:18:48.285214 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:48.160749 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:48.260581 27740 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:48.238826 27862 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:48.259084 27859 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:48.310369 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:48.328665 24092 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
W20260709 12:18:48.333636 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 55249.8us
I20260709 12:18:48.311757 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:48.271286 27741 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:48.345165 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:48.287974 27912 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:48.366479 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:48.368206 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:48.352375 24172 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:18:48.374738 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:48.284184 27775 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:48.392561 27906 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:18:48.334056 27862 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:48.394318 27916 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:18:48.394636 27907 log.cc:927] Time spent T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:18:48.367515 27686 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:48.400799 27919 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:48.391135 27868 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:48.417270 24169 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:48.311551 27740 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.432806 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:48.433873 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 318687us
I20260709 12:18:48.343356 27859 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.480370 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:48.474318 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.474292 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:48.361178 27741 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.481932 24095 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:48.488955 24246 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:18:48.479224 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:48.468786 27868 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:48.512266 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:48.481297 27692 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:48.532758 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:48.511477 27693 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:48.424696 27912 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.483053 27686 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:48.578378 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:48.579387 24174 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:48.552256 27929 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:48.473840 27919 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:48.575009 27693 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.589794 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:48.609786 24246 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:18:48.537472 27692 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:48.627967 27859 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:48.628633 27474 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:48.603471 27929 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:48.629168 27474 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:48.631350 27910 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:18:48.630542 27474 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.588297 27898 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:18:48.638540 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:48.639899 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:48.641011 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:48.641561 24169 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:48.650794 27913 raft_consensus.cc:3055] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:48.652204 27913 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:48.653735 27922 log.cc:927] Time spent T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:18:48.653430 27913 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:48.651783 27925 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:18:48.656369 27901 raft_consensus.cc:993] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:48.657027 27901 raft_consensus.cc:1081] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:48.660310 27775 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:48.660892 27918 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.260s	user 0.002s	sys 0.000s
I20260709 12:18:48.663050 27740 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:48.702291 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:48.622313 27924 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
W20260709 12:18:48.751869 27922 log.cc:927] Time spent T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.097s	user 0.004s	sys 0.000s
I20260709 12:18:48.614614 27868 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:48.752811 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:48.790868 24167 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
W20260709 12:18:48.880012 27921 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.478s	user 0.002s	sys 0.000s
W20260709 12:18:48.965178 24170 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.012s	sys 0.016s
W20260709 12:18:48.965778 24099 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.004s	sys 0.010s
W20260709 12:18:48.968228 24099 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.004s	sys 0.011s
W20260709 12:18:48.968794 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.011s	sys 0.018s
W20260709 12:18:48.969983 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.011s	sys 0.018s
W20260709 12:18:48.971306 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 618898us
W20260709 12:18:48.967945 24170 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.565s	user 0.012s	sys 0.016s
W20260709 12:18:48.974304 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 402857us
I20260709 12:18:48.976986 24066 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:48.977487 27951 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:48.978200 27951 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:48.977272 27883 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.013s	sys 0.003s
W20260709 12:18:48.979290 27883 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.014s	sys 0.003s
I20260709 12:18:48.980753 27951 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:48.984021 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:48.994689 24169 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:48.913338 27913 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:48.911191 27474 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:48.981720 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.011066 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.015419 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.017846 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:48.984818 27862 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.018775 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:49.018805 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 442440us
I20260709 12:18:49.037457 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.040244 24141 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:49.061864 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50931.1us
I20260709 12:18:49.063256 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.104600 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:49.106279 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 66120.4us
I20260709 12:18:49.107502 24141 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:49.125334 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 111175us
I20260709 12:18:49.126402 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:49.128902 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 104971us
W20260709 12:18:49.129448 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66323.7us
I20260709 12:18:49.130514 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:49.157557 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50189.6us
I20260709 12:18:49.158494 24141 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.159865 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.013737 27883 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.162806 24067 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.101117 27951 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:49.101871 27860 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.173476 24066 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.171178 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 2063) took 1084 ms. Trace:
I20260709 12:18:49.185096 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:49.160825 27870 consensus_meta.cc:287] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.136s	user 0.017s	sys 0.022s
I20260709 12:18:49.203727 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.127955 27693 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:49.152287 27775 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:49.161983 27686 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:49.204723 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.157243 27810 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:18:49.210971 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 51192.2us
I20260709 12:18:49.234493 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:49.227301 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64592.1us
I20260709 12:18:49.167544 27859 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:49.199793 27924 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:18:49.180255 24171 rpcz_store.cc:276] 0709 12:18:48.086704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.752321 (+665617us) service_pool.cc:224] Handling call
0709 12:18:48.752767 (+   446us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.775773 (+ 23006us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.775819 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:48.776457 (+   638us) log.cc:844] Serialized 26 byte log entry
0709 12:18:48.970773 (+194316us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:49.126971 (+156198us) log.cc:844] Serialized 14 byte log entry
0709 12:18:49.170669 (+ 43698us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.170794 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.170858 (+    64us) raft_consensus.cc:1685] finished
0709 12:18:49.170879 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.171091 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129075,"prepare.queue_time_us":147694,"raft.queue_time_us":26449,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":140,"thread_start_us":193809,"threads_started":1,"wal-append.queue_time_us":194229}
I20260709 12:18:49.237846 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.193416 27692 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.194177 27877 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:49.240455 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 2052) took 1170 ms. Trace:
I20260709 12:18:49.210218 27490 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:49.229125 27921 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:18:49.223479 27572 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:49.264899 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:49.264982 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 91659.8us
I20260709 12:18:49.238088 27883 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:49.288834 24244 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:49.293032 27943 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:49.293743 27943 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.295315 27939 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:49.296000 27939 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.299155 27942 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:49.299806 27942 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.302551 27935 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:49.303319 27936 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.303975 27914 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:49.221030 27870 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.304539 27914 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.306552 27870 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:49.307543 27944 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:49.308353 27954 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:18:49.309468 27953 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.310268 27904 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.311048 27946 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.318913 27957 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.319571 27957 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.235761 27775 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.324000 27775 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:49.325143 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 664) took 1172 ms. Trace:
I20260709 12:18:49.325522 24172 rpcz_store.cc:276] 0709 12:18:48.153020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.324156 (+1171136us) service_pool.cc:224] Handling call
0709 12:18:49.324541 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.324807 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.324833 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:49.324881 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:18:49.324917 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.324969 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.325075 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:49.263309 27877 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.327412 27741 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.328667 27877 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.331089 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1666) took 1133 ms. Trace:
W20260709 12:18:49.331873 27890 consensus_meta.cc:287] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.338s	user 0.025s	sys 0.015s
I20260709 12:18:49.333163 24172 rpcz_store.cc:276] 0709 12:18:48.197361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.330127 (+1132766us) service_pool.cc:224] Handling call
0709 12:18:49.330508 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.330726 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.330751 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:49.330794 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:49.330827 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.330885 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.331023 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:49.335647 24097 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:18:49.340096 24244 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
W20260709 12:18:49.345609 24174 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.766s	user 0.014s	sys 0.008s
I20260709 12:18:49.346549 24174 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:49.351732 24241 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:49.229859 27919 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.283361 27882 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:49.355581 27882 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.356043 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:49.356760 27955 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:49.357352 27955 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.358004 27882 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.360453 24171 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 12:18:49.265530 27490 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.221334 27912 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.302246 27942 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.322011 27957 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:49.306842 27914 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.372870 27883 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:49.373108 27490 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:49.290001 27572 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.400620 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 2064) took 1313 ms. Trace:
W20260709 12:18:49.402454 27926 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.783s	user 0.011s	sys 0.004s
I20260709 12:18:49.401404 24167 rpcz_store.cc:276] 0709 12:18:48.086932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.791810 (+704878us) service_pool.cc:224] Handling call
0709 12:18:48.792244 (+   434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.912036 (+119792us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.912078 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:48.962101 (+ 50023us) log.cc:844] Serialized 26 byte log entry
0709 12:18:49.114397 (+152296us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:49.195077 (+ 80680us) log.cc:844] Serialized 14 byte log entry
0709 12:18:49.366436 (+171359us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.366603 (+   167us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.400362 (+ 33759us) raft_consensus.cc:1685] finished
0709 12:18:49.400389 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.400548 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24161,"prepare.queue_time_us":130130,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"raft.queue_time_us":35210,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":49958,"thread_start_us":257457,"threads_started":2,"wal-append.queue_time_us":299380}
I20260709 12:18:49.403406 27955 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.404114 27939 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.409315 27572 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.410868 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 2059) took 1325 ms. Trace:
I20260709 12:18:49.411442 24175 rpcz_store.cc:276] 0709 12:18:48.085599 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.109809 (+ 24210us) service_pool.cc:224] Handling call
0709 12:18:48.110156 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.235738 (+125582us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.235777 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:48.237119 (+  1342us) log.cc:844] Serialized 26 byte log entry
0709 12:18:48.432835 (+195716us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:48.875126 (+442291us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b1800483940. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c08f733c7 00007f4c055859a7 00007f4c055950bf
0709 12:18:48.875431 (+   305us) log.cc:844] Serialized 14 byte log entry
0709 12:18:48.876447 (+  1016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:48.876582 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.401854 (+525272us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:49.410646 (+  8792us) raft_consensus.cc:1685] finished
0709 12:18:49.410668 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.410801 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65335,"prepare.queue_time_us":148257,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":63499,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":12720,"spinlock_wait_cycles":83350144,"thread_start_us":342461,"threads_started":3,"wal-append.queue_time_us":283423}
I20260709 12:18:49.413470 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1662) took 1265 ms. Trace:
I20260709 12:18:49.413825 24171 rpcz_store.cc:276] 0709 12:18:48.147876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.252246 (+1104370us) service_pool.cc:224] Handling call
0709 12:18:49.347457 (+ 95211us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:49.360880 (+ 13423us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.413256 (+ 52376us) spinlock_profiling.cc:243] Waited 94.6 ms on lock 0x7b54002adad0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:49.413408 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":217517440}
I20260709 12:18:49.414251 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1672) took 1051 ms. Trace:
I20260709 12:18:49.404152 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1671) took 1120 ms. Trace:
I20260709 12:18:49.416450 24167 rpcz_store.cc:276] 0709 12:18:48.284101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.403237 (+1119136us) service_pool.cc:224] Handling call
0709 12:18:49.403615 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.403821 (+   206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.403847 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:49.403896 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:49.403925 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.403985 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.404090 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:49.418781 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 184464us
I20260709 12:18:49.414605 24175 rpcz_store.cc:276] 0709 12:18:48.362693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.413410 (+1050717us) service_pool.cc:224] Handling call
0709 12:18:49.413759 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.413961 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.413985 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:49.414025 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:49.414057 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.414107 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.414199 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:49.419706 24141 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.420984 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.423534 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 2065) took 1336 ms. Trace:
I20260709 12:18:49.424364 27929 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.424636 27859 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:49.425421 27859 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.426077 27859 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:49.427310 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 2051) took 1366 ms. Trace:
I20260709 12:18:49.427642 24170 rpcz_store.cc:276] 0709 12:18:48.061186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.062208 (+  1022us) service_pool.cc:224] Handling call
0709 12:18:48.062594 (+   386us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:48.063068 (+   474us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:18:48.230777 (+167709us) log.cc:844] Serialized 14 byte log entry
0709 12:18:48.616920 (+386143us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b4800111e58. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0a4a4aa1 00007f4c0a49bb37 00007f4c0a49b9ca 00007f4c0a59326f 00007f4c0a592f37 00007f4c0a5a755c 00007f4c0a5a7508 00007f4c0a5a7488 00007f4c0a5a7443 00007f4c0a5a66ec 00007f4c094d0a96
0709 12:18:48.973845 (+356925us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:48.974574 (+   729us) log.cc:844] Serialized 52 byte log entry
0709 12:18:48.976437 (+  1863us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:49.118363 (+141926us) log.cc:844] Serialized 14 byte log entry
0709 12:18:49.244967 (+126604us) log.cc:844] Serialized 14 byte log entry
0709 12:18:49.417915 (+172948us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b1800374080. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02408c0a 00007f4c0bb48219 00007f4c0944f58f 00007f4c0248e571 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd
0709 12:18:49.426967 (+  9052us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.427076 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.427118 (+    42us) raft_consensus.cc:1685] finished
0709 12:18:49.427129 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.427252 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":593846,"prepare.queue_time_us":576201,"prepare.run_cpu_time_us":273,"prepare.run_wall_time_us":46095,"raft.queue_time_us":252131,"raft.run_cpu_time_us":3518,"raft.run_wall_time_us":582487,"spinlock_wait_cycles":17168640,"thread_start_us":786564,"threads_started":3,"wal-append.queue_time_us":236681}
I20260709 12:18:49.422581 27883 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.430228 24170 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:18:49.431464 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 149093us
I20260709 12:18:49.435181 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.436160 24170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:49.436738 24170 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:49.437110 24170 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.441710 24175 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:49.365343 24174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30d4ada45d4b4872986993abc4470158"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:49.444133 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.444569 24174 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:49.444978 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.444998 24174 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.370713 27890 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:49.442001 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1673) took 1070 ms. Trace:
I20260709 12:18:49.449270 24092 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
W20260709 12:18:49.392683 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 137752us
I20260709 12:18:49.445653 24095 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:18:49.450603 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.459623 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.459770 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.460558 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.461066 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.453094 24171 rpcz_store.cc:276] 0709 12:18:48.371275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.414740 (+1043465us) service_pool.cc:224] Handling call
0709 12:18:49.441505 (+ 26765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.441680 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.441704 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:49.441747 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:49.441785 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.441837 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.441943 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:18:49.458173 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:49.464216 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.465562 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.423938 24176 rpcz_store.cc:276] 0709 12:18:48.087192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.980482 (+893290us) service_pool.cc:224] Handling call
0709 12:18:48.980876 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:48.985531 (+  4655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.985564 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:49.005582 (+ 20018us) log.cc:844] Serialized 26 byte log entry
0709 12:18:49.149224 (+143642us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:18:49.242604 (+ 93380us) log.cc:844] Serialized 14 byte log entry
0709 12:18:49.423201 (+180597us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.423277 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.423317 (+    40us) raft_consensus.cc:1685] finished
0709 12:18:49.423332 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.423460 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":252694,"prepare.queue_time_us":99776,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":4716,"raft.queue_time_us":184045,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":191,"thread_start_us":87255,"threads_started":1,"wal-append.queue_time_us":224888}
I20260709 12:18:49.472031 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.472775 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.478042 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.478163 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.480145 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.481207 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:49.453238 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 303442us
I20260709 12:18:49.486745 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.488035 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.489670 27903 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:18:49.495370 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.409372 27943 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.497285 27866 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:49.554888 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:49.555176 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 72686.8us
I20260709 12:18:49.560014 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.452962 27952 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:49.561458 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 77919.6us
I20260709 12:18:49.565128 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1660) took 1440 ms. Trace:
I20260709 12:18:49.565542 24245 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:49.477905 27904 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:49.569820 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.570385 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.570513 24092 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:49.572623 27686 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.573215 27686 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.566929 27780 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.575133 27693 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:49.575027 27780 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.575723 27693 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.576416 27938 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:49.577198 27780 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:49.576987 27938 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.577740 24095 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:49.577929 27693 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:49.579159 27904 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.581341 27904 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.567714 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.582856 24171 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:49.578868 27913 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.574s	user 0.008s	sys 0.002s
I20260709 12:18:49.588007 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1659) took 1481 ms. Trace:
I20260709 12:18:49.588402 24169 rpcz_store.cc:276] 0709 12:18:48.107130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.997245 (+890115us) service_pool.cc:224] Handling call
0709 12:18:48.997552 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:49.003297 (+  5745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.003354 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:49.004965 (+  1611us) log.cc:844] Serialized 26 byte log entry
0709 12:18:49.476167 (+471202us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:18:49.563045 (+ 86878us) log.cc:844] Serialized 14 byte log entry
0709 12:18:49.565575 (+  2530us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.565654 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.587786 (+ 22132us) raft_consensus.cc:1685] finished
0709 12:18:49.587809 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.587945 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5866,"prepare.queue_time_us":90142,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":8950,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":16065,"thread_start_us":358410,"threads_started":1,"wal-append.queue_time_us":552631}
I20260709 12:18:49.572373 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:49.558710 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:49.595384 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 76054.6us
I20260709 12:18:49.596431 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:49.597713 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.599807 27862 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:49.604965 27686 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:49.611693 27862 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:49.610996 27859 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:18:49.605667 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47081.2us
I20260709 12:18:49.612223 27862 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:49.612313 27859 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:49.612847 27859 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:49.605867 27919 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:49.615583 27919 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:49.616534 27919 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:49.617182 27474 consensus_meta.cc:287] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.612s	user 0.015s	sys 0.001s
I20260709 12:18:49.599542 27948 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:49.600138 24174 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.619627 27948 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.620882 24176 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:49.622264 27948 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.611230 27938 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:49.625221 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:49.627542 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:49.628423 24174 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.628942 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:49.629691 24245 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:49.631021 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:49.633351 27904 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:49.631153 27935 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:49.633915 27904 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.634404 27935 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.636850 27935 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.637580 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:59356 (request call id 1670) took 1393 ms. Trace:
I20260709 12:18:49.641940 24099 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:49.638015 24174 rpcz_store.cc:276] 0709 12:18:48.259427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.365204 (+1105777us) service_pool.cc:224] Handling call
0709 12:18:49.628939 (+263735us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:49.568876 27878 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:18:49.637144 27961 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:49.649151 27961 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.653402 27904 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.655931 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.661767 24093 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:18:49.662355 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.637056 27953 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:49.670579 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:49.672374 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.645406 24170 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.677855 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:49.678551 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:49.678550 24167 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:49.681565 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.682519 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:49.683139 24101 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:49.683461 24101 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:49.686651 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.687359 24099 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:49.691543 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.693353 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.695778 24170 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.700685 24215 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:49.644785 27935 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:49.705758 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.708782 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:49.712296 24093 raft_consensus.cc:3055] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:49.712692 24093 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:49.706231 24101 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.713500 24101 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.709932 24215 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:49.714866 24215 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:49.565574 24168 rpcz_store.cc:276] 0709 12:18:48.124937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.015549 (+890612us) service_pool.cc:224] Handling call
0709 12:18:49.016028 (+   479us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:18:49.151175 (+135147us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.151209 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:18:49.175866 (+ 24657us) log.cc:844] Serialized 26 byte log entry
0709 12:18:49.380635 (+204769us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:49.444264 (+ 63629us) log.cc:844] Serialized 14 byte log entry
0709 12:18:49.564830 (+120566us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.564905 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.564947 (+    42us) raft_consensus.cc:1685] finished
0709 12:18:49.564956 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.565067 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270506,"prepare.queue_time_us":16902,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":261117,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":29965,"thread_start_us":134627,"threads_started":1,"wal-append.queue_time_us":167361}
I20260709 12:18:49.668951 27955 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:49.717195 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:49.717201 27474 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.717986 24250 raft_consensus.cc:2376] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8. Re-sending same reply.
I20260709 12:18:49.719935 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.720836 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.721669 24093 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.722883 24093 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.724458 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.727335 27896 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:49.727965 27896 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.677668 27953 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:49.730350 27896 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.730491 27953 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.731884 27953 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:49.711663 27889 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:49.719480 27966 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:49.716683 24215 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:49.768257 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.769404 24175 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:49.772945 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.773903 24171 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:49.776696 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.796703 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:49.799156 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.799948 24168 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:49.796622 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.706233 27572 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:49.812911 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 665) took 1578 ms. Trace:
I20260709 12:18:49.813401 24172 rpcz_store.cc:276] 0709 12:18:48.234404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.334224 (+1099820us) service_pool.cc:224] Handling call
0709 12:18:49.370562 (+ 36338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.415836 (+ 45274us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:49.415870 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:49.415914 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:18:49.415946 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.812637 (+396691us) spinlock_profiling.cc:243] Waited 45 ms on lock 0x7b54002571d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:49.812692 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.812838 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":103573760}
I20260709 12:18:49.734344 27961 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:49.815584 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:49.771602 27915 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:49.252628 24173 rpcz_store.cc:276] 0709 12:18:48.062141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.063233 (+  1092us) service_pool.cc:224] Handling call
0709 12:18:48.063677 (+   444us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:48.105624 (+ 41947us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:48.105670 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:48.106339 (+   669us) log.cc:844] Serialized 52 byte log entry
0709 12:18:48.351798 (+245459us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:48.525535 (+173737us) log.cc:844] Serialized 14 byte log entry
0709 12:18:48.878961 (+353426us) spinlock_profiling.cc:243] Waited 4.91 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:18:49.118424 (+239463us) log.cc:844] Serialized 14 byte log entry
0709 12:18:49.199268 (+ 80844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:49.199397 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:49.232087 (+ 32690us) raft_consensus.cc:1685] finished
0709 12:18:49.232121 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:49.232350 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":290660,"prepare.queue_time_us":419817,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":122,"raft.queue_time_us":251532,"raft.run_cpu_time_us":564,"raft.run_wall_time_us":38307,"spinlock_wait_cycles":11299840,"thread_start_us":750649,"threads_started":3,"wal-append.queue_time_us":223032}
I20260709 12:18:49.819768 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:49.796063 27889 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:49.882525 27474 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:49.882732 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67301.2us
I20260709 12:18:49.883245 27474 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.884109 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:49.884907 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:49.886837 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 58865.5us
I20260709 12:18:49.887001 27890 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:49.806742 27938 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:49.814064 27686 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:49.887199 27879 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:49.894026 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:49.738780 27935 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:18:49.771099 27955 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.913206 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.889694 27474 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:49.891007 27966 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:49.817003 27572 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.896013 27904 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:49.889871 27838 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:49.896200 27890 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:49.934012 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:49.901060 27879 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:49.936154 24170 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
W20260709 12:18:49.942304 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 239916us
I20260709 12:18:49.943173 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.930378 24093 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
W20260709 12:18:49.935635 27490 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.001s
I20260709 12:18:49.918102 27966 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:49.926882 24066 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:49.901160 27883 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:18:49.952104 24140 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:49.910663 27859 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:49.954499 27923 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:49.954300 27490 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.901142 27938 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.971848 24092 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:49.981070 24811 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:18:49.919073 24101 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:49.919991 27904 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:49.903452 27686 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.902932 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:49.983073 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:49.983335 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:49.983780 24173 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:49.983829 24097 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:49.964916 27490 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:49.948454 27879 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:49.955343 27966 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:49.984082 24242 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:49.990175 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:49.965674 27948 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:49.917681 27903 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:18:49.947738 27890 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:49.970930 27877 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:50.003518 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:50.004920 24140 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:49.952661 27838 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.014863 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.015664 24097 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:50.022305 24173 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:49.983043 27904 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:50.023459 27948 raft_consensus.cc:697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:50.028391 27948 consensus_queue.cc:237] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:49.966835 27785 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:18:50.034763 27572 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:50.037065 27932 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:50.037685 27932 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:50.038296 27838 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.040405 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.040611 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:50.042542 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:50.042831 27958 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:50.043398 27958 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:50.048691 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.049826 24093 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:49.888123 27915 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.059151 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:50.059995 24093 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:50.060923 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 229419us
I20260709 12:18:49.971268 27923 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:50.067799 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.070235 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:50.076666 24214 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:50.084776 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.086306 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:50.087440 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:50.089542 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 142654us
W20260709 12:18:50.092185 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 175412us
I20260709 12:18:50.101305 24093 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:50.103200 24214 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:50.104467 24214 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:50.075420 27950 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:50.105650 24214 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:50.044317 27958 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.038663 27932 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.084685 27913 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:50.117919 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 191171us
I20260709 12:18:50.119534 24066 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:50.110059 27693 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:18:50.113163 27929 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:50.148873 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 97311.9us
I20260709 12:18:50.111313 27935 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:50.135196 27868 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:50.124171 27883 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:50.152160 27883 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.154706 27883 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:50.143924 27971 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.185s	user 0.000s	sys 0.001s
I20260709 12:18:50.162801 27775 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.118497 27945 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:50.140304 27686 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:50.179283 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 59880us
I20260709 12:18:50.155506 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:50.155946 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:50.180739 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:50.112677 27919 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:18:50.117122 27692 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:50.174492 24172 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 12:18:50.149055 27862 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.002s
I20260709 12:18:50.126189 27955 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:50.180003 27749 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:50.186682 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 196623us
I20260709 12:18:50.199342 27896 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:50.200066 27923 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:50.179265 27775 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.201838 27955 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:50.206339 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:50.208542 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:50.212844 27945 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.213680 27938 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.215065 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:50.215735 24814 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:18:50.213436 27945 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.221282 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:50.222020 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 96013.6us
I20260709 12:18:50.224591 27966 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.186534 27692 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:50.185591 27859 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:50.190912 27862 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:50.247043 27862 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:50.235661 27982 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:18:50.243165 27692 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:50.243634 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:50.187207 27915 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.262053 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.264092 24095 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:18:50.265259 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:50.228879 27885 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:50.281302 27885 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.283898 27885 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.285403 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.286265 24096 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:50.286288 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:50.269428 24175 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:50.251842 27913 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:50.293538 24170 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:50.274521 24176 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
W20260709 12:18:50.300572 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 180822us
I20260709 12:18:50.302627 24214 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:50.307691 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.309549 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:50.310359 24249 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:50.311517 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.301105 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:50.301613 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 69764.1us
I20260709 12:18:50.226882 27693 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:50.331843 24214 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:50.333549 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:50.334300 24248 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:50.342125 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.343266 24245 raft_consensus.cc:2410] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:18:50.323606 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.345522 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.347597 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.348016 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:50.281385 27794 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:50.349385 24141 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.351327 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.355317 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.356074 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:50.359630 24779 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:50.362347 27943 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:50.350742 27915 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:50.350467 27870 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.369204 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.370010 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1682) took 1378 ms. Trace:
I20260709 12:18:50.319713 27932 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:50.367203 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.370415 24167 rpcz_store.cc:276] 0709 12:18:48.991528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:49.437859 (+446331us) service_pool.cc:224] Handling call
0709 12:18:49.438130 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:49.688513 (+250383us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:50.369754 (+681241us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400199454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:50.369939 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542718848}
I20260709 12:18:50.377991 24245 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:18:50.372366 24214 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:50.384687 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.390867 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:50.391834 24094 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:50.392611 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.395064 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.394807 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.354161 27952 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:50.354430 27948 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:50.353379 27794 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:50.322723 27913 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.369010 27859 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:50.458472 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 93102us
I20260709 12:18:50.395326 27950 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:50.468262 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 71726.4us
I20260709 12:18:50.469472 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.370195 27895 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:18:50.500525 27950 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:50.505503 27950 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:50.501735 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.505635 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.469434 27692 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.510571 27692 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.511416 27794 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.512501 27794 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:50.469194 27879 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:50.516077 24169 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:50.518015 27879 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:50.368817 27572 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:50.341830 27693 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:50.521776 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 137205us
I20260709 12:18:50.526484 24247 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:18:50.369671 27980 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.127s
I20260709 12:18:50.527437 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.458366 27870 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.456933 27935 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:50.539894 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.371639 27943 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:50.462616 27861 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:50.545346 24094 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:50.547410 24141 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.373960 27976 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.147s
W20260709 12:18:50.532351 27890 consensus_meta.cc:287] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.001s
I20260709 12:18:50.463099 27951 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:50.466566 27948 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:50.398247 27932 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.520053 27966 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.522382 27952 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:50.542608 27962 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:50.551237 27572 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:50.572669 27948 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:50.593091 27693 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:50.594283 27989 log.cc:927] Time spent T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:18:50.595288 27945 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.577925 27952 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.597739 27952 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:50.599210 27943 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:50.599658 27932 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:50.579506 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.576037 27951 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.603291 27951 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:50.604954 27899 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:50.605810 24066 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.606734 27899 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:50.608047 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.609954 27943 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:18:50.612277 24249 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:50.617503 27948 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.619045 27883 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:50.619982 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:50.620857 24066 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.622632 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:50.571396 27890 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.633615 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.635779 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.574602 27861 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:50.633925 24248 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:50.569479 27678 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:50.636451 24249 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:50.636994 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:50.638140 24066 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:50.645412 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:50.598824 27904 consensus_meta.cc:287] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.546s	user 0.009s	sys 0.000s
I20260709 12:18:50.648443 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:50.651913 24173 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:50.573035 27961 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:18:50.650432 27985 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:50.633628 27943 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:50.657797 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:50.665603 24101 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:50.666544 24096 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:50.675032 24095 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:50.686185 27952 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:18:50.654819 27678 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:50.725550 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 178279us
I20260709 12:18:50.661293 27904 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.729269 27884 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:18:50.735452 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 70178.5us
I20260709 12:18:50.681821 27775 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.740860 24098 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:50.747242 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:50.748708 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:50.749442 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:50.750180 24174 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:50.751561 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:50.752202 24176 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:18:50.766515 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:50.780447 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44158.5us
I20260709 12:18:50.727552 27950 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:50.771996 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:50.762696 27999 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:50.767967 27913 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.765754 27859 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:50.814106 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:50.850030 24174 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
W20260709 12:18:50.853071 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49215us
I20260709 12:18:50.819705 27895 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:50.908599 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.909298 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.909622 24244 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:50.862596 27890 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:50.917318 24244 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:18:50.815524 27999 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:50.910351 27904 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:50.897636 27969 consensus_queue.cc:1059] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
W20260709 12:18:50.912652 28003 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:18:50.911729 27889 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:50.910780 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:50.917196 24245 raft_consensus.cc:2368] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:18:50.922068 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:50.923933 24174 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:50.929030 24242 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:50.888374 27895 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:18:50.932832 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 103081us
W20260709 12:18:50.947902 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 93106.7us
I20260709 12:18:50.953151 24141 leader_election.cc:400] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:18:50.953603 24141 leader_election.cc:403] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:50.954864 24173 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:50.913906 27861 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:50.913925 27872 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:50.993785 27967 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:51.002799 27999 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.011734 27976 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:51.013190 27962 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:50.991552 27952 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:18:50.899200 27866 consensus_queue.cc:1059] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:18:51.017310 28002 log.cc:927] Time spent T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:18:50.956187 27889 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:51.020862 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 763954us
I20260709 12:18:51.026006 24176 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:50.955585 27950 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.057076 24215 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:51.058962 27938 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:51.060598 27938 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:51.048292 24168 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:51.075958 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:51.024788 27872 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:50.936368 27913 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.116s
W20260709 12:18:51.091933 28005 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.275s	user 0.002s	sys 0.002s
I20260709 12:18:51.123883 27872 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.087581 27987 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:51.137243 27948 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.139876 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:51.142926 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:51.143600 24096 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.144378 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:51.145056 24098 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:51.145984 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:51.146519 27939 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:51.147054 27939 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:51.148227 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:51.148094 27939 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.149646 27939 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:51.151582 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:51.152226 24101 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:51.154502 27976 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:51.082278 27859 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:18:51.157262 24093 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:18:51.083413 28012 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.163172 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.166900 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:51.169540 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:51.174652 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:51.177444 24096 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:51.038208 27967 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.176846 24247 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:18:51.204763 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:51.127475 27987 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.179474 27948 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:51.163301 24214 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:51.117499 27895 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.210960 27962 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:51.237406 27692 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:51.237509 27960 raft_consensus.cc:3055] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:18:51.238245 27960 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:51.238099 27692 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.241564 27692 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:51.259835 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 1913) took 1006 ms. Trace:
I20260709 12:18:51.260591 24250 rpcz_store.cc:276] 0709 12:18:50.252951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.254124 (+  1173us) service_pool.cc:224] Handling call
0709 12:18:50.261426 (+  7302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:50.573628 (+312202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:50.573723 (+    95us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:18:50.573789 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:18:50.573834 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:51.259445 (+685611us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b5400270454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:51.259505 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:51.259727 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717294848}
I20260709 12:18:51.263495 23997 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 7 to 6, leader changed from <none> to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 6 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:50.206296 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:51.195149 27976 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.350908 27976 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.351218 27953 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:51.351858 27953 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.353590 27967 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.354126 27953 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.360461 27987 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:51.234722 27890 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:51.235153 27962 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:51.393349 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 230150us
I20260709 12:18:51.420766 27794 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:51.390427 27861 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:51.432330 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:51.433314 24092 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 15.
I20260709 12:18:51.368975 27872 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:51.211839 28012 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.438243 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:51.427654 27794 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.429757 27981 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:51.346514 27960 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.462169 27960 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:51.467028 27889 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:51.467129 27955 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.469604 27955 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.470932 27986 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:51.471678 27986 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.476491 24100 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:51.477756 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:51.478569 24095 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:51.481040 24093 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:51.480717 27981 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.481305 27678 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:51.484793 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:51.485844 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:51.416021 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.399111 27962 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.436408 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:51.486796 24216 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:51.507741 27919 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:51.508136 27889 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:51.508513 27919 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:51.509008 27889 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:51.509173 27868 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:51.509687 27868 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:51.510186 27868 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:51.509704 27919 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.497473 28006 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:51.519500 28006 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.521840 28006 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.440079 27861 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.523516 27794 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:51.525362 27861 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.528434 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.426710 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:51.533211 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 106640us
I20260709 12:18:51.457154 28016 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:51.575327 28016 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:51.575791 28016 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:51.575891 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:51.576668 24169 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:18:51.547690 24173 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:51.554914 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.556737 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.579396 24214 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:51.510294 27889 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.583335 24214 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:51.564229 24101 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:51.557739 27678 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:51.571831 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.598286 28012 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:51.499027 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:51.602370 27913 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:51.573550 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.603916 27884 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:51.610489 27955 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.627192 27981 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.637945 27986 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.641613 24167 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:51.642069 27904 raft_consensus.cc:3055] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:51.649243 27945 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:18:51.692553 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 96680.3us
I20260709 12:18:51.651644 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.424840 24245 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:51.680408 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.653316 23997 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.704433 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:51.710139 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.710412 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.682518 27890 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:51.685140 27884 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:51.585855 27962 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.686350 27904 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:51.714136 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:51.720283 24244 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.104s	sys 0.110s
W20260709 12:18:51.718030 24780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.001s	sys 0.009s
W20260709 12:18:51.726022 24244 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.104s	sys 0.110s
W20260709 12:18:51.727483 24780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.001s	sys 0.009s
I20260709 12:18:51.737433 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.709980 27929 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:18:51.738894 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.739907 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:51.740355 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:51.711898 28017 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:51.744354 23997 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 8 to 9, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 9 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:51.745478 27895 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:51.747498 27904 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.748863 27904 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:51.749456 24811 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
W20260709 12:18:51.751384 24778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.053s	sys 0.152s
W20260709 12:18:51.751730 24778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.053s	sys 0.152s
I20260709 12:18:51.752951 24169 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:51.753539 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.726564 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:51.756585 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.757859 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.758569 24245 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:51.762651 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:51.763468 24813 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:51.767377 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:51.776046 27976 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:51.776751 27976 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.777462 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:51.778283 24807 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:51.707472 27945 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.781477 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:51.782045 27945 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:51.782171 24808 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:51.783607 27861 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:51.784049 27890 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:51.784482 27890 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:51.764737 27895 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:51.785420 27890 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.787792 27890 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:51.791898 27976 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.792490 27861 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:51.794476 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:51.797883 27861 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:51.800275 27861 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.785461 27895 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.805433 27895 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:51.807704 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49426us
I20260709 12:18:51.796581 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:51.820056 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:51.821637 27678 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:51.822374 27678 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.825347 27678 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:51.826583 24215 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:51.828152 24780 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:51.828336 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.829720 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.831825 27939 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:51.774300 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:51.832435 27939 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:18:51.833096 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 58914.3us
I20260709 12:18:51.833421 27945 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:51.833858 27879 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:18:51.834088 27945 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:51.834363 27879 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:51.834731 27945 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:51.838480 24141 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:51.839449 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.852154 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:51.834111 27861 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:18:51.858101 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:51.861194 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:51.834846 27879 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:51.869095 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:51.876652 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:51.848448 27962 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:51.893114 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:51.893539 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:51.859884 27948 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:51.903187 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:51.914884 24099 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:51.914740 24780 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:51.919457 24811 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:51.931085 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:51.934119 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:51.935544 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:51.944569 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 231013us
I20260709 12:18:51.946283 24214 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:51.953404 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.957296 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.958284 24168 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:51.961107 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.963400 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:51.965023 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50389.8us
I20260709 12:18:51.969748 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:51.970875 23994 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 210) took 18102 ms (client timeout 15000 ms). Trace:
I20260709 12:18:51.972272 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:51.963032 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45170.3us
I20260709 12:18:51.833523 27939 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:51.980729 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.982738 24175 raft_consensus.cc:2393] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:51.984709 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:51.978072 24780 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:51.991536 24141 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:51.923419 27948 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:51.967398 27985 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:51.962184 27984 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:51.973567 27952 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:51.984499 28021 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:18:51.977073 27865 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:51.972121 23994 rpcz_store.cc:269] 0709 12:18:33.828590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:33.838347 (+  9757us) service_pool.cc:224] Handling call
0709 12:18:51.930220 (+18091873us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:47.576012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:47.576652 (+   640us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:47.576688 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:18:47.576707 (+    19us) tablet.cc:662] Decoding operations
0709 12:18:47.679576 (+102869us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:47.679679 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:47.679706 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:18:47.680288 (+   582us) tablet.cc:701] Row locks acquired
0709 12:18:47.680309 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:18:47.680487 (+   178us) write_op.cc:270] Start()
0709 12:18:47.680620 (+   133us) write_op.cc:276] Timestamp: P: 1783599527680428 usec, L: 0
0709 12:18:47.680647 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:18:47.681473 (+   826us) log.cc:844] Serialized 2506 byte log entry
0709 12:18:47.737113 (+ 55640us) spinlock_profiling.cc:243] Waited 6.83 ms on lock 0x7b18002408e0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:47.976364 (+239251us) op_driver.cc:464] REPLICATION: finished
0709 12:18:48.125697 (+149333us) write_op.cc:301] APPLY: starting
0709 12:18:48.125808 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:48.126023 (+   215us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:48.126044 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:48.126858 (+   814us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:48.127097 (+   239us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:18:48.127144 (+    47us) write_op.cc:312] APPLY: finished
0709 12:18:48.127439 (+   295us) log.cc:844] Serialized 53 byte log entry
0709 12:18:48.127612 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:48.127759 (+   147us) write_op.cc:454] Released schema lock
0709 12:18:48.127804 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:48.139345 (+ 11541us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:48.139380 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32446,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":145551,"apply.run_cpu_time_us":2576,"apply.run_wall_time_us":13600,"num_ops":6,"prepare.queue_time_us":26314,"prepare.run_cpu_time_us":17645,"prepare.run_wall_time_us":152214,"raft.queue_time_us":202690,"raft.run_cpu_time_us":25485,"raft.run_wall_time_us":189735,"replication_time_us":284932,"spinlock_wait_cycles":15698176,"thread_start_us":240534,"threads_started":4,"wal-append.queue_time_us":46602,"wal-append.run_cpu_time_us":54627,"wal-append.run_wall_time_us":1412808}]]}
I20260709 12:18:52.031054 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:52.000309 27950 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:52.038112 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 205436us
I20260709 12:18:51.961985 27868 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:52.037350 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 53089.3us
I20260709 12:18:52.041319 24808 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:18:52.041676 24066 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:52.042457 24806 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15. Ops: [12.10-14.11]
W20260709 12:18:52.023819 27872 consensus_meta.cc:287] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.004s
I20260709 12:18:52.016355 27861 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:18:52.044516 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 107162us
I20260709 12:18:52.046286 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:52.062201 24066 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:52.085076 24247 raft_consensus.cc:2368] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11.
I20260709 12:18:52.062095 27896 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:52.066351 27985 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:52.111730 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:52.120357 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 118581us
I20260709 12:18:52.122350 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:52.124554 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:52.128013 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:52.030974 27952 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.129386 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:52.086486 27783 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:52.109740 28016 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.533s	user 0.010s	sys 0.004s
I20260709 12:18:52.042146 27889 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.077s
I20260709 12:18:52.110909 27896 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.120024 28009 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:52.182382 24814 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:18:52.145061 27899 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:52.188258 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 242061us
W20260709 12:18:52.178016 28025 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:18:52.186743 27896 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:52.174948 27861 raft_consensus.cc:697] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:52.109683 27948 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:52.230686 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 106223us
I20260709 12:18:52.240934 24067 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:52.241128 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:52.173691 28016 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.196110 27884 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.222023 28039 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:52.261300 28029 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:18:52.255703 27794 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:18:52.302014 24810 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:52.308719 24093 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
W20260709 12:18:52.308825 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67802.8us
W20260709 12:18:52.301981 28032 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:18:52.325939 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1388d59244114d37a482e6205f04c237"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:52.304702 27919 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:18:52.318282 28028 log.cc:927] Time spent T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:18:52.329860 24099 raft_consensus.cc:606] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:52.308259 28039 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:52.337114 24099 raft_consensus.cc:614] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:52.318001 27868 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:52.301479 27889 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:18:52.309144 28046 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:52.350188 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:52.351926 28041 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:18:52.335233 27981 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.357364 27884 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:52.361249 28047 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:18:52.370672 27879 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.410183 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
W20260709 12:18:52.364995 28031 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 12:18:52.346252 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 176752us
I20260709 12:18:52.345789 28048 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:52.409081 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 82886.9us
I20260709 12:18:52.410892 24099 raft_consensus.cc:606] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:52.417985 24099 raft_consensus.cc:614] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:52.418706 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:52.419389 24169 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:52.419634 24167 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:52.419658 24168 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
W20260709 12:18:52.421072 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 231841us
I20260709 12:18:52.409477 27952 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:52.402262 28053 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:52.443843 24169 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:52.440477 24214 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:52.435621 24141 leader_election.cc:400] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11.
I20260709 12:18:52.445489 24141 leader_election.cc:403] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:18:52.427212 27883 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:52.457736 28038 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:18:52.459406 28037 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260709 12:18:52.460212 27904 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.005s
I20260709 12:18:52.460716 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:52.462280 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:52.499293 24099 raft_consensus.cc:606] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:52.371886 27861 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:52.479732 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 52741.2us
I20260709 12:18:52.408998 27981 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:52.517180 24141 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.196:44187 timed out after 2.088s (SENT) [suppressed 27 similar messages]
I20260709 12:18:52.519222 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:52.490576 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 50214.9us
I20260709 12:18:52.514518 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:52.528146 28056 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:18:52.484400 27999 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11.
I20260709 12:18:52.488943 28049 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:52.479851 28053 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.545519 24101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:52.546535 24216 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:52.546657 24101 raft_consensus.cc:606] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:52.547794 24101 raft_consensus.cc:614] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:52.530998 28054 log.cc:927] Time spent T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:18:52.535475 27982 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:18:52.555846 24814 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15. Ops: [12.10-14.11]
I20260709 12:18:52.523913 27895 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:18:52.556591 28049 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.579234 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:52.556928 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:52.557627 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:52.539755 28016 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:52.556172 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:52.441910 28039 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.571321 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:52.589183 24092 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:52.542858 27678 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:52.575742 28053 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:52.576234 28066 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:52.580794 24099 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:52.561583 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:52.587296 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 70160.4us
I20260709 12:18:52.570691 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:52.582309 27945 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.746s	user 0.015s	sys 0.000s
I20260709 12:18:52.569301 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:52.568300 27884 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:52.611593 24101 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:18:52.613672 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:52.630232 24099 raft_consensus.cc:606] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:52.568575 27692 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:18:52.602942 28066 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:52.592592 27895 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:52.650035 28058 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.106s
I20260709 12:18:52.641233 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:52.645318 24092 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:52.616524 28053 raft_consensus.cc:476] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 12:18:52.649264 28043 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
I20260709 12:18:52.649513 28066 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.648029 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:52.575757 28062 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.110s
I20260709 12:18:52.641440 27919 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:52.668300 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:52.656162 27783 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:52.676693 27783 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.677824 28066 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:52.678602 27890 consensus_meta.cc:287] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.890s	user 0.014s	sys 0.000s
I20260709 12:18:52.631220 27884 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.679136 27919 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.681036 27884 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:52.615057 27945 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.682017 27919 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:52.656870 27923 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:52.682854 27923 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.683564 27945 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:52.684523 27981 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:52.588500 28049 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.683146 28059 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:52.688699 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 142237us
I20260709 12:18:52.692857 27923 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:52.651178 27895 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.656662 27879 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:52.699247 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:52.672642 28050 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:18:52.748116 28050 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:52.749372 28050 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.762429 27884 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:52.763178 27884 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.664400 27984 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:52.689870 27783 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:52.741457 28062 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:52.741335 27919 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:52.742952 23988 maintenance_manager.cc:419] P aa1cad1355eb4ec68d9dd23f0c34795d: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033394
W20260709 12:18:52.739929 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49097.5us
I20260709 12:18:52.745244 28049 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:52.689885 27986 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:52.703877 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:52.766634 24173 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:18:52.816952 27986 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:52.770680 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.687798 27999 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:52.785617 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:52.820899 24814 raft_consensus.cc:2376] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11. Re-sending same reply.
I20260709 12:18:52.823459 24141 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:52.823258 28017 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:52.824913 27999 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:52.781184 28059 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:52.825542 27999 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:52.826121 28059 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:52.795199 28069 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:18:52.826500 27999 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.836987 27884 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:52.840757 28042 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:18:52.841226 28042 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:52.790784 28062 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.783598 27984 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.857728 27984 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:52.842149 28042 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:52.859946 28042 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:18:52.861233 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:52.861591 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:52.863059 24169 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:52.863584 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:52.863955 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:52.866631 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:52.870903 27859 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:52.871556 27859 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.875244 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:52.877993 24244 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:52.862082 28043 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:52.882321 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:52.883240 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:52.884485 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:52.889056 24248 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:52.893923 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:52.887817 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:52.896713 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:52.901363 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:52.909106 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:52.916345 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:52.918218 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:52.906507 27955 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:52.886965 27896 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.005s
I20260709 12:18:52.924332 28035 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:52.920037 27955 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:52.888391 27986 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:52.928284 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:52.888587 28043 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:52.902623 28062 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:52.936208 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:52.936566 24098 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:52.933000 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:52.940721 24243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:52.953649 24243 raft_consensus.cc:606] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:52.954115 24243 raft_consensus.cc:614] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:52.955037 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 152628us
I20260709 12:18:52.951427 24216 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:52.952759 24095 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 6.
I20260709 12:18:52.964561 24214 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:52.933272 27955 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:53.022688 24100 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15. Ops: []
W20260709 12:18:53.024811 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60427.6us
W20260709 12:18:53.026021 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 74746us
I20260709 12:18:53.026154 24214 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:52.938274 27877 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:53.027101 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:53.067215 24214 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:53.070570 28059 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:53.019760 27861 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:53.071473 28059 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:52.932829 27896 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.035993 27889 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:53.065395 27868 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:53.076947 28035 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:53.034861 27913 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:18:53.088162 27890 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:53.064985 27877 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.035081 27678 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:53.077314 27794 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.765s	user 0.016s	sys 0.000s
I20260709 12:18:53.086742 27861 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:53.105602 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 149826us
I20260709 12:18:53.255828 27929 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.098904 28057 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:53.213919 28085 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:18:53.215528 28053 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:53.218042 27981 raft_consensus.cc:993] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:18:53.300056 27981 raft_consensus.cc:1081] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:18:53.212025 28035 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:53.301303 28035 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.302512 28053 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.304054 28035 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:53.304785 28053 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.306072 28059 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:53.268648 27794 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:53.299090 28057 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.292407 27929 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.309454 28057 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.309930 27929 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:53.298718 27861 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.253934 24141 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:53.325480 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 71665.1us
I20260709 12:18:53.090772 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:53.249936 27913 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:53.110136 28055 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:53.272961 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:53.328712 24814 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:53.273967 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.274394 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.275164 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:53.080330 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49148.4us
I20260709 12:18:53.283772 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.284137 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:53.285398 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.287197 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:53.276319 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.296294 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:53.298097 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:53.333598 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 46608.3us
I20260709 12:18:53.299073 27962 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:53.360235 24099 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:53.292364 27884 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:18:53.362869 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 278342us
I20260709 12:18:53.364234 24243 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 12:18:53.366971 24243 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:53.367599 24243 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.328557 27861 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:53.359141 27794 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:53.334729 27939 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:18:53.391376 27859 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.393678 27868 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:53.395859 27877 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:53.370411 27884 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.344848 27913 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.367604 27890 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:53.418208 24214 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:53.398869 28042 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.530s	user 0.011s	sys 0.002s
I20260709 12:18:53.416919 24243 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.359157 28055 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.422283 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:53.419572 27919 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:18:53.427982 28035 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:53.428184 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:53.428491 28035 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.419695 27868 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.428880 28035 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.430601 27868 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:53.431098 28057 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:53.431741 28057 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.432394 27884 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.433880 28057 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:53.428510 27913 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:53.436379 28055 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.418531 28043 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.437690 27884 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:53.437837 28043 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:53.438277 27884 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.440539 27884 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.444588 27948 raft_consensus.cc:3055] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:53.445106 27948 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:53.445945 27948 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.447220 27884 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:53.452832 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:53.453475 24810 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:53.455281 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:53.457659 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:53.458755 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:53.459333 24176 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:53.475760 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:53.480103 24215 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:53.485286 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:53.487332 24243 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:53.501943 24101 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.505592 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:53.478420 27948 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:18:53.486150 28080 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.308s	user 0.000s	sys 0.004s
I20260709 12:18:53.518246 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:53.523347 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.518930 24094 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:18:53.520248 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:53.525790 24810 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.479205 27868 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:53.520797 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.530660 24243 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:53.495648 28016 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.532673 24141 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:53.494450 28058 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:53.540247 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.498950 27884 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.541949 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.547113 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.484789 27939 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:18:53.549077 24092 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:53.550711 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.549634 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.554689 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.535804 27895 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:53.558492 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.560513 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.537894 27896 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:53.538657 28058 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:53.560236 27984 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.544811 28094 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:53.554881 27859 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:53.539417 27868 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.571149 28058 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:53.544668 28016 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.573916 28094 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:53.564342 28035 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.548252 27884 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.576970 27859 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.589236 27884 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.589929 27859 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.574396 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:53.562165 27895 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:53.573226 24168 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 5 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:53.582856 28094 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:53.573843 27984 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.596047 24243 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.578934 27868 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:53.601857 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:53.587145 27955 consensus_meta.cc:287] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.007s
I20260709 12:18:53.581348 28016 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:53.615481 24101 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:18:53.585282 28035 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:53.622579 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.604297 27895 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.623337 24245 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
W20260709 12:18:53.594223 28067 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 12:18:53.628816 24810 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:53.630376 24215 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:53.635794 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.642311 27984 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.645874 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:53.659745 24243 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:53.644217 28035 raft_consensus.cc:2804] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:53.660709 24245 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:53.624917 27955 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.666685 28035 raft_consensus.cc:697] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:53.675396 28035 consensus_queue.cc:237] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.679324 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2462) took 1125 ms. Trace:
I20260709 12:18:53.679778 24100 rpcz_store.cc:276] 0709 12:18:52.553432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.553597 (+   165us) service_pool.cc:224] Handling call
0709 12:18:52.554023 (+   426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:53.025395 (+471372us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:53.679060 (+653665us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540011b054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:53.679236 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1077200128}
I20260709 12:18:53.646878 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:18:53.723116 28067 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:18:53.724669 27919 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:53.750177 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.751899 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.752079 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.753345 24096 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:53.753417 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.755280 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:53.755838 24093 raft_consensus.cc:3055] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:53.756122 24093 raft_consensus.cc:740] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:53.752745 24099 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:53.759110 24100 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:53.760145 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.760943 24098 raft_consensus.cc:2393] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:53.760973 27919 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.725117 28043 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:53.762005 24093 consensus_queue.cc:260] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.762223 28043 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.763099 24093 raft_consensus.cc:3060] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:53.763587 27919 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:53.758096 27895 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.764482 28043 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:53.765193 24095 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:53.772277 24094 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:53.777565 24093 raft_consensus.cc:2468] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:53.779502 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.780110 24093 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:53.795993 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 2121) took 1379 ms. Trace:
I20260709 12:18:53.796499 24175 rpcz_store.cc:276] 0709 12:18:52.417040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:52.417165 (+   125us) service_pool.cc:224] Handling call
0709 12:18:52.417477 (+   312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:18:52.426825 (+  9348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:18:52.426860 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:18:52.444755 (+ 17895us) log.cc:844] Serialized 52 byte log entry
0709 12:18:52.495063 (+ 50308us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:18:52.513438 (+ 18375us) log.cc:844] Serialized 14 byte log entry
0709 12:18:52.515735 (+  2297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:52.515797 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:18:53.405409 (+889612us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b1800320020. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1
0709 12:18:53.419270 (+ 13861us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b1800320020. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:53.793431 (+374161us) raft_consensus.cc:1685] finished
0709 12:18:53.793458 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:18:53.795908 (+  2450us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18998,"prepare.queue_time_us":26176,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":15922,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":27341,"spinlock_wait_cycles":13147264,"thread_start_us":38227,"threads_started":1,"wal-append.queue_time_us":76072}
I20260709 12:18:53.801893 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:53.806505 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:53.807206 24093 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.778613 27961 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:18:53.814947 24093 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:18:53.827633 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.830726 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:53.811882 27895 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.832240 24214 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:53.853865 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.851948 24779 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:53.861434 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:53.854779 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:53.875335 24244 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:53.875335 27919 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:53.879432 27919 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.879839 27919 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:53.884649 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.887955 27955 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:53.875869 27872 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:18:53.889057 27872 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:53.889449 27872 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:53.890880 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:53.894184 24214 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:53.899226 27889 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:18:53.902407 28058 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:53.902844 27889 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:53.903062 27929 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:18:53.903484 27889 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:53.903976 27889 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:53.904141 28035 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:53.904629 28035 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:53.912278 28058 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:53.913235 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:53.913524 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:53.916193 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:53.899436 28053 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:53.902740 24214 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:53.935411 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:53.945475 24811 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:18:53.945636 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:53.947746 24812 raft_consensus.cc:1240] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:53.951408 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:53.952841 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:53.954044 24807 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:53.957026 28014 raft_consensus.cc:3055] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:53.957509 28014 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:53.962568 28087 raft_consensus.cc:993] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:53.963225 28087 raft_consensus.cc:1081] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:53.899613 27692 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:53.968896 27692 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:53.969410 27692 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:53.969059 28035 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.970644 28035 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:53.975356 28043 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:53.829605 28094 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:53.987495 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:54.008948 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:54.013212 24170 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:54.013046 24810 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:54.015336 24215 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:54.017158 24168 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:54.017230 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:54.018472 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.016728 24170 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:53.958619 28014 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.011549 28043 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:54.018069 28042 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:54.031222 28042 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:54.045288 28043 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.046440 28042 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.048718 28094 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:54.115259 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:54.117026 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.121800 24094 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:18:54.123749 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:54.125387 24097 raft_consensus.cc:2393] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:54.139796 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:54.022830 24169 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:54.141615 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:54.158064 27749 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:54.159344 27749 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.158164 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:54.172413 27896 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:54.118968 24066 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:54.162948 27749 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:54.165648 27783 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:54.166172 27793 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:54.192262 28014 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:54.192574 27793 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.188002 27896 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.206171 27896 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:54.207351 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.211004 27945 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:54.212001 27945 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.215514 28058 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.216647 28058 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.222946 27868 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:54.172145 27895 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:54.227916 27895 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.236487 28058 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:54.238596 27783 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:54.249207 24810 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:54.259713 27793 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:54.234642 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 115952us
I20260709 12:18:54.268079 27945 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:54.284799 24140 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:54.287813 27984 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:54.288496 27859 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:54.292454 27895 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:54.309911 27889 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:54.292469 23997 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 101) took 20201 ms (client timeout 15000 ms). Trace:
I20260709 12:18:54.313462 27884 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:54.327716 27884 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.315522 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:54.331494 24810 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:18:54.319303 23996 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 7, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 7 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:54.330894 27884 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:54.289376 27984 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:54.349536 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 65628.4us
I20260709 12:18:54.352129 27913 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:54.359946 27913 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:54.356410 24215 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:54.356029 27692 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.357139 27945 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:18:54.332410 23997 rpcz_store.cc:269] 0709 12:18:34.091337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:34.091603 (+   266us) service_pool.cc:224] Handling call
0709 12:18:54.292118 (+20200515us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:52.175052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:52.323066 (+148014us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:52.327201 (+  4135us) write_op.cc:435] Acquired schema lock
0709 12:18:52.328646 (+  1445us) tablet.cc:662] Decoding operations
0709 12:18:52.441779 (+113133us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:52.443462 (+  1683us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:52.444796 (+  1334us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:18:52.532751 (+ 87955us) tablet.cc:701] Row locks acquired
0709 12:18:52.532784 (+    33us) write_op.cc:260] PREPARE: finished
0709 12:18:52.532946 (+   162us) write_op.cc:270] Start()
0709 12:18:52.533082 (+   136us) write_op.cc:276] Timestamp: P: 1783599532532895 usec, L: 0
0709 12:18:52.533106 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:18:52.533818 (+   712us) log.cc:844] Serialized 1365 byte log entry
0709 12:18:53.153611 (+619793us) op_driver.cc:464] REPLICATION: finished
0709 12:18:53.391887 (+238276us) write_op.cc:301] APPLY: starting
0709 12:18:53.391999 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:53.392516 (+   517us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:53.392633 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:53.393026 (+   393us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:53.393233 (+   207us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:18:53.393280 (+    47us) write_op.cc:312] APPLY: finished
0709 12:18:53.393531 (+   251us) log.cc:844] Serialized 35 byte log entry
0709 12:18:53.393725 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.393854 (+   129us) write_op.cc:454] Released schema lock
0709 12:18:53.393903 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:53.394333 (+   430us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:53.394365 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2700861,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":229561,"apply.run_cpu_time_us":2454,"apply.run_wall_time_us":2462,"num_ops":3,"prepare.queue_time_us":370596,"prepare.run_cpu_time_us":17754,"prepare.run_wall_time_us":455756,"raft.queue_time_us":326867,"raft.run_cpu_time_us":64590,"raft.run_wall_time_us":273449,"replication_time_us":572529,"thread_start_us":644714,"threads_started":4,"wal-append.queue_time_us":123696}]]}
I20260709 12:18:54.358240 27877 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:54.345932 23996 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 9, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 9 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.366576 27859 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:54.366236 27877 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.367497 27859 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.360508 27913 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:54.373497 27945 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:54.374122 27945 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.374564 27945 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:18:54.375090 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 116637us
I20260709 12:18:54.375699 27913 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.377805 27913 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:54.364904 27889 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:54.381250 27919 consensus_meta.cc:287] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.011s
I20260709 12:18:54.374480 28094 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:54.381888 27919 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.382875 28094 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.383810 24244 raft_consensus.cc:2368] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:54.384783 27919 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:54.385686 28094 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:54.395609 24247 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:54.397791 27692 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:54.398880 24141 leader_election.cc:400] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:54.399268 24141 leader_election.cc:403] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:18:54.370941 27859 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:54.402419 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:54.393090 23996 catalog_manager.cc:5697] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 10, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 10 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:54.380832 27877 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:54.413221 27877 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:54.413625 28052 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:54.413856 27877 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.414486 27877 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.421291 23996 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:54.423753 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:54.413290 28053 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:18:54.435004 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:54.436460 28053 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:54.462252 24140 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:54.464941 27889 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.465862 27889 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.469990 27865 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.453452 23996 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:54.470764 27889 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:54.481530 27859 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:54.483215 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:54.486693 27984 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:54.519133 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.486775 23996 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 8, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.532651 28113 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:54.533231 28113 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:54.534202 28113 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.535878 24810 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:18:54.542654 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.543488 24098 raft_consensus.cc:1275] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:18:54.543443 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:54.545400 27889 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 12:18:54.549592 27872 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.592s	user 0.008s	sys 0.013s
I20260709 12:18:54.550328 27872 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.549536 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:54.551465 24099 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.493737 27865 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.555711 28113 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.561189 24806 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
W20260709 12:18:54.563607 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.577009 24099 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
W20260709 12:18:54.579280 28035 consensus_meta.cc:287] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.582s	user 0.011s	sys 0.008s
I20260709 12:18:54.588299 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:54.589119 24095 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:54.597620 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:54.599998 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:54.603540 28113 consensus_queue.cc:1059] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:54.604708 28050 raft_consensus.cc:3055] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:54.605255 28050 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:54.606617 28050 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.609942 28050 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:18:54.618197 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:18:54.623261 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44951.8us
I20260709 12:18:54.580209 23996 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 9 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:54.625891 28052 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
W20260709 12:18:54.629711 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 167655us
I20260709 12:18:54.636130 27865 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:54.636363 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:54.581513 27945 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.649284 23996 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:54.659147 24094 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:18:54.661952 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:54.665110 24099 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:18:54.663411 27872 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:54.674712 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:54.677024 23996 catalog_manager.cc:5697] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 8, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.664125 27913 consensus_queue.cc:1048] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:18:54.679679 27896 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:54.696055 24095 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:54.693388 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:54.692849 23996 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 9, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 9 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:54.693792 28052 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:54.690272 27877 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.708658 27945 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:54.720193 23996 catalog_manager.cc:5697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 8, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 8 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:54.722209 24101 raft_consensus.cc:2368] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:18:54.719652 24214 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:54.701120 27896 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:54.724419 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70291.3us
I20260709 12:18:54.718900 27868 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:18:54.713410 27692 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:18:54.729218 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:54.733043 27890 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:54.734584 23996 catalog_manager.cc:5697] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:54.737484 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:54.741010 24806 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:54.740092 28058 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:54.743584 24098 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:18:54.745751 27877 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:54.747179 27865 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:54.747893 27865 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.748217 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:54.748996 24099 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:54.751471 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:54.751858 24140 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:54.752199 24169 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:54.756537 28113 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:54.756633 28094 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:54.757949 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:54.758061 28113 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.758816 24247 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:54.760111 24067 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:54.761652 24781 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:54.763504 28058 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:54.769907 28058 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:54.774289 28117 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:18:54.774847 27984 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:54.775493 27872 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:54.775929 27872 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:54.776311 27872 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.779605 27896 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:54.756865 27865 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:54.783141 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:54.785425 24094 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:54.785490 28035 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:54.786161 28035 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.788096 24094 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:54.788445 28035 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:54.789974 28035 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:54.791395 28035 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.796571 28035 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:54.797066 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:54.797236 28113 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:54.797784 24247 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:54.800736 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:54.804828 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:54.805879 28113 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:54.806301 28113 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:54.806682 28113 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.813078 24214 leader_election.cc:400] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:18:54.813450 24214 leader_election.cc:403] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:18:54.815586 24247 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:18:54.816041 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:54.757004 23996 catalog_manager.cc:5697] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 10, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 10 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:54.817966 24098 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:54.755576 27890 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:54.824427 23996 catalog_manager.cc:5697] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:54.826323 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:54.833693 24806 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:18:54.823700 28035 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:54.836247 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:54.838552 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:54.838769 27889 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:54.823917 27913 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:54.843611 27890 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.879717 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:54.876879 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:54.882822 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:54.883565 24243 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:18:54.877234 27889 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.877926 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:54.884835 24814 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 16: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:54.878401 24247 raft_consensus.cc:2410] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:18:54.878958 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:54.885882 27889 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:18:54.887302 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.891392 24098 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
W20260709 12:18:54.894065 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 79330.1us
I20260709 12:18:54.894328 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:54.904028 24215 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:54.905128 27945 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:54.905529 28045 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:54.905723 27945 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:54.906452 28045 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:54.907586 28045 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.911218 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:54.912941 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:54.913602 24170 raft_consensus.cc:2410] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:18:54.914088 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:54.924309 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:54.920732 23996 catalog_manager.cc:5697] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 8, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:18:54.947973 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:54.949117 24094 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:54.959740 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:54.834393 27872 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:54.974942 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:54.961885 23996 catalog_manager.cc:5697] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 7, term changed from 7 to 9, VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added, no longer has a pending config: VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193), VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194), VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195), NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 9 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:55.007735 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:54.966596 28052 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.017058 27890 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:55.025297 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:55.009614 28094 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:55.034528 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 76673.5us
I20260709 12:18:55.036505 23996 catalog_manager.cc:5697] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 3 to 5, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 5 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.013362 27884 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:18:55.042011 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 80140.5us
I20260709 12:18:55.041029 23996 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.018442 27859 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.061153 23996 catalog_manager.cc:5697] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 8, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.069461 23996 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:55.072643 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.074646 24066 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:55.079995 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 43744.4us
I20260709 12:18:55.087549 28115 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.088411 28115 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.088977 27859 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.091380 27859 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.092008 27859 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.092671 27859 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.102535 27945 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:55.034011 28094 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.104322 23996 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.047469 28052 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:55.123591 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.110741 23996 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:55.108948 28115 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.130946 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:55.132808 27872 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.140972 28052 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.142725 28094 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.133038 27868 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 12:18:55.126832 27923 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:55.147468 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 77330.6us
I20260709 12:18:55.148727 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:55.154664 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.161469 24093 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:55.161772 27984 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:55.161494 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:55.162950 27984 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:55.165057 24066 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:55.174885 27884 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:55.126279 23996 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 15, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 15 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:55.177158 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.180312 23996 catalog_manager.cc:5697] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 8, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 8 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:55.183557 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.185758 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:55.186642 27919 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.186859 24095 raft_consensus.cc:2368] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
I20260709 12:18:55.187283 27919 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.188593 28134 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.189541 28134 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.189881 27919 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:55.094915 27859 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.194541 28134 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.195197 28134 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.182122 23996 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 10, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 10 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:55.197402 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:55.199847 28131 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.200460 28131 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.201750 24099 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:18:55.202881 28131 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.197912 28113 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.212932 28131 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.207607 27945 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:18:55.206138 28035 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:18:55.214391 28131 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.213392 28094 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.195758 28134 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.216207 28094 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.211582 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:55.205817 24066 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:55.210474 24170 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:55.225143 28131 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.226006 27984 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:55.226449 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:55.228171 24781 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:55.221148 23996 catalog_manager.cc:5697] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 4 to 9, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 9 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:18:55.232641 24246 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:55.206595 27859 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:55.229102 28127 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:55.236182 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.237800 24810 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:18:55.238812 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.235177 23996 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:18:55.240167 24170 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:55.244282 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:55.245020 28052 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:55.242130 27859 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.234589 27919 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:55.250211 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 44501.4us
I20260709 12:18:55.245728 28094 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.257302 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:55.243360 28127 raft_consensus.cc:697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:55.259202 28127 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:55.261601 24093 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:55.263792 28035 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:55.264232 24169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:55.265415 24169 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:55.265865 24169 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.271979 27859 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.236413 28131 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.277865 24810 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16. Ops: [12.10-15.12]
I20260709 12:18:55.280682 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.289526 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:55.246129 28134 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.295449 28035 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:55.297288 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 246390us
I20260709 12:18:55.300060 28113 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.301313 28131 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.303802 28131 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.311949 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.312547 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.313447 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:55.313709 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.314353 24241 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:18:55.315558 24779 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:55.316026 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.319638 24169 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.326581 28015 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:18:55.327273 28015 raft_consensus.cc:697] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:55.328826 24169 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:55.329243 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52410.3us
I20260709 12:18:55.333079 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:55.335325 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.337443 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:55.339847 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.340237 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.341501 24243 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:18:55.344175 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.332921 28130 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:55.350000 28130 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:55.350534 28130 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:55.331522 27896 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:18:55.350910 27923 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:18:55.351398 27923 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:55.351459 27896 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:18:55.351886 27923 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:55.355863 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.338428 27984 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:55.356624 24176 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:55.328449 28015 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:55.351907 27896 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:55.360273 27896 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:55.361539 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.368849 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.369801 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:55.370416 24246 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.371253 24094 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:55.375775 27945 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:55.376252 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.377957 24806 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:18:55.379004 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.379666 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:55.380436 24247 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:55.380450 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:55.387771 24241 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:55.388545 28035 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:55.396435 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:55.397905 28131 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:55.398434 28131 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:55.398893 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.398921 28131 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:55.400509 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:55.401278 24173 raft_consensus.cc:2368] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:18:55.402537 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:55.402945 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:55.403718 24170 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:55.399482 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.422019 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:55.427999 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.435767 24171 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:18:55.436424 24171 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:55.441161 24246 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:55.442380 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.448807 24171 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.456789 24171 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:18:55.464716 24174 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:55.436309 28113 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:55.474705 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.475548 24173 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:55.475394 28113 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:55.478521 28113 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:55.479161 28052 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:55.440336 27896 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:18:55.483250 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.490252 28115 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:55.495128 27945 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.495481 28115 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.495707 27945 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.497781 28115 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.500488 28050 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:55.501258 28050 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.502379 24171 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:18:55.502796 24171 pending_rounds.cc:85] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 4
I20260709 12:18:55.494371 28131 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.512176 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:55.515666 24171 pending_rounds.cc:107] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:18:55.490396 27859 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:55.521438 27859 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.471781 28128 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.519170 24171 raft_consensus.cc:2889] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:55.519254 24099 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:18:55.520828 28094 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:55.482236 28134 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:55.527451 24141 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:18:55.533900 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.534366 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:55.539037 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.541703 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.544369 24246 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 11: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:55.555622 24176 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:55.479846 28052 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.560868 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.565464 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:55.576881 27919 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:18:55.577360 27919 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:55.577761 27919 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:55.584714 28135 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:18:55.555984 28113 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:55.538782 28128 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:55.614719 24810 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:18:55.562076 28134 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.563170 28094 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.698174 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:55.760769 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.880102 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:55.798204 24168 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:55.799191 24167 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:18:55.864776 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:55.830471 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.797477 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.843282 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:55.756426 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 418996us
I20260709 12:18:55.805403 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:55.700549 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.799670 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:55.901796 24172 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:55.844157 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:55.909703 24097 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:55.673341 27859 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.754000 28050 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.789942 28131 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.888542 27913 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.824817 28145 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:55.700886 27945 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:55.919559 28035 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:55.768131 28128 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:55.980218 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:55.750003 27923 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:55.996132 28052 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.985891 27913 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.999085 28145 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:55.754757 28130 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:56.001418 28145 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:56.001765 28130 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:56.003115 28094 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:55.938522 28113 raft_consensus.cc:697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:55.998886 27913 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:55.967909 27872 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:55.994678 28132 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
W20260709 12:18:56.020403 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 106362us
I20260709 12:18:56.021749 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:55.998687 27919 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:56.016604 24140 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:56.019547 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 92766us
I20260709 12:18:56.015040 24216 leader_election.cc:400] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:18:56.038211 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:56.039921 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:56.011226 28035 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:56.034394 28134 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:56.056914 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:56.065369 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:56.051368 27913 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:56.024983 27872 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:56.069576 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:56.074430 27919 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:56.078181 28035 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:56.078743 24241 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:18:56.079181 28042 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:56.079587 28113 consensus_queue.cc:237] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:56.053057 28155 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:56.081332 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:56.084061 27923 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:56.071744 27945 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:56.067859 27896 consensus_meta.cc:287] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.005s
W20260709 12:18:56.088666 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 79657.3us
I20260709 12:18:56.108738 24095 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:18:56.109174 24095 pending_rounds.cc:85] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 11
W20260709 12:18:56.088827 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:56.095502 24810 raft_consensus.cc:2410] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:56.084741 28152 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:56.121649 28152 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:56.109419 24095 pending_rounds.cc:107] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:18:56.100828 28035 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:56.094480 28042 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:56.132118 28156 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:18:56.137660 28152 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:56.119486 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55114.6us
I20260709 12:18:56.118863 27872 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:56.228470 28157 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:18:56.629760 28155 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:56.788946 28155 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:56.791584 28155 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:56.658118 28166 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:56.678128 28052 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:56.792346 28166 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:56.691829 28042 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:56.797395 24067 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:56.798352 28167 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:56.699211 27865 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:56.697082 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:56.891577 27872 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:56.892344 27872 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:56.667657 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.897696 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.898547 24092 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 11: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:56.666224 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.901026 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.902180 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.661172 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.670236 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.669993 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.906519 24099 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:18:56.132725 24140 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:57.070485 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 937805us
I20260709 12:18:57.071523 24140 leader_election.cc:400] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9.
W20260709 12:18:56.298507 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.006s	sys 0.004s
I20260709 12:18:56.669261 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.651237 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.297438 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1876) took 1405 ms. Trace:
I20260709 12:18:57.297889 24100 rpcz_store.cc:276] 0709 12:18:55.892327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:56.650792 (+758465us) service_pool.cc:224] Handling call
0709 12:18:57.297364 (+646572us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:18:56.357528 24167 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:18:56.358734 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:56.310858 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.305913 24176 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:18:56.359526 24172 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:18:57.307415 24172 pending_rounds.cc:85] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 7
I20260709 12:18:57.307703 24172 pending_rounds.cc:107] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:18:57.307940 24172 raft_consensus.cc:2889] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:18:56.101213 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 336669us
W20260709 12:18:56.227741 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 107209us
I20260709 12:18:56.686883 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:57.319445 24101 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:18:56.690945 24095 raft_consensus.cc:2889] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:18:56.809137 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:57.322916 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 513846us
I20260709 12:18:57.323769 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:56.908592 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:56.918517 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.020s	sys 0.009s
I20260709 12:18:56.918967 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:56.926890 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:56.997705 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:57.007941 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:57.020946 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.025892 28177 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:56.799310 27865 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:56.819463 27868 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:57.328176 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.328966 24100 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:57.328701 27868 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.329559 27865 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.330329 24097 raft_consensus.cc:3055] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:57.330675 24097 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:57.331210 27868 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.331952 28188 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:56.817265 28052 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:57.333168 28052 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.333786 24094 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 11: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:18:57.335634 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.241s	user 0.021s	sys 0.009s
W20260709 12:18:57.336024 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 1.24129e+06us
I20260709 12:18:57.336550 28052 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:56.859974 27984 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.085350 28180 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.337885 27984 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.085979 28179 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.076349 28150 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:57.340235 27984 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:56.979054 28157 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:57.341637 24093 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:18:57.342101 28157 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:56.795295 28166 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.324988 28183 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:56.817402 28156 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:57.346251 28156 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.346956 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:57.347599 24094 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:18:57.104565 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:56.921933 28167 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.348559 28156 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.349709 28167 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.351198 28157 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.352022 28167 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.156512 28182 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.352850 28182 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.353905 27865 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:57.159257 28181 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.355336 28181 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.357733 28181 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.182614 28035 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:56.998567 28170 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.358752 28035 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.359462 28170 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.361006 28035 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.361582 28035 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:57.361785 28170 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.195178 23987 maintenance_manager.cc:643] P aa1cad1355eb4ec68d9dd23f0c34795d: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.323s	user 0.232s	sys 0.021s Metrics: {"bytes_written":30840,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":9411,"dirs.run_cpu_time_us":430,"dirs.run_wall_time_us":15754,"drs_written":1,"lbm_read_time_us":402,"lbm_reads_lt_1ms":4,"lbm_write_time_us":33162,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":32,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":9670,"threads_started":1,"update_count":30}
I20260709 12:18:57.362111 28035 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.364919 28035 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.365477 23988 maintenance_manager.cc:419] P aa1cad1355eb4ec68d9dd23f0c34795d: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 8994 bytes on disk
I20260709 12:18:57.367055 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.368717 23987 maintenance_manager.cc:643] P aa1cad1355eb4ec68d9dd23f0c34795d: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":361,"lbm_reads_lt_1ms":4}
W20260709 12:18:57.229964 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.548s	user 0.012s	sys 0.004s
I20260709 12:18:57.370234 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.371539 28182 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:57.374758 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 51088.5us
I20260709 12:18:57.292068 28043 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:57.375808 24806 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:57.375624 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.375562 28043 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.378065 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:57.378166 28043 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.306751 28184 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:57.379333 28184 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.382340 28184 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.324319 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2556) took 1814 ms. Trace:
I20260709 12:18:57.382843 24095 rpcz_store.cc:276] 0709 12:18:55.509765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:55.511081 (+  1316us) service_pool.cc:224] Handling call
0709 12:18:55.511373 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:18:57.322421 (+1811048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:18:57.323981 (+  1560us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540011b054. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:18:57.324151 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1372144896}
I20260709 12:18:57.331593 24097 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.384709 28181 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:57.385111 24097 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:57.385255 28181 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.385951 28181 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:56.911836 27872 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:56.806551 28042 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.389631 28182 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:57.337986 28180 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.078768 24140 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.342684 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.343392 28177 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.390941 28042 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:57.393461 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 314832us
I20260709 12:18:57.396142 28042 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:57.396811 28177 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.396660 28042 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.338891 28179 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.397401 24140 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.399019 28179 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.399188 28150 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:56.816579 28155 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:57.400028 28150 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:57.400465 28155 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.395228 24093 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:57.398726 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.402689 28155 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.348999 24092 raft_consensus.cc:606] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:57.409649 28155 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:57.410400 28155 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.269529 27945 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:57.412218 27945 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.413944 28155 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.404029 28152 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:57.392786 28180 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.391491 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.378885 28043 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:57.418012 28180 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:57.417958 28043 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.366235 28035 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.419440 28035 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.420436 28043 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.421376 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:57.392309 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.348526 28159 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:18:57.423097 28180 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:57.429031 28180 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.429699 28180 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.414420 27945 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.403472 24140 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.431962 28152 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:57.432143 28180 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.433163 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.434623 28156 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:57.436146 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 117413us
I20260709 12:18:57.430786 28035 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.398804 28042 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.441169 24094 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:18:57.444341 28156 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:18:57.445139 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 108502us
I20260709 12:18:57.445533 28150 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:57.445972 28150 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:57.445968 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:57.447186 27984 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:57.447741 27984 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:57.447377 28150 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.434748 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.448768 27984 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.450263 24140 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.450392 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:57.451339 24806 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 16: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:57.451207 28052 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:57.452353 28052 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:57.454547 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.458005 28150 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:57.463006 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:57.464754 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 89088.6us
I20260709 12:18:57.469162 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.470062 24806 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:57.470855 28181 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.472913 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.474359 27984 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:57.475251 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:18:57.475770 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.474944 27984 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.478408 27984 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:57.480068 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 111411us
I20260709 12:18:57.481216 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.489466 27984 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.490195 27984 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:57.491245 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 51858.1us
I20260709 12:18:57.491804 28179 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:18:57.492641 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 196859us
I20260709 12:18:57.492502 28179 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.494915 28179 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.494879 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.495566 28179 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.495683 24094 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:18:57.496377 28179 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.498519 28179 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.499141 28159 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.501475 28159 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.503262 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:57.503935 24094 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:57.504657 28159 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.491430 28180 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:57.500591 28184 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:57.506071 28180 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.506204 28184 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.500699 28177 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.508364 28180 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.500026 27984 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.505409 28182 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.508450 28177 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.509531 28182 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.511657 28184 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.511710 28182 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.512310 28177 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.513729 28181 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.491900 28189 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:57.514194 24092 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:18:57.514611 28189 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.515311 24094 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:18:57.517056 28189 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.517210 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.517894 24092 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 16.
I20260709 12:18:57.523439 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.524221 24099 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:18:57.525902 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 193) took 9242 ms. Trace:
W20260709 12:18:57.526556 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 112229us
I20260709 12:18:57.527669 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.532065 24097 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:57.532646 24099 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:18:57.529284 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.533908 24094 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:18:57.534029 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.530104 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:57.540643 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48212.5us
I20260709 12:18:57.541818 24780 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:57.542709 28159 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:57.543155 28159 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.543531 28159 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:57.544662 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.529785 23999 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:18:57.549811 27872 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:57.550727 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.551241 28152 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:57.550009 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.552367 24810 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
W20260709 12:18:57.552383 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 97904us
I20260709 12:18:57.553586 24140 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:57.552551 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 86829.7us
I20260709 12:18:57.531212 23996 rpcz_store.cc:276] 0709 12:18:48.392186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:48.402706 (+ 10520us) service_pool.cc:224] Handling call
0709 12:18:57.525798 (+9123092us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:55.591655 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:55.808273 (+216618us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:55.860019 (+ 51746us) write_op.cc:435] Acquired schema lock
0709 12:18:55.862237 (+  2218us) tablet.cc:662] Decoding operations
0709 12:18:55.978688 (+116451us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:55.978803 (+   115us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:55.978832 (+    29us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:18:56.118027 (+139195us) tablet.cc:701] Row locks acquired
0709 12:18:56.118095 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:18:56.118321 (+   226us) write_op.cc:270] Start()
0709 12:18:56.118471 (+   150us) write_op.cc:276] Timestamp: P: 1783599536118246 usec, L: 0
0709 12:18:56.118500 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:18:56.121087 (+  2587us) log.cc:844] Serialized 10726 byte log entry
0709 12:18:56.436960 (+315873us) op_driver.cc:464] REPLICATION: finished
0709 12:18:56.579710 (+142750us) write_op.cc:301] APPLY: starting
0709 12:18:56.579859 (+   149us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:56.581782 (+  1923us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:56.582037 (+   255us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:56.590647 (+  8610us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:56.601346 (+ 10699us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=54
0709 12:18:56.602136 (+   790us) write_op.cc:312] APPLY: finished
0709 12:18:56.626231 (+ 24095us) log.cc:844] Serialized 182 byte log entry
0709 12:18:56.633458 (+  7227us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:56.633764 (+   306us) write_op.cc:454] Released schema lock
0709 12:18:56.633862 (+    98us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:56.634397 (+   535us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:56.634428 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":68753,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":39164,"apply.run_cpu_time_us":8496,"apply.run_wall_time_us":54670,"num_ops":27,"prepare.queue_time_us":67043,"prepare.run_cpu_time_us":78334,"prepare.run_wall_time_us":750270,"raft.queue_time_us":47493,"raft.run_cpu_time_us":5775,"raft.run_wall_time_us":207024,"replication_time_us":253480,"spinlock_wait_cycles":1280,"thread_start_us":284271,"threads_started":4,"wal-append.queue_time_us":194369}]]}
I20260709 12:18:57.556948 28150 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.557603 28150 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.559660 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:57.561278 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:57.564363 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.559206 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.566468 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:18:57.569454 28052 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:57.571568 28052 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.572079 28052 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:57.565433 28152 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:57.570659 24141 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.566279 28133 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:57.566489 27872 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:57.569651 28177 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:18:57.591527 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49786.5us
I20260709 12:18:57.568743 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.582175 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:57.600528 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:57.596930 24067 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.721s (SENT)
I20260709 12:18:57.579725 28156 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:57.620895 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.594610 27872 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.599116 28177 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.598837 28133 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:57.604447 28152 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:57.641553 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.642302 28152 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:57.643275 28185 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:57.645627 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:57.647178 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 166385us
I20260709 12:18:57.647691 28133 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.639246 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.639178 28190 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:57.639535 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.672904 24243 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:18:57.639725 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:57.643350 28150 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:57.638548 28186 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:57.658634 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:57.637045 28177 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:57.631299 27872 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:57.667435 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.670792 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:57.644132 28185 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.693792 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:57.681105 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 80737.7us
I20260709 12:18:57.681877 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:57.681918 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 119639us
I20260709 12:18:57.695204 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:57.684154 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.698868 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.701238 24140 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.674515 28156 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:57.710300 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:57.712244 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.716439 28204 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:57.716698 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.718231 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.719141 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.720238 24249 raft_consensus.cc:2368] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13.
I20260709 12:18:57.677078 28190 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.725982 28190 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.716459 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.681843 28186 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:57.737972 28185 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:57.738626 28186 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:57.738938 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.712930 28150 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:57.742228 24243 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:57.750283 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:57.750555 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:57.763424 24172 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:57.763545 24171 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:57.758033 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.763922 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.762071 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.763572 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.766721 24174 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:57.718799 28195 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:57.768959 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.770527 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.697165 28157 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:57.769783 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.769764 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.775297 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.786418 24167 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:18:57.790856 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.805542 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:57.792497 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 144003us
I20260709 12:18:57.806387 24173 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:57.807451 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:57.808017 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.809489 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:57.810593 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.811196 24245 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:57.793148 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.811331 28157 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.794708 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.812420 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:57.812489 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.808012 24173 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:57.835350 24167 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:57.813666 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.816020 24175 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:57.805789 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.825660 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:57.835975 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.781384 28195 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:57.839366 28195 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:57.840822 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.841969 24170 raft_consensus.cc:2410] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:18:57.842926 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.844223 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.793814 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.847357 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.876845 24170 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:57.849329 24171 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:57.849732 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.767446 28152 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:57.851567 24176 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:57.852083 24250 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:18:57.853945 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.852097 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.856665 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.863958 24098 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:18:57.882181 24168 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:57.870829 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.875623 24245 raft_consensus.cc:1240] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:57.880695 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.888527 24171 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:57.878458 27868 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:57.891147 27868 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:18:57.891517 27868 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:57.892287 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.892959 24175 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:57.894572 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.895285 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.838260 24169 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:18:57.900906 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.875916 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:57.903496 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 50952.8us
I20260709 12:18:57.879639 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:57.880193 24099 raft_consensus.cc:2368] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13.
I20260709 12:18:57.904443 24248 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:57.908659 24101 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:57.910663 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.911406 24174 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:57.916882 28035 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:57.917461 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:57.919329 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:57.919504 27945 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:18:57.920665 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45933.5us
I20260709 12:18:57.922092 24099 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:57.923664 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.880686 28152 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:57.932566 24172 raft_consensus.cc:2410] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 12 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:18:57.933149 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.945441 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:57.946605 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49009.1us
I20260709 12:18:57.935380 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.949998 24247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:18:57.950870 24247 raft_consensus.cc:606] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:57.951435 24247 raft_consensus.cc:614] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:18:57.946602 24096 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:18:57.955783 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.956521 24098 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:18:57.960772 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.965219 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.966087 24093 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:57.964548 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.939473 28035 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:57.984730 24101 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:57.953039 28152 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:57.898327 28159 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:57.957011 27945 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:58.030241 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:58.032418 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:57.979358 28187 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:18:58.068013 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 372912us
I20260709 12:18:58.068954 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:58.000626 28035 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.089759 24214 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:58.052681 28187 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.100600 28185 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:58.101106 28185 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:58.101326 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:58.101588 28185 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:58.101776 28211 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:18:58.102228 28035 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.099702 28209 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:58.103802 28209 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:58.104336 28209 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:58.087369 28042 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:18:58.108908 28042 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:58.109280 28042 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:58.113691 28052 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
I20260709 12:18:58.098367 27945 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.114257 28052 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.115547 28157 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:58.110265 28042 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.122977 24214 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:58.130388 28156 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:18:58.131757 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.019s	sys 0.006s
W20260709 12:18:58.132128 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.019s	sys 0.006s
W20260709 12:18:58.132822 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 562253us
I20260709 12:18:58.132941 24214 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:18:58.134148 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:58.136617 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:58.138662 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:58.139312 24097 raft_consensus.cc:606] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:58.139673 24097 raft_consensus.cc:614] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:18:58.141898 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08002493a0 after lost signal to thread 22906
I20260709 12:18:58.143208 28043 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:58.143772 28043 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:58.144194 28043 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.144692 28189 raft_consensus.cc:993] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:58.145236 28189 raft_consensus.cc:1081] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:58.145748 28159 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.146629 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:58.147390 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:58.147930 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:58.148422 24067 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:58.133071 24216 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.579s (SENT) [suppressed 5 similar messages]
I20260709 12:18:58.149327 24067 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:58.150190 24067 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:18:58.143323 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08002b1da0 after lost signal to thread 24033
I20260709 12:18:58.151564 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:18:58.152133 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08002294e0 after lost signal to thread 24125
W20260709 12:18:58.153554 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7f20 after lost signal to thread 24200
I20260709 12:18:58.154263 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.154878 24171 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:18:58.155378 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.154901 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:58.156303 24169 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:18:58.153818 24122 debug-util.cc:398] Leaking SignalData structure 0x7b0800372a80 after lost signal to thread 24201
I20260709 12:18:58.157352 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:58.158658 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08003deaa0 after lost signal to thread 24274
I20260709 12:18:58.160480 28181 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:58.130662 28177 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.160319 28217 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:18:58.161087 28181 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.161506 28217 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.161608 28181 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.161975 28217 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.162941 28177 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:58.160530 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.169018 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:58.166807 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08001c78a0 after lost signal to thread 24275
W20260709 12:18:58.171574 24122 debug-util.cc:398] Leaking SignalData structure 0x7b080033ff00 after lost signal to thread 24839
W20260709 12:18:58.171888 24122 debug-util.cc:398] Leaking SignalData structure 0x7b0800184de0 after lost signal to thread 24840
W20260709 12:18:58.172439 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0240 after lost signal to thread 28150
W20260709 12:18:58.172708 24122 debug-util.cc:398] Leaking SignalData structure 0x7b080037f700 after lost signal to thread 28155
W20260709 12:18:58.172906 24122 debug-util.cc:398] Leaking SignalData structure 0x7b0800334d40 after lost signal to thread 28156
W20260709 12:18:58.173112 24122 debug-util.cc:398] Leaking SignalData structure 0x7b0800360340 after lost signal to thread 28157
W20260709 12:18:58.173331 24122 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5320 after lost signal to thread 28159
W20260709 12:18:58.173605 24122 debug-util.cc:398] Leaking SignalData structure 0x7b0800369fc0 after lost signal to thread 28167
I20260709 12:18:58.126696 28035 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:18:58.184150 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.169952 24214 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.192937 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.193749 24171 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:18:58.194896 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.196086 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.204430 24140 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:58.205742 28219 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:58.206400 24140 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:58.207542 28219 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:58.209189 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:58.209403 24140 leader_election.cc:400] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13.
I20260709 12:18:58.209931 24140 leader_election.cc:403] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:18:58.209924 28219 raft_consensus.cc:2764] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:18:58.210467 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:58.211760 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:58.213186 28225 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:58.214131 28225 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:58.216460 28225 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:58.149940 28157 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:58.165311 28042 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:58.224370 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.165669 28189 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:58.164103 28150 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.228796 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.168286 28213 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:58.182641 28035 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:18:58.249879 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 122761us
I20260709 12:18:58.266535 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.266535 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:58.268528 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 117570us
I20260709 12:18:58.268693 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.269706 24171 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:18:58.271258 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.272864 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.276351 24174 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:58.223464 28177 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:58.282239 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.223316 28157 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:18:58.176524 28195 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:58.290752 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 110509us
I20260709 12:18:58.282835 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:58.262538 28213 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.295006 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:58.270610 28035 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:18:58.300843 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:58.301762 24093 raft_consensus.cc:606] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:58.302556 24806 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 7. Current term is 8. Ops: []
W20260709 12:18:58.295674 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 82534.9us
W20260709 12:18:58.280525 27872 consensus_meta.cc:287] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.005s
I20260709 12:18:58.291041 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:58.302685 24169 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:18:58.281551 28177 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.288362 28189 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:58.288231 28157 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:58.317889 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:58.278717 28150 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.297910 28213 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.325418 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:58.317378 27872 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.317809 28177 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.316713 28219 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13.
I20260709 12:18:58.351446 24173 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
W20260709 12:18:58.353099 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080012b8e0 after lost signal to thread 22906
W20260709 12:18:58.354562 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080010d440 after lost signal to thread 24033
W20260709 12:18:58.356678 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08001f3f60 after lost signal to thread 24125
W20260709 12:18:58.357070 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800086520 after lost signal to thread 24126
W20260709 12:18:58.357460 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800148a80 after lost signal to thread 24140
W20260709 12:18:58.357771 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800107aa0 after lost signal to thread 24141
W20260709 12:18:58.358592 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003836c0 after lost signal to thread 24167
W20260709 12:18:58.359045 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08002665e0 after lost signal to thread 24172
I20260709 12:18:58.361161 27872 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.363101 24808 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 17: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:18:58.364781 24170 raft_consensus.cc:2410] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:18:58.371289 28185 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.372859 27868 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.328779 28189 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:18:58.374855 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08002956a0 after lost signal to thread 24173
W20260709 12:18:58.375278 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003222a0 after lost signal to thread 24176
W20260709 12:18:58.375993 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800341e40 after lost signal to thread 24200
W20260709 12:18:58.376372 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080030b3c0 after lost signal to thread 24201
W20260709 12:18:58.376744 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08002f3040 after lost signal to thread 24214
W20260709 12:18:58.377067 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003c8020 after lost signal to thread 24216
W20260709 12:18:58.378113 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003e75a0 after lost signal to thread 24257
W20260709 12:18:58.378379 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800108a40 after lost signal to thread 24258
W20260709 12:18:58.378671 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08002380e0 after lost signal to thread 24260
W20260709 12:18:58.382858 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003c6c40 after lost signal to thread 24261
W20260709 12:18:58.383273 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb240 after lost signal to thread 24262
W20260709 12:18:58.384438 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 172748us
I20260709 12:18:58.389627 28228 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:58.353554 28223 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:58.383579 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080033cdc0 after lost signal to thread 24263
W20260709 12:18:58.395570 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc7e0 after lost signal to thread 24264
I20260709 12:18:58.385660 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:58.392560 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 101616us
I20260709 12:18:58.393638 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:58.384229 28052 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.396694 28235 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:58.397260 28150 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.398545 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:58.406414 24097 raft_consensus.cc:606] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:58.399904 28185 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.408349 27868 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.397794 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:58.410508 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:58.412231 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:18:58.395934 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080027db60 after lost signal to thread 24265
W20260709 12:18:58.413429 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003b61c0 after lost signal to thread 24266
W20260709 12:18:58.413697 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080005e0c0 after lost signal to thread 24267
W20260709 12:18:58.413964 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080005a180 after lost signal to thread 24268
W20260709 12:18:58.414211 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080032aba0 after lost signal to thread 24269
W20260709 12:18:58.414101 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 136175us
I20260709 12:18:58.404137 28177 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.415915 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:58.414624 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003a2280 after lost signal to thread 24270
W20260709 12:18:58.431998 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 262135us
I20260709 12:18:58.419797 28195 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.421661 28187 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.380069 28207 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:58.381569 28189 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.430143 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:58.419261 28184 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:18:58.433290 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003168e0 after lost signal to thread 24272
I20260709 12:18:58.435995 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.441098 24141 leader_election.cc:400] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13.
W20260709 12:18:58.447675 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800339a00 after lost signal to thread 24273
W20260709 12:18:58.447991 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800339a80 after lost signal to thread 24274
W20260709 12:18:58.448197 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3fc0 after lost signal to thread 24275
W20260709 12:18:58.448439 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080036da60 after lost signal to thread 24276
W20260709 12:18:58.448639 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800328260 after lost signal to thread 24278
I20260709 12:18:58.449898 28231 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:58.450419 28231 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.450655 28177 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.450948 28231 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.433107 28228 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:58.452558 28228 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.453008 28228 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.455305 28235 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:58.457072 28184 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:58.458132 28184 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.461928 28235 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:18:58.463050 28052 raft_consensus.cc:3055] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:58.463532 28052 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:58.464753 28052 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.439806 28150 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:58.472178 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:18:58.476320 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003a25e0 after lost signal to thread 24279
W20260709 12:18:58.476723 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800339d60 after lost signal to thread 24282
W20260709 12:18:58.476980 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800345180 after lost signal to thread 24774
W20260709 12:18:58.477198 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08001249c0 after lost signal to thread 24775
W20260709 12:18:58.477499 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800327880 after lost signal to thread 24782
I20260709 12:18:58.478041 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:58.478708 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08002ffc00 after lost signal to thread 24839
W20260709 12:18:58.489241 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08002d49a0 after lost signal to thread 24840
W20260709 12:18:58.489812 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080029b000 after lost signal to thread 27865
W20260709 12:18:58.490097 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080025ec20 after lost signal to thread 27868
W20260709 12:18:58.490381 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800301ba0 after lost signal to thread 27872
W20260709 12:18:58.490741 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6b40 after lost signal to thread 27984
W20260709 12:18:58.491035 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003d12e0 after lost signal to thread 28014
W20260709 12:18:58.491360 24271 debug-util.cc:398] Leaking SignalData structure 0x7b0800364800 after lost signal to thread 28042
W20260709 12:18:58.491668 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08003809c0 after lost signal to thread 28052
I20260709 12:18:58.506775 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:58.466730 28052 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.516346 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:58.535915 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3e40 after lost signal to thread 28166
I20260709 12:18:58.554523 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:58.557924 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:58.444947 28189 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:58.564566 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:18:58.575225 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 442151us
I20260709 12:18:58.482189 28207 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.466921 28152 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.439404 28182 consensus_queue.cc:1059] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.127s
I20260709 12:18:58.602883 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:58.473342 28035 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.586939 28207 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:58.589494 28152 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:58.623018 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 58531.1us
W20260709 12:18:58.613313 28209 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.508s	user 0.008s	sys 0.007s
I20260709 12:18:58.599690 28180 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:58.665388 28229 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:58.670866 24171 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:58.673223 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.603616 28043 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.665817 28240 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:18:58.681202 28222 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:18:58.681742 28234 log.cc:927] Time spent T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.288s	user 0.001s	sys 0.001s
W20260709 12:18:58.684237 28181 consensus_meta.cc:287] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.522s	user 0.015s	sys 0.000s
I20260709 12:18:58.618813 28227 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:58.692338 28035 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:58.632409 28207 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:18:58.711725 28180 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:18:58.712297 28180 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:58.712782 28180 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:58.672430 28236 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:18:58.715411 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 82526us
I20260709 12:18:58.715426 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:18:58.723973 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50891.3us
I20260709 12:18:58.725725 24216 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:58.670089 28209 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.728820 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:58.729857 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.731436 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:58.733525 28043 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.734911 24096 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:18:58.736711 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 324533us
I20260709 12:18:58.737496 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:58.739409 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:58.742345 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:58.734048 28237 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.078s	user 0.000s	sys 0.005s
I20260709 12:18:58.743815 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.746246 24806 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:58.718852 28181 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.751302 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:58.735828 27868 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:58.753355 28233 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:18:58.754168 28177 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:58.754287 28233 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:58.754655 28177 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.755155 28177 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.755546 28233 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.759395 28232 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:58.760980 28243 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:58.761488 28243 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:58.761871 28243 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:58.763937 24101 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:58.741004 28155 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:58.766791 28181 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:58.768651 28217 consensus_meta.cc:287] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.006s
I20260709 12:18:58.721524 28227 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.777253 28209 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.781610 28157 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.764765 28042 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:18:58.789048 28231 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.723728 28228 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:58.804710 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53498.7us
I20260709 12:18:58.805080 24096 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:18:58.805996 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:58.806463 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:58.810701 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.811411 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:58.801249 28042 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:58.815290 27868 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:58.815395 28042 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.816780 28227 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:58.817329 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:58.818887 24092 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:58.820086 28232 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:58.820631 28232 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.814152 28177 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.822840 24098 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:58.823292 28242 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:58.797526 28217 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.825197 24099 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 7. Current term is 8. Ops: []
I20260709 12:18:58.825359 24096 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:58.826013 28217 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.826776 28156 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:58.827391 28156 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:58.828178 28228 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.824998 28177 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.828437 28156 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.826188 28180 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.834955 28232 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.835122 24214 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.836432 28180 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:58.836562 27868 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:58.840401 28186 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:18:58.841671 28240 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:18:58.847910 28186 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:58.848192 28240 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:58.848388 28186 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:58.848608 28240 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:58.849457 28240 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.849457 28186 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.842784 28232 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:18:58.851107 28186 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.851224 28232 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:58.851601 28232 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 7 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:58.852519 28232 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.853765 28232 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:58.854178 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:58.845335 24808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 610) took 1176 ms. Trace:
I20260709 12:18:58.847810 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:58.845618 24099 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:58.855674 28189 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.858050 28189 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:58.860628 28213 consensus_meta.cc:287] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 12:18:58.861274 28213 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.862706 24100 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:58.863703 28155 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:58.864861 28185 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:58.865374 28185 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:58.869084 24095 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:58.877055 24093 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:58.855471 24808 rpcz_store.cc:276] 0709 12:18:57.668961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:57.676630 (+  7669us) service_pool.cc:224] Handling call
0709 12:18:58.845080 (+1168450us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54005d7fd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:18:58.845243 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1418275200}
I20260709 12:18:58.882500 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:58.882819 28185 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.886097 28042 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.887534 28246 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:18:58.888501 28246 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:58.888826 28246 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:58.889812 28246 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:58.877130 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 139719us
I20260709 12:18:58.893497 27868 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:58.899977 28155 consensus_queue.cc:1059] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:18:58.902726 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 92143.7us
I20260709 12:18:58.904304 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.905280 24098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:18:58.906203 24098 raft_consensus.cc:606] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:58.912437 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:58.913980 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:58.916088 28246 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:58.915858 27868 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:18:58.920271 28042 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.921101 28213 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.921627 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:18:58.925146 28240 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.926451 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:18:58.927748 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:18:58.929406 28221 raft_consensus.cc:3055] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:58.929831 28221 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:58.931222 28043 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:58.930696 28221 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.932879 28221 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:58.911924 28235 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:18:58.938726 28235 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:58.939132 28235 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:58.939983 28235 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:58.940735 28231 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:58.942082 28157 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:58.947329 28238 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:58.948549 28238 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:18:58.949046 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:58.950040 28207 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:58.950145 28155 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:58.950520 28207 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:58.952909 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.950661 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:58.951309 28249 raft_consensus.cc:3055] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:18:58.956823 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44470.6us
I20260709 12:18:58.950642 28155 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:58.960587 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:58.950466 28185 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.961846 28042 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:18:58.967459 28042 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:58.967921 28042 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:58.971195 28247 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.156s	user 0.003s	sys 0.001s
I20260709 12:18:58.948024 28215 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 12:18:58.961246 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.958966 28249 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:58.975915 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:58.960047 28231 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:18:58.959971 28213 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:58.983379 28155 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.984774 28155 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.957011 28207 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.980129 28043 raft_consensus.cc:3055] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:58.979915 28249 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.980538 28231 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:58.982250 28218 raft_consensus.cc:476] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Not starting pre-election -- already a leader
I20260709 12:18:58.990357 28207 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:58.999315 28186 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:58.999811 28213 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:58.999917 28186 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.000494 28213 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:59.002523 28186 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:59.004858 27984 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:58.994182 28231 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:58.974721 28157 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:18:58.993976 27868 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:58.994954 28223 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:58.995095 28227 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:59.008119 28042 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.008414 28227 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:58.992467 28043 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:59.011058 28043 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.011555 28227 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:59.004778 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:59.011854 28042 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:59.012382 28043 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:59.015686 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:59.007598 27868 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.018649 28249 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.014514 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:18:59.013140 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52619.3us
I20260709 12:18:59.025146 28243 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:59.027467 28236 raft_consensus.cc:993] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:59.027343 28220 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:18:59.028053 28236 raft_consensus.cc:1081] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:59.028896 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:59.002787 28213 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:59.020342 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:58.964977 28235 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.035442 24172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:59.036131 24172 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.036552 24172 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.038012 27868 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:59.040877 28220 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:59.041175 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.041446 28220 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.041898 24167 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.043635 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.044253 24173 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:59.045917 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.046527 24168 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.056972 28231 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.058835 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.060206 24168 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:59.062772 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.064203 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.064891 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:59.065428 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 321678us
I20260709 12:18:59.069103 24170 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.069797 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:59.071980 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.072621 24176 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:59.066159 24216 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:59.075711 24169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:59.076346 24169 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.075027 28213 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:59.076973 24169 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.087492 24173 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:59.086637 24172 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.089615 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.090694 24175 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:59.088114 24167 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:59.092079 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.092922 24244 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 17: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:59.095292 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.097174 24176 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:59.101511 24169 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.104859 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:59.108031 24169 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:59.090533 27984 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:59.079487 28236 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:59.113560 24170 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:18:59.121193 24243 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:18:59.123081 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.124212 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.124611 24246 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:59.126087 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.091208 28240 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:59.111737 27872 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:59.128835 24172 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:59.128741 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.129958 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:59.133767 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.137403 28201 consensus_queue.cc:1059] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:18:59.135391 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.147045 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.137959 27984 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:59.140547 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:59.160159 24094 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:18:59.160638 24094 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.134327 23995 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.042501 28220 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.131736 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.133767 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:59.148883 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.173095 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.149909 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:59.175863 24247 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.176347 28159 raft_consensus.cc:3055] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:59.176508 24168 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:18:59.176893 28159 raft_consensus.cc:740] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:18:59.177884 28159 consensus_queue.cc:260] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:59.178705 23999 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 209) took 43280 ms (client timeout 15000 ms). Trace:
I20260709 12:18:59.150022 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.179526 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:18:59.181043 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.183161 24168 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: [10.7-10.7]
W20260709 12:18:59.159341 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.161880 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.163244 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.160084 24241 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:59.164655 24094 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.185547 24170 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.186050 24094 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:18:59.186415 24245 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:59.165356 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.166157 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.141618 28236 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:59.167699 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.193415 28236 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:59.193872 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:59.196383 28253 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:18:59.196316 24094 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:18:59.198393 28243 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:59.168006 24173 raft_consensus.cc:1240] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:59.199059 24241 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:59.170020 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.165525 23995 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 6 to 7, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 7 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:59.200199 24176 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:18:59.200476 27984 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:18:59.155189 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 73834.1us
I20260709 12:18:59.201177 24241 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:59.201179 23995 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 5 to 6, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 6 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.202939 28231 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:59.215713 24176 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:59.217443 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.222369 24168 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:59.223315 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:18:59.228950 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.244382 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:59.245443 24094 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:18:59.245857 24094 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.246819 24094 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.257920 24094 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:18:59.261554 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 60259.1us
W20260709 12:18:59.179160 23999 rpcz_store.cc:269] 0709 12:18:15.898574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:15.937190 (+ 38616us) service_pool.cc:224] Handling call
0709 12:18:59.178593 (+43241403us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:57.895814 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:58.066754 (+170940us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:58.072884 (+  6130us) write_op.cc:435] Acquired schema lock
0709 12:18:58.074794 (+  1910us) tablet.cc:662] Decoding operations
0709 12:18:58.111927 (+ 37133us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:18:58.112008 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:18:58.112037 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:18:58.112282 (+   245us) tablet.cc:701] Row locks acquired
0709 12:18:58.112296 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:18:58.112488 (+   192us) write_op.cc:270] Start()
0709 12:18:58.112619 (+   131us) write_op.cc:276] Timestamp: P: 1783599538112426 usec, L: 0
0709 12:18:58.112654 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:18:58.267418 (+154764us) log.cc:844] Serialized 536 byte log entry
0709 12:18:58.691947 (+424529us) op_driver.cc:464] REPLICATION: finished
0709 12:18:58.761149 (+ 69202us) write_op.cc:301] APPLY: starting
0709 12:18:58.761251 (+   102us) tablet.cc:1367] starting BulkCheckPresence
0709 12:18:58.888530 (+127279us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c05576e28 00007f4c08fb1581 00007f4c08fb0d58 00007f4c08fb59f1 00007f4c08fb59a9 00007f4c08fb5939 00007f4c08fb5901 00007f4c08fb4b2d 0000000000388634 0000000000388479
0709 12:18:58.926176 (+ 37646us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b18000de4c0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e522 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:18:58.934831 (+  8655us) tablet.cc:1370] finished BulkCheckPresence
0709 12:18:58.934862 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:18:58.981670 (+ 46808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:18:58.981893 (+   223us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:18:58.981939 (+    46us) write_op.cc:312] APPLY: finished
0709 12:18:58.982232 (+   293us) log.cc:844] Serialized 25 byte log entry
0709 12:18:58.982422 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:58.982519 (+    97us) write_op.cc:454] Released schema lock
0709 12:18:58.982564 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:18:58.993359 (+ 10795us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:18:58.993937 (+   578us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":653949,"reported_tablets":51,"child_traces":[["op",{"apply.queue_time_us":68853,"apply.run_cpu_time_us":10710,"apply.run_wall_time_us":221851,"cfile_cache_hit":2,"cfile_cache_hit_bytes":2091,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":19732,"lbm_reads_1-10_ms":1,"lbm_reads_10-100_ms":1,"lbm_reads_lt_1ms":10,"num_ops":1,"prepare.queue_time_us":239062,"prepare.run_cpu_time_us":38357,"prepare.run_wall_time_us":1036561,"raft.queue_time_us":255540,"raft.run_cpu_time_us":18743,"raft.run_wall_time_us":50633,"replication_time_us":579081,"spinlock_wait_cycles":39967488,"thread_start_us":424588,"threads_started":4,"wal-append.queue_time_us":149593}]]}
I20260709 12:18:59.266811 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:59.282277 24244 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:18:59.208469 23995 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 8 to 9, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 9 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.293051 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.280265 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:59.294948 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.285310 24242 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:59.287839 24243 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:59.288568 24247 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:18:59.289211 24249 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:18:59.305142 24168 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:59.306506 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.307900 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.309299 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.311127 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:18:59.307900 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:18:59.312678 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.311664 24171 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:18:59.314404 24098 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:59.313634 24094 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:18:59.315446 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:59.315869 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:59.316289 24101 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:59.316444 24098 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.317230 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:59.318938 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.319633 24243 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:18:59.317548 24216 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.322250 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.283495 27984 raft_consensus.cc:993] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:59.326841 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.321406 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:59.327670 24248 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:59.329296 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:59.330510 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:18:59.333638 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.284089 28159 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:59.324123 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.339247 24095 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:18:59.339685 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.322261 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:59.325975 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:59.278259 28180 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:18:59.346583 28180 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:59.348870 24098 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:18:59.339440 24140 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:59.311300 28179 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:59.350831 28179 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.351990 28179 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.352943 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:18:59.323642 28235 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:59.355386 23995 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 5 to 8, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 8 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.359372 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:59.361133 28235 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:18:59.361773 28235 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:59.327176 28240 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:59.362836 28235 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.363871 28213 raft_consensus.cc:993] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:59.364432 27984 raft_consensus.cc:1081] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:59.322618 24170 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:18:59.367549 24247 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:59.336632 24066 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:59.369048 24247 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:18:59.370630 24247 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:59.337826 24243 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:18:59.344394 28221 raft_consensus.cc:1081] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:18:59.387688 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:18:59.358886 23995 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 5 to 10, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 10 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.388074 24140 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:59.388613 24242 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:18:59.345270 24093 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:59.367551 24246 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:18:59.372663 24243 raft_consensus.cc:3055] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:18:59.391575 24243 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:18:59.338246 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.385217 24250 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:59.349077 28180 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:59.324098 28042 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:18:59.399098 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 77755.8us
I20260709 12:18:59.400174 24067 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:59.400015 23995 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:18:59.404433 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 67864.9us
W20260709 12:18:59.410195 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 80048.4us
I20260709 12:18:59.411791 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.392689 24243 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.402182 28156 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:18:59.413053 28213 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:18:59.338593 28231 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:59.413843 28156 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.419579 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:18:59.398660 28256 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:18:59.418496 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:59.390619 28223 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:18:59.423729 23995 catalog_manager.cc:5697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 8 to 9, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:18:59.430804 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:18:59.398564 28150 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:59.422861 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.418030 28180 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:59.439416 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:18:59.452530 24170 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:59.454274 24175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:59.440583 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.441468 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:59.455032 24175 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.445905 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.448091 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.455610 24175 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.449827 24167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:18:59.456672 24167 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:18:59.418256 28246 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:59.416488 28243 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:59.457134 24167 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:18:59.416739 28155 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.420197 28236 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:18:59.398592 28215 consensus_queue.cc:1059] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:18:59.474011 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:18:59.469097 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 137946us
I20260709 12:18:59.434685 28228 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:59.420693 27868 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:18:59.468827 27984 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:59.498387 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.453088 28231 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.500782 24176 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:18:59.417878 28042 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:59.510818 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 196093us
I20260709 12:18:59.427582 28249 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:18:59.516590 24067 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:59.470060 28232 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:18:59.517511 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 43729us
I20260709 12:18:59.512660 28035 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:18:59.500254 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 54449.2us
I20260709 12:18:59.517221 23995 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:18:59.538419 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:59.495573 28233 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:59.525250 24167 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.498025 28180 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.540294 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.471380 28150 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:18:59.548671 24170 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:18:59.515551 28243 raft_consensus.cc:697] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.596755 28243 consensus_queue.cc:237] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.544157 28155 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:18:59.556942 24167 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:59.529733 28213 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:59.561247 28182 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:18:59.557914 28249 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.562114 28150 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:59.568387 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:18:59.607798 24243 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:18:59.575901 28180 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.589655 28042 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:18:59.536829 27984 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.591526 28231 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.594375 28156 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:59.558811 28220 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.639886 24243 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:59.658620 24175 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.637189 28213 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.692575 24175 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:18:59.711110 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 157985us
I20260709 12:18:59.714387 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:18:59.715526 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 154781us
I20260709 12:18:59.715989 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.718441 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.720016 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.721971 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:59.718006 28042 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.735010 28159 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:59.721643 28155 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:59.731222 28261 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:18:59.737440 28159 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:59.748147 24097 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:18:59.749576 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:59.752359 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:18:59.753806 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:59.750241 24093 raft_consensus.cc:3055] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:18:59.720392 28157 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.783852 24093 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.786685 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:18:59.789459 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:59.775583 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:18:59.776859 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 43781.8us
W20260709 12:18:59.782099 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 44284.6us
I20260709 12:18:59.725896 28249 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:18:59.782725 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:18:59.793489 24092 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:59.793853 24092 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.792860 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:59.794633 24092 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.795682 24092 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:18:59.717345 27984 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.725629 28220 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:18:59.776350 28156 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:59.772693 28218 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:18:59.786077 28261 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.816795 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.799718 28259 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:18:59.791679 28182 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:18:59.802860 28222 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:18:59.822736 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:18:59.799279 28250 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:59.823931 24250 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:59.820969 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.791919 28246 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:18:59.832057 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50371.4us
I20260709 12:18:59.783221 28262 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:18:59.842145 24242 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:18:59.820132 28179 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:18:59.842821 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.844164 24810 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:18:59.841970 28042 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.825779 28249 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:18:59.848503 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:18:59.785790 28213 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:18:59.824193 28155 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
W20260709 12:18:59.880925 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 113361us
I20260709 12:18:59.822021 28156 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.826597 28218 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:18:59.886404 28277 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:18:59.886729 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.888463 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:18:59.859475 28223 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:59.894387 24167 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:18:59.889477 24168 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:18:59.851570 28235 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.890803 24097 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:18:59.824690 28225 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:18:59.913215 24780 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:18:59.845026 28273 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:18:59.905609 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:18:59.861269 28250 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.882793 28159 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:18:59.885051 28179 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.918205 28235 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:18:59.927132 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 103889us
I20260709 12:18:59.916535 27872 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:18:59.920549 28236 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:18:59.915508 28223 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:18:59.975031 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 86040.1us
I20260709 12:18:59.929406 28271 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:18:59.927778 28276 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:18:59.898917 28259 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
W20260709 12:18:59.977258 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 94528.9us
I20260709 12:18:59.958917 28278 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:18:59.969698 28222 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:18:59.975796 28270 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:18:59.975811 28236 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:19:00.013815 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48013.7us
W20260709 12:19:00.051538 28266 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:19:00.052157 28222 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.054929 28042 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:00.055410 28042 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:00.056290 28042 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.996325 28271 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:00.076566 28042 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.077730 28223 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.073473 28218 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:00.074880 28179 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:18:59.921512 28261 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.058576 24092 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:00.105928 28156 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:00.051621 28283 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.107573 28235 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:18:59.991605 28276 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.121943 24175 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:00.141649 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.142450 28260 raft_consensus.cc:3055] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:00.143155 28260 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:00.144484 28260 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.146461 28260 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:00.012612 28278 consensus_queue.cc:1059] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:19:00.186939 24093 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.188781 28201 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:00.189271 28201 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:00.189688 24093 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:00.190243 28201 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.191823 28184 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:00.192248 28184 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:00.193147 28184 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.194355 28184 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:00.203029 24093 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:00.077404 28271 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.223359 28278 raft_consensus.cc:3055] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:00.224184 28278 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:00.014925 28250 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.109681 28218 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:19:00.231144 28235 raft_consensus.cc:3055] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:00.231817 28235 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:00.233186 28235 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.127395 28156 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:00.231432 28035 consensus_meta.cc:287] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.657s	user 0.015s	sys 0.000s
I20260709 12:19:00.252583 24250 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:00.243592 28035 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:00.156596 28283 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.154219 28236 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:00.259481 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 281757us
W20260709 12:19:00.279770 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 282548us
W20260709 12:19:00.283432 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.242004 28156 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.292829 24066 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:19:00.295493 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.302435 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:00.303618 24097 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260709 12:19:00.306007 24170 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:00.306130 24175 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:19:00.319766 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 414235us
I20260709 12:19:00.342742 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:00.237082 28278 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:00.361887 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 45026.3us
I20260709 12:19:00.364114 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:00.306226 28182 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:00.361382 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 60263.8us
I20260709 12:19:00.366071 24098 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 8. Current term is 9. Ops: []
W20260709 12:19:00.339639 28189 consensus_queue.cc:1175] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 7 } }
I20260709 12:19:00.347590 28236 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:00.393061 28182 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.360499 28281 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:19:00.382051 28180 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:19:00.357831 28042 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:19:00.348675 28243 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.360237 28228 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:19:00.427098 28294 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:00.443892 28294 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.414019 28304 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
W20260709 12:19:00.446205 28289 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:19:00.446384 28294 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:00.448860 28276 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:00.449890 28182 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:00.424553 28287 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:00.451572 28287 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:00.397899 28217 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.015s	sys 0.023s
W20260709 12:19:00.454293 28217 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.015s	sys 0.027s
I20260709 12:19:00.453931 28287 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:00.418424 28288 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:19:00.438880 28283 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:00.441738 28156 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:00.421593 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 56185.6us
I20260709 12:19:00.442317 28180 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:00.474283 28180 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:00.475519 28180 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.458940 28294 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:00.477037 28294 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:00.478217 28294 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.479979 28294 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.477169 28180 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:00.481855 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:00.482609 24174 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:00.474426 28278 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:00.451691 28235 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:00.490885 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 107179us
I20260709 12:19:00.492116 24170 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:00.494727 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:00.497241 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:00.496021 24174 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
W20260709 12:19:00.503801 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.506371 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:00.507292 24245 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:00.507277 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.505673 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:00.510839 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.511958 24248 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:00.508610 24249 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:00.514158 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.514274 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.514955 24246 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:19:00.515312 24244 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:00.515784 24247 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:00.516314 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.522212 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:00.522814 24250 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:00.534077 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.534328 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.531582 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.538388 24248 raft_consensus.cc:2393] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:00.538180 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:00.538410 24241 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:00.500079 28150 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:00.545356 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:00.503691 28217 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:00.550698 24246 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:00.552894 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:00.553969 24250 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:00.556607 24242 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:00.544003 28223 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.558403 28291 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:00.555778 28249 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:19:00.561192 28291 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.561686 28291 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:00.561983 28249 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:00.562402 28249 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.562731 28249 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:00.555289 28217 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.563463 28217 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:00.563665 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.556057 28225 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.564474 24243 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:00.564873 28225 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.567335 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:00.567487 27984 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:00.568243 24808 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:19:00.558856 28156 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:19:00.571055 28035 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:00.571470 28035 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:00.572350 28035 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.573571 28035 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.534512 28306 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:19:00.560420 28223 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.528651 28287 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:00.533838 28227 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:00.580101 24250 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:00.581193 24141 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:00.589751 24245 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:00.597852 24808 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:00.592991 24141 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:00.547685 28182 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:19:00.617941 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.579183 28287 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:00.622610 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:00.624632 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.556393 28150 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.611459 28294 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:00.623651 28156 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:00.595655 27984 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:19:00.630195 28287 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:00.636162 28133 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.594558 28227 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.656786 28305 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:00.657462 28305 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.658334 24245 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:00.636950 28276 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.659385 28276 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.661443 28276 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:00.636720 28288 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:00.664280 28227 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:00.653290 28150 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:00.630007 28283 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:19:00.679855 24250 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:00.688102 27984 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:00.687383 28294 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:19:00.716420 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:00.727438 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 105343us
I20260709 12:19:00.729809 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.730996 24250 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:00.733799 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.734731 24245 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:00.700150 28290 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:00.684430 28133 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.693307 28250 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:19:00.741645 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:00.727169 28294 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:00.753551 24808 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:00.741981 28223 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:00.762822 24092 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:00.753592 28150 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:00.736871 28249 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.742568 28290 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.759471 28156 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:19:00.817561 28311 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:19:00.820607 28294 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.797783 28150 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:00.831513 24247 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:00.850948 28324 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:00.851810 28324 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:00.854972 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.858304 28250 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:00.858958 28250 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.860654 28290 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:00.861227 28250 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:00.788987 28222 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:19:00.815305 28305 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:00.879251 28249 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:00.879482 28246 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.880066 28246 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.882391 28246 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:00.888415 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.889957 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:00.890590 24250 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:00.891077 28318 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:00.891783 28318 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.834739 28150 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:00.867786 28156 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.869879 28133 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:00.908885 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:00.910408 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:00.913524 24250 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:00.827718 28281 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:19:00.929433 28314 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:19:00.930624 28236 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:00.932173 28318 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:00.932698 28182 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:00.933125 28182 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:00.933524 28182 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:00.936713 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:00.937536 24808 raft_consensus.cc:2393] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:19:00.927203 28281 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.944563 28201 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:00.928511 28325 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:19:00.904940 28324 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:00.962638 28246 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:00.962828 28249 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:00.963703 28249 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:00.968986 28249 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:19:00.990592 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.004189 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:01.004988 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:01.005532 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.006134 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:01.006879 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:01.012015 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:00.976625 28330 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:01.061175 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:01.061388 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48865.4us
I20260709 12:19:01.064455 24169 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:01.066423 24100 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:19:01.066330 28330 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:00.976393 28246 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:01.076428 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.064823 28297 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:01.078235 24100 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:01.013092 28278 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.013484 28305 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:01.091791 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:00.997002 28287 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:01.096535 24100 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:19:01.137856 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.106408 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.140349 24249 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:01.140817 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.095980 28228 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.075404 28182 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.101296 28207 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.144583 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.078019 28217 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.152678 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.154284 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.098030 28278 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.155508 28236 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:01.162911 28236 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:01.163502 28331 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
W20260709 12:19:01.163846 28320 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.341s	user 0.003s	sys 0.000s
I20260709 12:19:01.167732 24249 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:01.171556 24100 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:01.094296 28297 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:01.115424 28305 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:01.158720 28327 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260709 12:19:01.148249 27984 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:19:01.185464 28297 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:01.152537 28207 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.149624 28228 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.190457 28207 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:19:01.196982 28310 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.542s	user 0.002s	sys 0.000s
I20260709 12:19:01.192996 28228 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:01.166694 28291 consensus_meta.cc:287] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.604s	user 0.016s	sys 0.000s
I20260709 12:19:01.191892 28281 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:01.218964 28184 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:19:01.239513 28157 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:01.251034 28334 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 12:19:01.252058 28246 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:01.252580 28254 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:01.244144 28218 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:01.223876 28291 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.249905 28207 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.249919 28340 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:01.291545 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.261698 28157 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.295060 28287 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:01.295157 28261 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:01.297389 28269 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:01.281737 28254 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.304484 28249 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.345110 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.301153 28330 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:01.365609 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:01.366333 28329 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:19:01.394608 24246 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:19:01.366894 28284 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:01.297169 28207 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:01.359769 28327 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:19:01.402697 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.414098 24808 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:19:01.347380 28246 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.367650 28269 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:01.366484 28157 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:01.404546 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.299881 28340 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.347071 28182 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:01.396598 28289 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:19:01.434108 24810 raft_consensus.cc:2410] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:19:01.396369 28235 consensus_meta.cc:287] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.906s	user 0.012s	sys 0.004s
I20260709 12:19:01.360486 28217 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.300459 28218 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:01.393772 28287 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.398161 28330 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:01.360255 28261 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:01.457136 28343 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:19:01.445255 28184 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.393427 28249 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.412750 28284 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.467573 28330 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.439769 28246 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:01.469223 28346 log.cc:927] Time spent T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:19:01.469120 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.480353 28333 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.483925 28291 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.449594 28305 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:01.478776 28150 consensus_meta.cc:287] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.550s	user 0.011s	sys 0.001s
W20260709 12:19:01.511134 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 90243.4us
I20260709 12:19:01.505677 28182 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:01.527173 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.533074 28218 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:01.535648 28352 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:01.536237 28352 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.538638 28352 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:19:01.541198 28201 consensus_meta.cc:287] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.596s	user 0.011s	sys 0.003s
I20260709 12:19:01.542763 28225 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.506508 28184 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:01.545948 28184 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:01.494684 28287 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:01.548615 28207 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:01.549459 28182 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.550083 28287 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:01.524647 28150 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:01.559840 24171 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:19:01.560985 28150 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.563760 28330 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:01.564697 28246 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:01.565407 28261 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.567677 28249 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:01.512203 28333 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:01.572364 24808 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:19:01.573856 28333 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.576720 28236 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:01.584136 28284 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.587630 28269 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.597980 28182 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.619163 28340 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:01.624889 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.626868 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.627327 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.627862 24099 raft_consensus.cc:2410] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:19:01.627970 24097 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:19:01.630012 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.631372 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:01.633447 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.634228 24243 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:01.635872 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.639109 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:01.639688 24244 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:01.641644 24242 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:01.643695 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.644491 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.645262 24246 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:01.645744 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.647019 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.648442 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.648995 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.654165 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 1974) took 1074 ms. Trace:
I20260709 12:19:01.654274 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.654683 24247 rpcz_store.cc:276] 0709 12:19:00.579694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.584735 (+  5041us) service_pool.cc:224] Handling call
0709 12:19:01.653926 (+1069191us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b54003ac854. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:01.654074 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":486698368}
I20260709 12:19:01.656142 24241 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:19:01.657534 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.657624 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:01.658840 24250 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:01.664995 24244 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:01.667558 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:01.675318 24095 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:19:01.675966 24095 pending_rounds.cc:85] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 6
I20260709 12:19:01.676324 24095 pending_rounds.cc:107] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:19:01.676702 24095 raft_consensus.cc:2889] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:01.678655 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.680392 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.682271 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.680457 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.684664 24098 raft_consensus.cc:2393] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 9: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:01.686100 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.687049 24095 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
W20260709 12:19:01.687179 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 164779us
I20260709 12:19:01.679858 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.679574 24814 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:01.688957 24101 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:01.683980 24097 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:01.689199 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.690666 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.696625 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:01.697439 24243 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:01.699188 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.701347 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:01.702256 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:01.703106 24810 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:19:01.711410 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:01.724659 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.725396 24248 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:19:01.726379 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.727203 24248 raft_consensus.cc:2393] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:19:01.729023 28332 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.653s	user 0.002s	sys 0.002s
I20260709 12:19:01.714188 24243 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:01.690366 28318 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:01.719580 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.721786 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:01.740975 24250 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:19:01.702422 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:01.732501 24243 raft_consensus.cc:606] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:01.742156 24243 raft_consensus.cc:614] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:01.742189 24248 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:01.744207 24780 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:01.745237 28259 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:01.745658 28259 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.746024 28259 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:01.746064 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.747084 24810 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:01.747252 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.750356 24215 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:01.751314 24141 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:01.751439 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.751693 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.753142 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.754215 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.755007 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:01.755967 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.756716 24141 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:01.761392 28284 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:01.759441 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:01.759954 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.764027 28353 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:01.764118 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:01.764846 28225 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:01.765853 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 1979) took 1027 ms. Trace:
I20260709 12:19:01.766592 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 848) took 1330 ms. Trace:
I20260709 12:19:01.722520 28133 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:01.776747 24167 rpcz_store.cc:276] 0709 12:19:00.435686 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.439091 (+  3405us) service_pool.cc:224] Handling call
0709 12:19:00.439482 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:00.459374 (+ 19892us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:00.459407 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:00.459450 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:00.459482 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:01.766307 (+1306825us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b540019a354. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:19:01.766361 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.766483 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45234560}
I20260709 12:19:01.778380 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:01.776618 24245 rpcz_store.cc:276] 0709 12:19:00.738510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.738686 (+   176us) service_pool.cc:224] Handling call
0709 12:19:00.739164 (+   478us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:00.739677 (+   513us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:00.739723 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:00.743594 (+  3871us) log.cc:844] Serialized 26 byte log entry
0709 12:19:00.923052 (+179458us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:00.923107 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:00.923207 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:01.728204 (+804997us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:19:01.765519 (+ 37315us) raft_consensus.cc:1685] finished
0709 12:19:01.765544 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:01.765778 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":120,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":5014,"spinlock_wait_cycles":17480576,"thread_start_us":133013,"threads_started":1,"wal-append.queue_time_us":237821}
I20260709 12:19:01.762665 28304 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:01.762253 28318 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:01.783083 28284 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:01.782900 28282 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:01.812378 24174 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:01.813335 24175 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:01.787142 28133 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:01.788525 24173 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:01.791145 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:01.842581 24168 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:01.792688 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:01.793637 28217 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:01.801081 28304 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:01.844354 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:01.844955 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:01.866861 24175 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:01.806159 24170 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:01.851687 24167 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:01.869457 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:01.893498 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:01.895233 24168 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:19:01.925714 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 193197us
W20260709 12:19:01.939756 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 127917us
I20260709 12:19:01.980500 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:01.981165 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:01.982213 24170 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:01.993196 24173 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:01.993834 24172 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:02.037410 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 96230.5us
I20260709 12:19:02.038645 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:01.809477 28150 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:02.055320 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 305054us
I20260709 12:19:02.055611 24170 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:02.062124 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:02.064534 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:02.065358 24101 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:02.066669 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:02.067423 24176 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:02.063378 24097 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:19:01.942821 28304 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.103978 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:02.075464 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 147308us
I20260709 12:19:02.054543 28157 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:02.129419 24174 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
W20260709 12:19:02.103440 28314 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:19:02.095839 28189 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:02.136235 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:02.101426 28223 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:02.140882 24167 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:02.141822 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:02.153981 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 50128.1us
I20260709 12:19:02.154925 24066 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.156726 24172 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:02.107105 28179 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:02.089438 28291 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:02.152523 28333 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:02.089098 28305 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.144045 24174 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
I20260709 12:19:02.159453 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:02.142073 24242 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:02.091279 28150 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.173162 28150 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.164631 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.166088 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:02.169143 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:02.169636 28282 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:02.169310 28305 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.177392 28305 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.177573 28282 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:02.178160 28282 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.178570 28282 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.170141 28291 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.180860 28291 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.183346 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.183534 28297 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.184168 28297 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.186641 28297 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.153642 28292 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.149942 28223 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.195323 28236 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.168740 24167 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:02.154194 28330 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.160133 28182 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:02.204932 24097 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:02.203380 28250 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.147156 28157 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.229568 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:02.161427 24215 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:02.196013 28317 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.207607 28223 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:19:02.243300 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 81958us
I20260709 12:19:02.246371 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:02.248309 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:02.192798 28179 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.252147 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:02.157202 28318 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.263473 28280 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:02.234859 28250 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.264626 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1896) took 1249 ms. Trace:
I20260709 12:19:02.265053 24171 rpcz_store.cc:276] 0709 12:19:01.005839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.007924 (+  2085us) service_pool.cc:224] Handling call
0709 12:19:01.008261 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.560287 (+552026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.254678 (+694391us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54002adfd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:19:02.254916 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1267856256}
I20260709 12:19:02.266180 28250 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.267501 24095 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:02.257107 28365 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:02.268615 28365 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.269044 28365 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.229614 28236 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.271507 28278 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:02.273554 28360 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:19:02.259923 28133 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.200662 28333 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.283744 28243 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:02.284390 28243 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.285768 28189 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.286358 28189 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.233985 28330 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.288609 28179 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.286553 28243 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.293403 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:02.295019 28291 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:02.295600 28291 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:02.296319 28254 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.296574 28291 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.297544 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 1937) took 1198 ms. Trace:
I20260709 12:19:02.297927 24100 rpcz_store.cc:276] 0709 12:19:01.099522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.105985 (+  6463us) service_pool.cc:224] Handling call
0709 12:19:02.297300 (+1191315us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54001f45d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:02.297450 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71573376}
I20260709 12:19:02.300908 28207 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.301177 28189 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.301520 28207 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.208187 28292 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.246454 28317 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.302192 28315 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.305670 28315 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.308137 28315 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:02.312887 28292 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:02.315438 28333 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.317723 28189 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.317824 28324 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.318560 28324 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.320958 28324 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.317838 28157 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:02.323663 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.286293 28236 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:02.334436 28259 consensus_meta.cc:287] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.588s	user 0.006s	sys 0.006s
I20260709 12:19:02.315476 24216 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:02.342010 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:02.240280 28225 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:02.359990 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.361897 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.362686 24242 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:02.363515 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.363471 24246 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:02.363674 28249 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:19:02.358204 28157 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:02.379864 28157 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.380508 28157 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.384631 28157 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:02.363945 24140 connection.cc:256] RPC call timeout handler was delayed by -1.0325484410002446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
I20260709 12:19:02.352856 28281 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:02.384958 28364 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.159s	user 0.002s	sys 0.000s
I20260709 12:19:02.385663 28281 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.388098 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:02.389412 28243 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:02.389983 28243 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:02.352887 28340 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.391008 28243 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.400895 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.401964 24250 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:19:02.405799 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.408155 28278 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.408798 28278 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.409235 28367 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:02.391422 28340 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.411902 28207 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.413641 28218 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.414047 28340 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.414256 28218 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.392947 28283 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.415508 28283 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.422210 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.423214 24808 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
I20260709 12:19:02.365561 28330 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.435237 28324 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.388157 28281 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.438530 24241 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 2112) took 1768 ms. Trace:
I20260709 12:19:02.422277 28156 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.442323 24241 rpcz_store.cc:276] 0709 12:19:00.657071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:00.660379 (+  3308us) service_pool.cc:224] Handling call
0709 12:19:01.655854 (+995475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:01.656559 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:02.425562 (+769003us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b54003ac850. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:02.425742 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2288546688}
I20260709 12:19:02.359453 28259 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.438743 28284 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:02.460071 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.446996 28156 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.473119 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.445541 28278 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.441286 28324 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.474884 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:19:02.485200 24244 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.797s	user 0.044s	sys 0.065s
I20260709 12:19:02.489931 24813 raft_consensus.cc:2368] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12.
W20260709 12:19:02.491361 24244 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.803s	user 0.045s	sys 0.066s
I20260709 12:19:02.441659 28225 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:19:02.493336 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.494139 24250 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:02.493359 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:02.495324 24809 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.496829 28365 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.498001 24245 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:19:02.500941 28156 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.473719 28284 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:02.520448 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 327829us
I20260709 12:19:02.523589 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:02.523998 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:02.525411 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:02.526281 24101 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:19:02.546366 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:02.550042 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.551343 24248 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:02.560302 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:02.444782 28223 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.482162 28305 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:02.573132 24779 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:02.576124 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.581292 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:02.557552 28156 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:02.558820 28221 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:02.583868 28335 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:02.588672 28218 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.590440 24809 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:02.597304 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.623090 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.633483 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.568765 28220 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:02.625216 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.657614 24246 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:02.579592 28353 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:02.660018 24214 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.020s	sys 0.035s
W20260709 12:19:02.664865 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 550679us
I20260709 12:19:02.667163 24780 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.585206 28365 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.594879 28335 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.680307 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.673982 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:02.669114 28218 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:02.582643 28305 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.593808 28221 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.665755 24214 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:02.683595 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 270466us
I20260709 12:19:02.658625 28214 raft_consensus.cc:2764] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:19:02.584431 28333 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.086s
I20260709 12:19:02.655207 28184 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:02.661610 28267 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:02.697161 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.698145 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.699152 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.700994 24250 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 18: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:19:02.698549 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 436693us
I20260709 12:19:02.703137 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.670630 28278 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:02.683449 28335 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.682946 28269 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:02.685698 28340 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:02.687448 28218 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.663614 28220 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.710717 24140 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.693364 28221 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:02.708922 24067 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.639669 28156 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.702327 28184 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.760592 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.761847 24249 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:02.707681 28318 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:02.763927 28318 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:02.733067 28283 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.754217 28225 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.704831 28278 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.766739 28297 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:02.747615 28259 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.767342 28278 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:02.767879 28297 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:02.768918 28302 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:02.746912 28324 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.769460 28217 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:02.770954 28217 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:02.769469 28305 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.696578 28284 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.640784 28304 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.772042 28217 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.773803 28217 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.774118 28304 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.775084 24169 raft_consensus.cc:2368] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9.
I20260709 12:19:02.743597 28223 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.776880 28184 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.745823 28156 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.778311 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.783145 28220 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.705118 28271 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 12:19:02.717187 28254 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:19:02.705590 28150 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:02.737807 28218 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.784492 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.785198 28340 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:02.785399 24249 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:02.786320 28340 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.741921 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.787779 24250 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:19:02.788712 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.789281 24250 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:02.769397 28302 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:02.742865 28243 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:02.805135 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 65959.5us
I20260709 12:19:02.737455 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.809087 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.786334 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.813868 24249 raft_consensus.cc:2393] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 10: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:19:02.816198 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 78883.9us
I20260709 12:19:02.821205 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.733071 28281 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 12:19:02.823770 28380 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:02.833876 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 218514us
I20260709 12:19:02.826134 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:19:02.811537 28282 consensus_meta.cc:287] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.006s
I20260709 12:19:02.828670 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:02.828830 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:02.831149 28150 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.831643 28156 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:02.832229 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.838011 24171 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:19:02.838547 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:02.839447 28220 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:02.815493 28332 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.119s	user 0.006s	sys 0.004s
I20260709 12:19:02.841235 24174 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:02.846562 24067 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:02.832053 28340 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:02.850680 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:02.851380 24174 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:19:02.822419 28254 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:02.832134 28304 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:02.859192 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:02.861840 28222 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:02.862073 28324 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:02.858374 28371 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:02.863960 24140 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.864354 28371 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.864825 28371 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.865540 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:02.867223 28283 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:02.844476 28282 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.867961 28283 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:02.868639 28283 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:02.869836 28282 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.870918 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:02.871888 28387 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:02.872342 28387 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.872695 28387 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.873607 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:02.874882 24809 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.849166 28150 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.877548 28150 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.850389 28220 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:02.878337 28220 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.856757 28228 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:19:02.881328 28236 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:02.881446 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.882035 28236 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:02.883095 28236 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.850008 28273 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:02.854434 28156 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.884166 28150 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:02.886134 28156 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:02.862382 28222 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:02.887334 28222 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.888175 28387 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:02.889149 28261 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:02.891330 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.892704 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.893949 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:02.894485 24249 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:19:02.835983 28317 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:02.856103 28254 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:02.899534 28254 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:02.900107 28225 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:02.909212 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:02.910054 28377 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:19:02.911347 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:02.913017 24167 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:02.914537 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.915912 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.917001 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.910887 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:02.919329 28221 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.919267 28304 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:02.930027 24250 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:02.921912 24167 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:19:02.923599 28267 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:02.945016 24781 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:02.948144 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:02.948926 24245 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:02.953588 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:02.954476 24250 raft_consensus.cc:3060] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:02.955183 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:02.956009 24813 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:02.956326 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.956768 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.944664 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:02.965741 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.966169 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.969606 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.972160 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.974809 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:02.977360 24249 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:02.979463 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.981048 28324 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:02.984509 24245 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:02.991395 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:02.995448 24806 raft_consensus.cc:2368] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:19:02.960826 28292 raft_consensus.cc:2804] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:02.997351 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:03.000255 24811 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:03.001930 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 1902) took 1213 ms. Trace:
I20260709 12:19:03.002367 24169 rpcz_store.cc:276] 0709 12:19:01.788702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.792382 (+  3680us) service_pool.cc:224] Handling call
0709 12:19:03.001641 (+1209259us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540037ad54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:03.001831 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142359936}
I20260709 12:19:03.003754 28278 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.006630 28278 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:03.007529 28304 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:03.009953 28389 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.148s	user 0.003s	sys 0.000s
I20260709 12:19:02.941568 28335 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.037993 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:03.012063 28221 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:03.016079 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:02.969856 28225 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:03.021816 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 154977us
W20260709 12:19:03.026057 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 360393us
I20260709 12:19:03.045840 24214 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:03.013332 24809 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:03.039562 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:03.044853 24140 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.048017 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:02.998556 28243 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:03.052740 24245 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:02.964013 28220 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.058053 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.059507 24247 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:03.027913 28292 raft_consensus.cc:697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:03.060787 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 2138) took 1392 ms. Trace:
I20260709 12:19:03.068953 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.069741 24170 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:19:03.069670 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.070960 24171 raft_consensus.cc:2393] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:19:03.070905 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.071381 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.072047 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.072227 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.072510 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.072055 24174 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:03.074033 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.074609 24174 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:03.072732 24172 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:03.075825 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.076332 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.073479 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.077239 24174 raft_consensus.cc:2393] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 7: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:03.049484 28225 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:03.086512 24067 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.115182 24250 raft_consensus.cc:2468] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:19:03.115582 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:03.096228 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.078756 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.116557 24101 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:03.106272 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.107801 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.108560 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.110687 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.111385 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.013363 28371 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.106163 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.096899 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.118431 24097 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:03.055997 28278 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:03.171438 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:03.173190 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57703.1us
I20260709 12:19:03.174005 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.202682 27984 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:03.204231 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.219640 24098 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:03.205055 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:03.221055 24093 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:19:03.061309 28304 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:03.205797 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:03.076366 28324 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:03.206233 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.207429 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:03.207648 28385 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:19:03.209894 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 164134us
I20260709 12:19:03.238166 24214 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:03.210676 28374 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:03.213485 24092 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:03.066413 28243 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:03.147106 28387 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.243518 24214 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:03.053979 28223 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:03.113197 24168 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:03.067999 24244 rpcz_store.cc:276] 0709 12:19:01.668223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.674320 (+  6097us) service_pool.cc:224] Handling call
0709 12:19:01.674711 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:01.674978 (+   267us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:19:02.502415 (+827437us) log.cc:844] Serialized 14 byte log entry
0709 12:19:03.060451 (+558036us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:03.060509 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:03.060557 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:03.060622 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:03.060728 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":268767,"prepare.queue_time_us":46281,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":255744,"thread_start_us":1105288,"threads_started":2,"wal-append.queue_time_us":402505}
I20260709 12:19:03.218349 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.205533 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.222426 24813 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:03.225983 24096 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:19:03.226836 24100 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:03.234568 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.147514 28225 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:03.246630 24093 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:03.215926 24171 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:03.169911 28284 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:03.278244 28324 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:03.169793 28315 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:03.066469 28291 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
W20260709 12:19:03.248718 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 253017us
I20260709 12:19:03.290778 28324 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.167963 28221 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:03.258826 24214 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:03.102605 28156 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.137s
I20260709 12:19:03.117103 28261 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.146s
I20260709 12:19:03.223839 27984 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:03.271741 24811 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 18.
I20260709 12:19:03.068471 28218 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.234620 28317 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:03.275525 28292 consensus_queue.cc:237] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.290596 28284 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:03.300768 24216 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.541s (SENT) [suppressed 3 similar messages]
I20260709 12:19:03.272563 28249 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:03.304105 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 85896.3us
I20260709 12:19:03.305395 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:03.250789 28365 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:19:03.272212 28380 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:19:03.317523 28243 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.318274 28371 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.319430 28335 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:03.299806 28315 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.307958 28221 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.320159 28352 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:03.321247 28180 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:03.256633 28391 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:03.328470 24173 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:03.327956 28218 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:03.322363 28254 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.329303 24096 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:03.325486 27984 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:03.352603 24813 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 18: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:03.392186 24067 leader_election.cc:400] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9.
I20260709 12:19:03.325155 28223 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:03.392539 24067 leader_election.cc:403] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:03.303066 28222 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.337282 28236 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:19:03.381084 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 80212.2us
W20260709 12:19:03.390221 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 131495us
I20260709 12:19:03.351781 28249 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:03.397825 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:03.395646 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:03.338295 28317 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.406925 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.371390 28398 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:03.415025 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:03.385596 28180 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:03.386631 28352 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:03.420766 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.409446 24096 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:03.394058 28223 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:03.394070 28281 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:19:03.391964 28297 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:03.421787 24097 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:03.434389 24170 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:03.400278 28220 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.422447 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.408783 28249 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:03.443192 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:03.444870 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:19:03.432658 28396 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.063s	user 0.003s	sys 0.000s
I20260709 12:19:03.429615 28317 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:03.437521 28297 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.431119 28324 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.428829 28222 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.434252 28398 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.429713 28223 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:03.408430 28394 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9.
I20260709 12:19:03.463553 28221 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:03.404768 28391 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.404908 28236 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.421197 28352 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:03.494249 24096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:03.481792 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.467278 24095 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 18: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:03.504694 24096 raft_consensus.cc:606] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:03.500509 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.502866 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.420778 28180 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:03.473533 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:03.507377 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.508015 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.508530 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.508729 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:03.509492 24173 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:03.511546 24171 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:03.524228 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:03.526690 24215 leader_election.cc:400] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:19:03.527293 24215 leader_election.cc:403] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:03.541891 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:03.542891 24245 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 18: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:03.544905 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:03.545029 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:03.554700 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:03.557013 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:03.423048 28406 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:03.562235 24811 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:03.529330 24141 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:03.563592 24244 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:03.566143 24215 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:03.569247 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:03.615906 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.623344 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:03.624104 24241 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:03.626664 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 56622us
I20260709 12:19:03.615984 24173 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:19:03.627303 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:03.628809 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:03.498168 28315 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:03.463591 28254 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.640384 28220 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:03.641268 28222 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:03.644902 28236 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.647572 28284 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.647953 28370 consensus_queue.cc:1059] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:03.616209 28380 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:03.572422 28317 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:19:03.656558 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.657436 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.495025 28297 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:03.499801 28398 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:03.659075 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:03.665848 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 270255us
I20260709 12:19:03.696564 24216 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:03.614840 28330 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:19:03.672537 24175 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:03.673564 24067 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.657392 28304 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:03.705822 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:03.688638 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.697743 24241 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:03.708914 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:19:03.713276 28413 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:19:03.715117 28155 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:03.716167 23994 catalog_manager.cc:5697] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 9, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 9 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:03.704216 28380 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:03.718392 28317 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:03.718281 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:03.719197 28330 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:03.719357 28365 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:03.720279 28330 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.718904 28317 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:03.721864 28317 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:03.724645 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:03.725493 28406 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:03.726009 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:03.726430 28412 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:03.727160 28398 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:03.718261 28380 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.718235 23994 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 10 to 11, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 11 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:03.734594 23995 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 102) took 12875 ms (client timeout 15000 ms). Trace:
I20260709 12:19:03.736151 24216 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:03.739993 23994 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:03.750749 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:03.752681 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:03.751886 23994 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 10 to 11, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 11 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:03.759505 23994 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 10 to 11, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:19:03.760907 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 72400.7us
I20260709 12:19:03.761154 23994 catalog_manager.cc:5697] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:03.761875 24140 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.767732 23994 catalog_manager.cc:5697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 9, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:03.772645 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 99188.2us
I20260709 12:19:03.774329 24096 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:19:03.774554 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:03.708596 28274 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:03.774897 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.775298 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c552e5996384fef9c032a7fda531298"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:03.776835 24093 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:19:03.776433 24140 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.770382 23994 catalog_manager.cc:5697] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 7 to 8, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:03.777346 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:03.781283 24092 raft_consensus.cc:606] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:19:03.786686 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 101780us
I20260709 12:19:03.788031 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:03.735164 23995 rpcz_store.cc:269] 0709 12:18:50.859534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:50.867762 (+  8228us) service_pool.cc:224] Handling call
0709 12:19:03.734508 (+12866746us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:18:59.826930 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:18:59.979211 (+152281us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:18:59.983492 (+  4281us) write_op.cc:435] Acquired schema lock
0709 12:18:59.994134 (+ 10642us) tablet.cc:662] Decoding operations
0709 12:19:00.270251 (+276117us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:00.289985 (+ 19734us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:00.296317 (+  6332us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:19:00.466166 (+169849us) tablet.cc:701] Row locks acquired
0709 12:19:00.466186 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:19:00.466379 (+   193us) write_op.cc:270] Start()
0709 12:19:00.466522 (+   143us) write_op.cc:276] Timestamp: P: 1783599540466317 usec, L: 0
0709 12:19:00.466543 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:19:00.467931 (+  1388us) log.cc:844] Serialized 3597 byte log entry
0709 12:19:00.726601 (+258670us) op_driver.cc:464] REPLICATION: finished
0709 12:19:00.935669 (+209068us) write_op.cc:301] APPLY: starting
0709 12:19:00.935768 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:01.253516 (+317748us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:01.253679 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:01.610087 (+356408us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:01.610450 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:19:01.610520 (+    70us) write_op.cc:312] APPLY: finished
0709 12:19:01.610957 (+   437us) log.cc:844] Serialized 89 byte log entry
0709 12:19:01.615776 (+  4819us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557832a 00007f4c054fdf14 00007f4c054fdec3 00007f4c054fde38 00007f4c054fddf3 00007f4c054fd0dc 00007f4c05526e16 00007f4c0550ecbb 00007f4c054f939d 00007f4c054fcd75
0709 12:19:01.636033 (+ 20257us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:01.636221 (+   188us) write_op.cc:454] Released schema lock
0709 12:19:01.636283 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:01.636788 (+   505us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:01.636818 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":332217,"reported_tablets":22,"child_traces":[["op",{"apply.queue_time_us":195550,"apply.run_cpu_time_us":22650,"apply.run_wall_time_us":701085,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41765,"num_ops":9,"prepare.queue_time_us":225200,"prepare.run_cpu_time_us":21255,"prepare.run_wall_time_us":744353,"raft.queue_time_us":117868,"raft.run_cpu_time_us":33140,"raft.run_wall_time_us":934839,"replication_time_us":238383,"spinlock_wait_cycles":32141056,"thread_start_us":316354,"threads_started":4,"wal-append.queue_time_us":62568,"wal-append.run_cpu_time_us":13857,"wal-append.run_wall_time_us":2110059}]]}
I20260709 12:19:03.754752 28376 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:03.792635 28156 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:03.789170 28324 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:03.780710 28315 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:03.779567 28261 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:03.794584 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.795253 28254 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:03.796850 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.705338 28225 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.759850 28366 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:03.841279 24173 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:03.842361 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 69505.2us
I20260709 12:19:03.799801 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:03.843351 24092 raft_consensus.cc:606] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:03.843748 24092 raft_consensus.cc:614] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:03.844722 28223 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.788367 23994 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 9, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:03.850136 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:03.801906 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.850863 24098 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:03.851778 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49961us
I20260709 12:19:03.811138 28315 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:03.852567 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.854203 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:03.811378 28180 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:03.839439 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44953.2us
I20260709 12:19:03.858841 24067 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:19:03.840596 28410 log.cc:927] Time spent T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:19:03.841019 28225 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.852790 28315 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:03.775913 28304 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:03.854884 28156 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:03.869730 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.830261 28302 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.799458 28274 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:19:03.863065 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 66326.9us
I20260709 12:19:03.830852 28317 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:03.787508 28268 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:19:03.811311 28324 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:03.861990 28223 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:03.877955 24094 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:19:03.932134 24098 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
W20260709 12:19:03.946038 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 193479us
I20260709 12:19:03.875339 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.863040 28218 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:03.935643 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.866343 28261 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:19:03.869290 28273 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:03.871940 28281 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:03.830406 27984 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:03.954237 24098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:03.935551 28222 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:03.934811 28324 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:03.955008 24098 raft_consensus.cc:606] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:03.925485 28156 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:03.956468 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 81250.8us
I20260709 12:19:03.963955 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:03.941901 28302 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:03.962366 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:03.968178 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:03.970000 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:03.949610 28391 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:03.953424 28221 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:03.982187 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:03.951191 28218 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:03.959774 28398 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:03.961064 28220 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:03.970940 28419 log.cc:927] Time spent T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:19:04.000402 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:04.001123 24174 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:04.009167 24241 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:04.015852 28259 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:04.008415 28376 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:04.020479 28376 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:04.021858 28249 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.023907 28254 raft_consensus.cc:993] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:04.024425 28254 raft_consensus.cc:1081] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:04.025640 28261 raft_consensus.cc:993] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:04.026122 28261 raft_consensus.cc:1081] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
W20260709 12:19:04.028525 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46471.4us
I20260709 12:19:04.029204 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:19:04.017558 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52192.6us
I20260709 12:19:03.988888 28218 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.029649 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:04.023231 24246 raft_consensus.cc:2368] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11.
W20260709 12:19:04.033823 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 179706us
I20260709 12:19:03.986472 28184 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:19:04.040854 24140 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:04.043193 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:04.023181 28376 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:04.014312 28274 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:04.039793 28427 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:19:04.053288 24242 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
W20260709 12:19:04.102653 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64189.4us
W20260709 12:19:04.106639 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 244754us
I20260709 12:19:04.038007 28220 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:04.091362 28419 log.cc:927] Time spent T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:19:04.112023 24093 raft_consensus.cc:1240] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:04.111799 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:04.113036 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:04.085721 28305 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:04.083425 28180 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:04.085767 28249 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:04.092762 28391 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:04.092109 27984 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:04.129674 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:04.130577 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:04.131165 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:04.134953 24092 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.124013 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:04.138392 24242 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:04.044822 28156 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
W20260709 12:19:04.152546 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 109463us
I20260709 12:19:04.053730 28280 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:04.153551 24140 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:04.163359 24092 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:04.172283 24214 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:04.132514 28391 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:04.145485 28317 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:04.151134 28243 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:04.192975 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:04.175918 28283 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:04.206549 24214 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:04.164187 28432 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:04.177760 28280 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:04.186813 28391 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:04.182504 28249 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:04.202184 28184 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:19:04.215018 28412 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:04.248369 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60148.4us
I20260709 12:19:04.258013 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.192597 28380 consensus_queue.cc:1059] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:19:04.260787 24249 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:04.265623 24168 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:04.267239 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.271109 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.229939 28223 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:04.275167 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:04.275974 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:04.278860 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.286274 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c552e5996384fef9c032a7fda531298"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:04.287340 24168 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.287895 24168 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:04.280079 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60079.1us
I20260709 12:19:04.289368 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.313122 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.290087 24175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:04.315471 24175 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:04.315887 24175 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.320750 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:04.322650 24066 leader_election.cc:400] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11.
I20260709 12:19:04.324148 24066 leader_election.cc:403] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:04.342126 24170 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:04.284457 28366 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:04.350338 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:04.345516 28352 consensus_meta.cc:287] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.005s
I20260709 12:19:04.362499 28352 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.365235 28352 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:04.366873 24250 raft_consensus.cc:2368] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12.
I20260709 12:19:04.367242 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.368626 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:04.369035 24169 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:04.369796 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:04.370223 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:04.311116 28283 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:04.371528 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.367017 28428 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.177s
I20260709 12:19:04.372310 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.375578 24175 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.382112 24175 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:04.289145 28282 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.068s
I20260709 12:19:04.333671 28223 raft_consensus.cc:697] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:04.388875 28333 raft_consensus.cc:3055] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:19:04.373569 28397 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:19:04.390386 28236 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.371778 28297 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11.
W20260709 12:19:04.393641 28416 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:19:04.400121 24216 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:04.384754 24168 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.372162 24169 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.421094 24216 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:04.413841 28405 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:19:04.423710 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:04.425699 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:04.352974 28280 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:04.428416 28438 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:19:04.433207 28447 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:04.433702 28376 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:04.372131 28418 consensus_queue.cc:1059] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.187s
I20260709 12:19:04.410491 28333 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:04.440692 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:04.450067 24248 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:04.450637 28376 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:04.431339 28365 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:04.437287 28429 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:04.417544 28236 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.436261 28447 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:04.434417 28283 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.452713 28366 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:04.501323 28417 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.738s	user 0.000s	sys 0.004s
I20260709 12:19:04.503279 28333 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:04.504873 28333 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:04.507499 28315 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.632s	user 0.011s	sys 0.002s
I20260709 12:19:04.507997 28315 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:04.501482 28441 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:19:04.519649 28447 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.524099 28447 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.577402 24093 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:19:04.578781 24093 pending_rounds.cc:85] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 6
I20260709 12:19:04.579239 24093 pending_rounds.cc:107] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:19:04.579753 24093 raft_consensus.cc:2889] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:19:04.578430 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 285084us
I20260709 12:19:04.589529 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1942) took 1379 ms. Trace:
I20260709 12:19:04.590248 24171 rpcz_store.cc:276] 0709 12:19:03.210112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.621480 (+411368us) service_pool.cc:224] Handling call
0709 12:19:03.621801 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:03.622125 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:03.622153 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:03.622610 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:19:03.933556 (+310946us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:04.050425 (+116869us) log.cc:844] Serialized 14 byte log entry
0709 12:19:04.050818 (+   393us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.050931 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:04.588624 (+537693us) raft_consensus.cc:1685] finished
0709 12:19:04.588679 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.589130 (+   451us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25311,"prepare.queue_time_us":43889,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":8241,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":36922,"thread_start_us":333125,"threads_started":2,"wal-append.queue_time_us":481387}
I20260709 12:19:04.594897 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.596395 24171 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.600870 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1943) took 1390 ms. Trace:
I20260709 12:19:04.601531 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:04.602572 24101 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:04.603027 24101 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:04.605921 24247 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:04.607096 24101 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.619007 28315 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:04.621186 28249 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:04.623266 24097 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:04.621217 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:04.630505 28284 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.632052 28284 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.634877 28428 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:04.636672 28428 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:04.637987 28284 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:04.639151 28324 consensus_meta.cc:287] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.651s	user 0.010s	sys 0.005s
I20260709 12:19:04.639495 24811 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:04.640112 28236 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:04.640275 28324 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.481222 28223 consensus_queue.cc:237] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.643600 24172 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:04.649657 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.651108 28463 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:04.601555 24176 rpcz_store.cc:276] 0709 12:19:03.210479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.625952 (+415473us) service_pool.cc:224] Handling call
0709 12:19:03.635858 (+  9906us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:03.665363 (+ 29505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:03.665397 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:03.675979 (+ 10582us) log.cc:844] Serialized 26 byte log entry
0709 12:19:03.757023 (+ 81044us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:03.757085 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:03.757192 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:04.438859 (+681667us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:19:04.599947 (+161088us) raft_consensus.cc:1685] finished
0709 12:19:04.600016 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:04.600620 (+   604us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29038,"raft.queue_time_us":29193,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":22757,"spinlock_wait_cycles":6589696,"thread_start_us":51947,"threads_started":1,"wal-append.queue_time_us":72107}
I20260709 12:19:04.650348 28456 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:04.656581 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:04.656704 28456 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.657388 24808 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:04.662269 27984 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.663699 28282 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:04.666513 28330 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.667793 28184 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:04.667749 28330 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.671640 28380 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:04.672991 28330 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:04.676676 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:04.672616 28380 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.692940 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2675) took 1205 ms. Trace:
I20260709 12:19:04.693452 28380 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:04.674060 28302 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:04.702888 28302 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:04.697168 28284 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:04.705282 28284 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.704617 28302 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.708274 28302 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.712862 28315 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:04.714164 28315 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.693503 24094 rpcz_store.cc:276] 0709 12:19:03.487554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.488864 (+  1310us) service_pool.cc:224] Handling call
0709 12:19:03.489362 (+   498us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:03.945245 (+455883us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:04.692203 (+746958us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b54002d73d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:19:04.692671 (+   468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":892855680}
I20260709 12:19:04.727450 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:04.727794 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:04.729256 27984 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.630614 28249 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.728744 24097 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:04.732841 27984 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:04.739571 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.742339 28428 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:04.754570 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:04.756031 24098 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 11: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:04.761898 28352 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:04.765097 28352 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:04.765365 28324 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:04.765662 28352 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:19:04.774235 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49383.8us
I20260709 12:19:04.780438 28315 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:04.780876 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:04.782557 24176 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:04.784092 28456 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:04.790953 24172 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:04.795305 28228 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:04.802631 28335 raft_consensus.cc:3055] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:19:04.803253 28335 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:04.803977 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:04.805055 24170 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:04.804698 28335 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:04.806273 28335 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:04.806360 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:04.807996 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:04.808957 24249 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:04.816582 28432 raft_consensus.cc:3055] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:04.817183 28432 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:04.820042 28446 raft_consensus.cc:3055] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:04.820616 28446 raft_consensus.cc:740] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:04.826217 24171 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:04.830590 28271 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:04.831527 28271 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:04.839470 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:04.822149 28446 consensus_queue.cc:260] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:04.851395 24169 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:04.853360 24811 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:04.856396 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 2190) took 1299 ms. Trace:
I20260709 12:19:04.857667 24249 raft_consensus.cc:1275] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:04.858206 28461 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:04.858853 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:04.859581 24099 pending_rounds.cc:85] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 11
I20260709 12:19:04.869793 24099 pending_rounds.cc:107] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:19:04.867380 24250 rpcz_store.cc:276] 0709 12:19:03.556539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:03.556676 (+   137us) service_pool.cc:224] Handling call
0709 12:19:04.855957 (+1299281us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54000b59d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:04.856185 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1860170496}
W20260709 12:19:04.842938 28218 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.798s	user 0.011s	sys 0.012s
I20260709 12:19:04.870112 24099 raft_consensus.cc:2889] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:04.883124 24097 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:04.886479 28271 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:04.818708 28432 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.890336 28432 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:04.897764 28221 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:04.883605 28218 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.901870 28218 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:04.903076 24175 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:04.869289 28461 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:04.902652 24101 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.911753 24171 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 6. Current term is 7. Ops: []
I20260709 12:19:04.915731 28446 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:04.913964 24171 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:04.923564 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:04.924250 28324 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:04.924685 24092 raft_consensus.cc:606] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:04.928773 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:04.932097 24245 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:04.937110 28352 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.941331 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:04.926498 28461 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:04.947089 24168 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:04.948290 28461 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:04.952327 28391 consensus_meta.cc:287] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.714s	user 0.015s	sys 0.005s
I20260709 12:19:04.952943 28391 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.954264 24173 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:04.956702 28391 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:04.958176 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.958355 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:04.959550 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:04.961279 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:04.962091 24100 raft_consensus.cc:3055] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:04.962452 24100 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:04.963485 28439 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:04.964041 28439 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:04.965678 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:04.965341 28439 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:04.966652 28439 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:04.968086 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:04.969609 28284 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:04.987128 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:04.999431 24066 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:04.981560 28352 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:05.001722 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:05.019632 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.025173 24100 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.026880 24100 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:05.028559 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.030839 24098 raft_consensus.cc:2368] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11.
I20260709 12:19:05.023044 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:05.037583 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 252820us
I20260709 12:19:05.040517 24092 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:19:05.050191 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:05.059790 28302 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:05.047456 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:19:05.095744 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 60266.6us
I20260709 12:19:05.100227 24249 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:19:05.092075 24066 leader_election.cc:400] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12.
I20260709 12:19:05.110611 24066 leader_election.cc:403] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:19:05.112625 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:05.116667 24245 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.095875 24214 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:05.121897 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 79743.3us
I20260709 12:19:05.155902 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:05.157016 24249 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
W20260709 12:19:05.173858 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 95864.4us
I20260709 12:19:05.179286 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:05.153861 28184 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12.
W20260709 12:19:05.201054 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 188280us
W20260709 12:19:05.210129 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.213420 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:05.118283 28333 consensus_queue.cc:1048] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.123s
W20260709 12:19:05.223654 28476 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:19:05.227042 28451 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:19:05.227320 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 127968us
I20260709 12:19:05.229269 28459 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:05.229655 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:05.231249 28184 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:05.232399 28184 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:05.235271 28282 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:05.235831 28282 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:05.237090 28282 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.246619 24241 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:05.255311 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:05.256276 24249 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:05.238863 28282 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.204651 28218 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:05.260121 28218 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.261721 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:05.266559 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 90789.3us
I20260709 12:19:05.234705 28184 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:19:05.271811 24140 leader_election.cc:400] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11.
I20260709 12:19:05.272277 24140 leader_election.cc:403] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:19:05.275619 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 83277.7us
I20260709 12:19:05.278486 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:05.230060 28459 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:05.276669 24100 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:05.283931 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:05.262670 28218 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:05.288826 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 59299us
I20260709 12:19:05.291953 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:05.316994 28447 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11.
I20260709 12:19:05.326670 24101 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
W20260709 12:19:05.330435 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:05.333989 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:05.341506 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.344527 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:05.337707 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:19:05.355074 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.370276 28391 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:05.355969 28459 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.329692 28218 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:05.333192 28284 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:05.395241 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.395025 28284 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:05.397022 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 183198us
I20260709 12:19:05.397955 28284 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:05.401687 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:19:05.420764 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 94009.4us
I20260709 12:19:05.424206 24093 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:05.427995 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.454631 24101 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:05.461514 24245 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:05.469223 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:05.470599 28406 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:19:05.475476 24094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.056s	sys 0.032s
W20260709 12:19:05.475919 24094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.056s	sys 0.032s
I20260709 12:19:05.415942 28218 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.481983 24248 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:05.483587 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 156952us
W20260709 12:19:05.511767 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 113590us
I20260709 12:19:05.487277 28406 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:19:05.522418 28335 consensus_meta.cc:287] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.716s	user 0.019s	sys 0.002s
W20260709 12:19:05.526726 28432 consensus_meta.cc:287] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.636s	user 0.014s	sys 0.004s
I20260709 12:19:05.542841 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:05.539876 28352 consensus_meta.cc:287] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.005s
I20260709 12:19:05.556638 28292 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.557396 28292 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:05.561069 24169 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:19:05.559711 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57070.5us
I20260709 12:19:05.529449 28406 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.559059 28398 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:05.586885 28398 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.594719 28218 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:05.599387 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 71825.6us
I20260709 12:19:05.598223 28335 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:19:05.600597 28488 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:05.600811 24168 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:19:05.606585 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:05.615271 28482 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.175s	user 0.002s	sys 0.000s
I20260709 12:19:05.556643 28155 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:19:05.628446 28398 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:05.629331 28398 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:05.603559 28461 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.655s	user 0.008s	sys 0.011s
I20260709 12:19:05.570735 28317 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:19:05.640633 28429 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:05.641356 28429 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:05.638087 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 125891us
I20260709 12:19:05.643777 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:05.647370 28352 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:05.653487 28352 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:05.655221 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.656256 28218 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:05.656934 28218 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:05.660593 24140 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:05.663107 28352 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:05.631795 28406 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:05.664628 24216 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:05.670379 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 68439.6us
I20260709 12:19:05.668500 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:05.668241 24140 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:05.674055 28432 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:05.676399 28218 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:05.630242 28398 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.677642 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:05.680922 28488 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:05.684777 28439 consensus_meta.cc:287] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.703s	user 0.017s	sys 0.000s
W20260709 12:19:05.719429 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:05.692198 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 171721us
I20260709 12:19:05.684852 28432 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.686731 28352 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:05.691098 28406 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:05.693548 28218 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:05.763738 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.762997 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.760362 28432 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:05.774729 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.768270 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:05.761919 28317 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.764217 28406 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:19:05.789347 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 97315.6us
I20260709 12:19:05.791679 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.771392 28218 raft_consensus.cc:697] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:19:05.798264 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 119801us
I20260709 12:19:05.795436 24098 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
W20260709 12:19:05.801116 28484 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:19:05.797559 28352 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:05.805164 28352 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.791324 28284 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:05.807454 28497 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:05.807756 28284 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.808270 28497 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:05.810664 28317 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:05.795287 28495 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:05.812647 28495 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:05.788062 28429 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:05.816371 28218 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.789825 28406 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:05.820284 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:05.821604 28488 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:05.845674 28500 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:05.839973 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49333.4us
I20260709 12:19:05.849758 28495 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:05.850654 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.851600 24094 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:05.853446 28352 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:05.859301 28292 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:05.858669 28485 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.288s	user 0.009s	sys 0.009s
I20260709 12:19:05.867889 28302 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:05.868057 28398 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:05.868516 28302 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:05.824471 28429 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:05.878949 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:05.885244 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 194462us
I20260709 12:19:05.885437 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.891206 28398 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:05.891040 28429 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.874119 28284 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:05.891894 28398 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:05.893843 28429 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:05.894282 28398 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:05.895103 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:05.896842 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 74907.2us
I20260709 12:19:05.897749 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:05.900910 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:05.901758 28398 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:05.902124 28398 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:05.902508 28398 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:05.907984 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.908948 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.884640 28317 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:05.929502 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:05.932212 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:05.883267 28461 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:05.883723 28500 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:05.942209 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:05.954058 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:05.973831 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.913609 28292 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:19:05.979144 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:05.929653 28439 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:05.937274 28317 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:05.944836 28488 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:05.990849 24095 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:05.945235 28502 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:05.999694 28489 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.000280 28489 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.003176 24812 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:06.003724 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.004565 24170 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
W20260709 12:19:06.004669 28480 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.666s	user 0.000s	sys 0.003s
I20260709 12:19:06.010486 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2698) took 1153 ms. Trace:
I20260709 12:19:06.010921 24099 rpcz_store.cc:276] 0709 12:19:04.857134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.859053 (+  1919us) service_pool.cc:224] Handling call
0709 12:19:04.859377 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:04.899240 (+ 39863us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:04.899279 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:04.899815 (+   536us) log.cc:844] Serialized 26 byte log entry
0709 12:19:05.167398 (+267583us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:05.167458 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.167551 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:06.003764 (+836213us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:19:06.010126 (+  6362us) raft_consensus.cc:1685] finished
0709 12:19:06.010152 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:06.010410 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":81464576,"thread_start_us":266994,"threads_started":1,"wal-append.queue_time_us":384745}
I20260709 12:19:06.013020 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:19:06.018217 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 75755.7us
I20260709 12:19:06.019654 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:05.979005 28461 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.025660 28461 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:06.027243 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:06.027962 24812 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:19:06.033123 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.036363 28503 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:06.038051 28503 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:06.044526 24215 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:06.053011 24098 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 13. (term mismatch)
I20260709 12:19:06.053491 24098 pending_rounds.cc:85] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 12
I20260709 12:19:06.053759 24098 pending_rounds.cc:107] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 12.13
I20260709 12:19:06.054013 24098 raft_consensus.cc:2889] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:06.055171 28461 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:06.055495 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.055776 28461 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.056334 28497 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:06.056829 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.057668 28497 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:06.058115 28497 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:06.058171 28461 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:06.059415 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 81019.2us
I20260709 12:19:06.028182 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.002830 28489 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.076846 24215 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:06.029621 28459 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.058590 28497 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:06.088137 28317 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:06.088863 28317 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:06.089351 28317 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:05.988309 28500 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:05.998517 28439 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.136536 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.130795 24781 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:06.147382 28274 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:06.067433 28456 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:19:06.030735 28502 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.077385 28432 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.114068 28302 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.155589 28274 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:06.163419 28274 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:06.163946 28456 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:06.164405 28456 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:06.164887 28302 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.165459 28456 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.167317 28249 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:06.168026 28249 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.170293 24172 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:19:06.170500 28249 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:06.170703 24172 pending_rounds.cc:85] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 5
I20260709 12:19:06.138247 28155 consensus_queue.cc:1059] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:19:06.172313 28495 raft_consensus.cc:3055] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:06.172216 28406 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.172812 28495 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:06.172820 28273 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:06.173800 28273 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.173919 28495 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.175479 28495 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:06.176945 28432 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.179366 24175 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:06.182087 28273 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:06.171126 24172 pending_rounds.cc:107] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:19:06.101637 28459 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.183183 24172 raft_consensus.cc:2889] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:06.185079 28459 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:06.189749 28500 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.191648 28488 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.207355 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:06.208508 24101 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 11: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:06.174710 28406 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:06.212406 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.215374 28439 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.206168 28456 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:06.210492 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:06.244642 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:06.245123 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.247838 24245 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:06.144095 28398 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.259361 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:06.258807 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:06.257283 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:06.266186 24170 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:06.267267 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:06.268282 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 57923.5us
I20260709 12:19:06.272382 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:06.273597 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 252125us
I20260709 12:19:06.275720 24099 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:06.276873 24176 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:06.279919 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:06.268642 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:06.309866 24173 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:06.321213 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:06.239718 28500 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:06.268023 28218 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:06.331758 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.334019 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.337113 24173 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:19:06.278661 28302 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.342023 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.335294 24100 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:19:06.337143 24170 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:06.348277 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.321276 28495 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:06.368852 28352 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:06.382578 28493 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.691s	user 0.002s	sys 0.002s
I20260709 12:19:06.401693 28353 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:06.419546 24813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 649) took 1004 ms. Trace:
I20260709 12:19:06.420133 24813 rpcz_store.cc:276] 0709 12:19:05.421493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.427354 (+  5861us) service_pool.cc:224] Handling call
0709 12:19:05.445428 (+ 18074us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:05.445786 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.445825 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:05.449552 (+  3727us) log.cc:844] Serialized 26 byte log entry
0709 12:19:05.529103 (+ 79551us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:19:05.529163 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:05.529273 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:06.381439 (+852166us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:19:06.419050 (+ 37611us) raft_consensus.cc:1685] finished
0709 12:19:06.419088 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:06.419448 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66723584,"thread_start_us":78932,"threads_started":1,"wal-append.queue_time_us":189830}
I20260709 12:19:06.369844 28352 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.426726 28352 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:06.332836 28504 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:06.335487 28507 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:06.342784 28155 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:06.338284 28502 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:06.452833 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.455374 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:06.452167 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 312806us
I20260709 12:19:06.470886 24247 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:06.473130 24172 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:06.452277 28459 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.504987 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.508018 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:06.469750 28432 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:06.458629 28324 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:06.470512 28406 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:06.513813 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 239433us
I20260709 12:19:06.515539 24141 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:06.349316 28218 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.353613 28500 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.524479 24141 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:06.525645 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:06.528028 24066 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:06.496006 28284 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:06.521010 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.529841 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.501082 28282 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.491405 28302 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:06.593806 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:06.595710 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 260978us
I20260709 12:19:06.599786 28432 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:06.604377 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46482.1us
I20260709 12:19:06.497490 28504 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:06.587157 28484 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:19:06.495716 28155 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.528952 28512 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:06.528566 28406 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.554405 28268 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:06.609928 28317 consensus_meta.cc:287] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.520s	user 0.015s	sys 0.000s
I20260709 12:19:06.520008 28459 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.500066 28507 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.533227 28324 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.588716 28488 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:06.621711 28432 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.644078 24813 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:19:06.623899 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 200170us
I20260709 12:19:06.602537 28292 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.607223 28502 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:06.629655 24175 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:06.614809 28284 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:06.588356 28282 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.619340 28398 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:06.644337 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:06.644198 24176 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:06.625028 28520 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:19:06.693900 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 81031us
I20260709 12:19:06.646569 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:06.643774 28217 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:19:06.698386 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 78635.3us
W20260709 12:19:06.627746 28463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.021s	sys 0.035s
W20260709 12:19:06.697820 28274 consensus_meta.cc:287] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.534s	user 0.015s	sys 0.000s
I20260709 12:19:06.628042 28317 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.740897 24167 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:06.679949 28228 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:19:06.626291 28268 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.699695 28217 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:19:06.711194 28463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.323s	user 0.024s	sys 0.046s
I20260709 12:19:06.685329 28292 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.759431 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:06.758976 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57411.4us
I20260709 12:19:06.687587 28284 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.792879 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:19:06.794466 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 95111.8us
I20260709 12:19:06.800575 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.804939 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.699537 28488 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:19:06.808012 24093 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 14: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:06.745770 28353 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:06.760043 28217 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:06.819582 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:06.822973 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:06.823662 24244 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:06.828343 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:06.829246 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:06.811642 24808 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:19:06.795363 28352 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:06.741176 28274 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.810184 28218 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.863541 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.867947 24241 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:06.861825 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:06.843886 28521 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:19:06.869511 24093 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:19:06.703830 28520 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.886230 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:06.843602 28302 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.887836 24249 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
W20260709 12:19:06.888780 28524 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.297s	user 0.000s	sys 0.002s
I20260709 12:19:06.893060 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:06.900002 28218 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.900712 28218 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.901062 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:06.883715 28497 consensus_meta.cc:287] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.802s	user 0.009s	sys 0.007s
I20260709 12:19:06.902671 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.892352 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:06.912406 24176 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:06.925895 24097 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:06.878935 28505 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:06.882491 28500 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.933620 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:06.931506 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.936321 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:06.938453 24169 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:06.934891 24098 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:06.828145 28353 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:06.870802 28352 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.945802 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.938970 24249 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:06.907069 28535 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.918365 28406 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:06.949098 24092 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:06.949416 24100 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:06.914028 28504 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:06.950800 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 114392us
I20260709 12:19:06.951730 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.928180 28543 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:06.955509 24097 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:06.975478 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 1967) took 1038 ms. Trace:
I20260709 12:19:06.936559 28324 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.932578 28155 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:06.980278 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:06.963239 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:06.987890 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.978426 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:06.943765 28500 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:06.975968 24167 rpcz_store.cc:276] 0709 12:19:05.937282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.951452 (+ 14170us) service_pool.cc:224] Handling call
0709 12:19:05.979553 (+ 28101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:06.745402 (+765849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.962038 (+216636us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54003f9154. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:19:06.975404 (+ 13366us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1379194112}
I20260709 12:19:06.996029 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:07.003362 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.004189 24241 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:07.005244 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.005370 28553 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.006068 28553 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.010244 28543 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:06.954272 28282 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:07.011642 28545 log.cc:927] Time spent T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260709 12:19:07.012981 28549 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.013762 28549 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.014361 28542 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:07.015384 28511 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.015091 28542 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.015928 28511 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.016695 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:07.017771 28302 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.018321 28511 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.019266 28507 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:07.021225 28518 log.cc:927] Time spent T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.265s	user 0.000s	sys 0.001s
I20260709 12:19:07.022076 28500 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.022872 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 904) took 1144 ms. Trace:
I20260709 12:19:06.939459 28505 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.023751 28268 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.024480 28542 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:07.003257 28531 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:07.024991 28284 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.025295 28520 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.960922 28398 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:19:07.025967 28505 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:06.978422 28535 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.005244 28317 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:07.006492 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:06.951730 28548 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.027456 24241 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:19:07.027581 28548 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.028261 28535 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.028412 28353 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.028528 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:07.029186 24241 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:06.928393 28497 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.030224 28548 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:07.019266 28529 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:19:07.031459 28497 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:07.032796 24250 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
W20260709 12:19:06.977993 28515 log.cc:927] Time spent T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.275s	user 0.001s	sys 0.001s
I20260709 12:19:07.034228 28274 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:06.990083 24216 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:07.036140 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2723) took 1082 ms. Trace:
I20260709 12:19:07.036348 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.032891 28500 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.006444 28292 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.037336 24098 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:07.023375 24168 rpcz_store.cc:276] 0709 12:19:05.878439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.879019 (+   580us) service_pool.cc:224] Handling call
0709 12:19:05.908412 (+ 29393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:05.919567 (+ 11155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.919597 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:05.976812 (+ 57215us) log.cc:844] Serialized 501 byte log entry
0709 12:19:06.323571 (+346759us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:06.323616 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.323699 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:07.022579 (+698880us) raft_consensus.cc:1685] finished
0709 12:19:07.022608 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.022770 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":297134,"threads_started":1,"wal-append.queue_time_us":648064}
I20260709 12:19:07.051512 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:07.067088 24812 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:06.945525 28218 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:07.003118 28514 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:19:07.094239 24245 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:07.095965 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.102362 24244 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
W20260709 12:19:07.096884 24173 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.574s	user 0.013s	sys 0.000s
I20260709 12:19:07.036682 24094 rpcz_store.cc:276] 0709 12:19:05.953528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:06.026668 (+ 73140us) service_pool.cc:224] Handling call
0709 12:19:06.052699 (+ 26031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:06.053142 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:06.053167 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:06.053809 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 12:19:06.333377 (+279568us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:19:06.333444 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.333550 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:07.035829 (+702279us) raft_consensus.cc:1685] finished
0709 12:19:07.035861 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.036040 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5788,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":130,"spinlock_wait_cycles":6912,"thread_start_us":279067,"threads_started":1,"wal-append.queue_time_us":571401}
I20260709 12:19:06.954468 28459 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.105795 24173 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
W20260709 12:19:07.110158 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 120217us
W20260709 12:19:07.109722 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 201622us
I20260709 12:19:07.116317 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:07.117758 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:07.118453 24813 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:07.105172 28284 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:07.129268 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:07.108919 28552 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.129913 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:07.135886 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:07.163597 24813 raft_consensus.cc:2368] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:19:07.163251 28284 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.165836 28284 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:07.119828 28535 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:07.162474 28552 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.175601 24241 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:19:07.177865 28552 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.147512 28556 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:07.132674 28548 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:19:07.154549 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2715) took 1385 ms. Trace:
I20260709 12:19:07.180727 24096 rpcz_store.cc:276] 0709 12:19:05.769111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.769323 (+   212us) service_pool.cc:224] Handling call
0709 12:19:05.784207 (+ 14884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:05.798042 (+ 13835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:05.798089 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:06.036504 (+238415us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b2c000014c8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2
0709 12:19:06.036993 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 12:19:06.340788 (+303795us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:06.340833 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.340930 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:07.154131 (+813201us) raft_consensus.cc:1685] finished
0709 12:19:07.154165 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.154457 (+   292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9682,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":7710,"spinlock_wait_cycles":15471872,"thread_start_us":303346,"threads_started":1,"wal-append.queue_time_us":499929}
I20260709 12:19:07.018337 28302 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:07.156126 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.157804 28217 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.184685 24093 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:07.185187 28302 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:07.186638 28217 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:07.189850 28523 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.504s	user 0.003s	sys 0.001s
I20260709 12:19:07.192564 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 909) took 1174 ms. Trace:
I20260709 12:19:07.193049 24171 rpcz_store.cc:276] 0709 12:19:06.018526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:06.018714 (+   188us) service_pool.cc:224] Handling call
0709 12:19:06.019088 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:06.247836 (+228748us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:06.247868 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:06.278413 (+ 30545us) log.cc:844] Serialized 26 byte log entry
0709 12:19:06.846712 (+568299us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:19:06.846827 (+   115us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.192059 (+345232us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54003eb2d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:19:07.192121 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:07.192181 (+    60us) raft_consensus.cc:1685] finished
0709 12:19:07.192197 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.192481 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10399,"raft.queue_time_us":116545,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":125170,"spinlock_wait_cycles":468689792,"thread_start_us":390459,"threads_started":1,"wal-append.queue_time_us":681075}
W20260709 12:19:07.196101 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66941.1us
I20260709 12:19:07.199227 28556 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.200043 28543 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.207032 28249 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.207677 28249 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.211426 28249 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.214001 23999 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 9 to 11, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.216142 23999 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 10, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.218062 23999 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:07.220280 28352 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.220932 23999 catalog_manager.cc:5697] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.124990 28463 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:07.227521 28463 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.237751 24812 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:19:07.253789 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:07.253789 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 554) took 1014 ms. Trace:
I20260709 12:19:07.255383 24250 rpcz_store.cc:276] 0709 12:19:06.238923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:06.239073 (+   150us) service_pool.cc:224] Handling call
0709 12:19:07.253577 (+1014504us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b54000b81d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:07.253694 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1727289088}
W20260709 12:19:07.255851 28537 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.450s	user 0.000s	sys 0.006s
I20260709 12:19:07.262321 28553 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.264286 28549 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.265388 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.266249 24171 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:19:07.270143 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 550) took 1041 ms. Trace:
I20260709 12:19:07.270188 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:07.271438 24171 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.270596 24242 rpcz_store.cc:276] 0709 12:19:06.228733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:06.228861 (+   128us) service_pool.cc:224] Handling call
0709 12:19:06.254307 (+ 25446us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:19:06.279471 (+ 25164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:06.279521 (+    50us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:19:06.345239 (+ 65718us) log.cc:844] Serialized 52 byte log entry
0709 12:19:06.648437 (+303198us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:19:06.901985 (+253548us) spinlock_profiling.cc:243] Waited 6.8 ms on lock 0x7b1800184ea0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248b455 00007f4c08f733c7 00007f4c055859a7 00007f4c055950bf
0709 12:19:06.902155 (+   170us) log.cc:844] Serialized 14 byte log entry
0709 12:19:06.908003 (+  5848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:06.908121 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:07.249960 (+341839us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b1800184ea0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db
0709 12:19:07.250557 (+   597us) spinlock_profiling.cc:243] Waited 5.89 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:19:07.269755 (+ 19198us) raft_consensus.cc:1685] finished
0709 12:19:07.269781 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.269946 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22644,"prepare.queue_time_us":116194,"prepare.run_cpu_time_us":68,"prepare.run_wall_time_us":69,"raft.queue_time_us":70309,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":21838,"spinlock_wait_cycles":56702720,"thread_start_us":295132,"threads_started":2,"wal-append.queue_time_us":339055}
I20260709 12:19:07.291098 23999 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 10, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.292223 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:07.293589 23999 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.295213 28335 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.296424 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:07.294556 28259 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:07.297902 24171 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:19:07.295439 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:07.286607 24215 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:07.300870 24215 leader_election.cc:400] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:19:07.301218 24215 leader_election.cc:403] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:19:07.302032 24215 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:07.303013 28549 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:07.303426 28549 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.303803 28549 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.298894 23999 catalog_manager.cc:5697] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 9 to 12, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 12 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.307835 28335 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:07.309430 23999 catalog_manager.cc:5697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 9, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:07.310427 28495 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:07.314818 23999 catalog_manager.cc:5697] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:07.315733 28495 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:07.322065 23999 catalog_manager.cc:5697] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:07.322346 28495 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.323576 23999 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 11, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:07.307333 28553 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.350052 28292 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index 5 to 7, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:07.355548 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:07.360132 28352 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:07.362322 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:07.338132 23994 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 211) took 13248 ms (client timeout 15000 ms). Trace:
W20260709 12:19:07.365777 28456 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.118s	user 0.013s	sys 0.002s
I20260709 12:19:07.334055 24141 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:07.432961 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 98998.8us
W20260709 12:19:07.367918 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47213.5us
I20260709 12:19:07.230659 28463 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:07.404820 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52034.3us
W20260709 12:19:07.407394 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 490155us
I20260709 12:19:07.441802 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:07.451333 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:07.453495 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:07.454723 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:07.445788 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 83623.1us
I20260709 12:19:07.456283 28456 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:07.456499 24216 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:07.456861 28456 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.455528 24242 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:07.457525 28456 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:07.455687 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 339489us
I20260709 12:19:07.460928 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.463069 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.463646 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:07.464751 24244 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:07.463778 24250 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:07.470090 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:07.469385 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:07.481449 28510 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:07.481845 28509 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:07.482077 28510 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:07.482498 28509 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.483240 28459 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:07.484901 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.485843 24168 raft_consensus.cc:2410] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:19:07.450201 28488 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:07.487071 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:07.454214 28543 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.445355 28559 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.495472 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.481472 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.459272 28512 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:07.494606 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.459574 28556 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:07.501739 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.505685 24246 raft_consensus.cc:2410] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:19:07.511485 24216 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:07.513792 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56221.5us
I20260709 12:19:07.482518 28510 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:07.514816 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.515131 24781 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:07.486591 28503 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:07.477871 28504 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.521462 24169 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:07.462903 28502 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:19:07.490090 28488 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:07.494890 28439 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:07.524364 24781 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:07.486758 28548 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:19:07.501029 28512 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.520630 28352 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:07.486141 28447 consensus_queue.cc:1059] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:19:07.550534 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.523007 28503 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.545635 28558 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:19:07.546515 28550 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:07.533883 28488 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:07.559199 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.561192 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.558238 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.561316 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.562110 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.583799 28491 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:07.656708 24096 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 6.
I20260709 12:19:07.656890 28491 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.556362 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.657392 28491 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:07.657788 24100 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:07.543778 28512 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.531987 28504 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.663343 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.508200 28559 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.667744 28559 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.558785 28259 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:07.669997 28259 raft_consensus.cc:697] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:07.670871 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.652902 28551 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:07.672277 28551 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.672561 28456 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.673870 28504 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.550091 28549 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.556504 28503 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.638051 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.638310 28352 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:07.675019 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.675884 28352 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.676580 28549 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:07.637650 28560 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:07.677759 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:07.677639 28560 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.678421 24811 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.680063 28549 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.680595 28549 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.682881 28549 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.643159 28507 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:07.685111 28507 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:07.686055 28507 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.638324 28292 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35632 (request call id 0) took 2791 ms. Trace:
I20260709 12:19:07.552829 28439 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.651623 28509 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.660882 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:07.556264 28550 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.664098 24100 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:19:07.636437 24172 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 5 to 7, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:07.671090 28259 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:07.546962 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:07.554823 28552 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:07.745071 28552 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.686669 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.747238 28507 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:07.747359 28552 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.687034 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.640386 28553 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
W20260709 12:19:07.431774 23994 rpcz_store.cc:269] 0709 12:18:54.090272 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:54.091261 (+   989us) service_pool.cc:224] Handling call
0709 12:19:07.337890 (+13246629us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:04.241270 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:04.429675 (+188405us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:04.429728 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:19:04.429759 (+    31us) tablet.cc:662] Decoding operations
0709 12:19:04.433236 (+  3477us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:04.433307 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:04.433340 (+    33us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:19:04.434166 (+   826us) tablet.cc:701] Row locks acquired
0709 12:19:04.434189 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:19:04.434371 (+   182us) write_op.cc:270] Start()
0709 12:19:04.434515 (+   144us) write_op.cc:276] Timestamp: P: 1783599544434312 usec, L: 0
0709 12:19:04.434544 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:19:04.473179 (+ 38635us) log.cc:844] Serialized 3632 byte log entry
0709 12:19:04.768253 (+295074us) op_driver.cc:464] REPLICATION: finished
0709 12:19:05.041878 (+273625us) write_op.cc:301] APPLY: starting
0709 12:19:05.069238 (+ 27360us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:05.112474 (+ 43236us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557832a 00007f4c054fdf14 00007f4c054fdec3 00007f4c054fde38 00007f4c054fddf3 00007f4c054fd0dc 00007f4c05526e16 00007f4c0550ecbb 00007f4c054f939d 00007f4c054fcd75
0709 12:19:05.307282 (+194808us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:05.316018 (+  8736us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:05.594495 (+278477us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:05.594852 (+   357us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:19:05.594919 (+    67us) write_op.cc:312] APPLY: finished
0709 12:19:05.595475 (+   556us) log.cc:844] Serialized 89 byte log entry
0709 12:19:05.770483 (+175008us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:05.808018 (+ 37535us) write_op.cc:454] Released schema lock
0709 12:19:05.808121 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:05.819392 (+ 11271us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:05.819438 (+    46us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":9614,"reported_tablets":52,"child_traces":[["op",{"apply.queue_time_us":217452,"apply.run_cpu_time_us":59437,"apply.run_wall_time_us":798807,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41765,"num_ops":9,"prepare.queue_time_us":247033,"prepare.run_cpu_time_us":28321,"prepare.run_wall_time_us":530206,"raft.queue_time_us":1068,"raft.run_cpu_time_us":34510,"raft.run_wall_time_us":572134,"replication_time_us":333387,"spinlock_wait_cycles":522588928,"thread_start_us":641119,"threads_started":5,"wal-append.queue_time_us":264034,"wal-append.run_cpu_time_us":4988,"wal-append.run_wall_time_us":2021928}]]}
I20260709 12:19:07.714849 28292 rpcz_store.cc:276] 0709 12:19:04.849153 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:04.849479 (+   326us) service_pool.cc:224] Handling call
0709 12:19:05.022783 (+173304us) log.cc:844] Serialized 501 byte log entry
0709 12:19:05.419236 (+396453us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b18003f8c20. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:19:05.678250 (+259014us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b54008a0aa0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054f0dbe 00007f4c054fb930 00007f4c054fb8d8 00007f4c054fb858 00007f4c054fb813 00007f4c054faa9c 00007f4c0b3e62f6 00007f4c0b3e0aa8 00007f4c055377cb 00007f4c0553a2c0
0709 12:19:07.557910 (+1879660us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":13162,"mutex_wait_us":46606,"raft.queue_time_us":11754,"raft.run_cpu_time_us":1634,"raft.run_wall_time_us":16321,"spinlock_wait_cycles":93134976,"thread_start_us":164328,"threads_started":1,"wal-append.queue_time_us":347495,"wal-append.run_cpu_time_us":6177,"wal-append.run_wall_time_us":1303866}
I20260709 12:19:07.756067 28558 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:07.756632 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 209766us
I20260709 12:19:07.757642 28456 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:07.757779 24066 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:07.758571 28559 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:07.759917 28559 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:07.760983 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 51d85bfbe5fb4a4ba1caf713a20ce874 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:07.742501 28550 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:07.756659 28558 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.764290 28504 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.764894 28504 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.766961 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.768245 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:07.768827 24094 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:07.765646 28558 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.769693 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.772132 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:07.741302 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.744225 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:07.772135 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.774032 24097 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
W20260709 12:19:07.779574 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:07.783154 24811 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:07.788519 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:07.789021 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.750690 28439 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:07.789677 24100 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:07.790638 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:07.792573 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:07.795365 28503 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:07.788004 24214 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:07.798097 24215 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:07.801101 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:07.806408 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.807268 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:07.808867 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.811172 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.772845 28549 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.823727 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:07.813546 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:07.885644 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.934712 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.936460 24101 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:07.919504 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.934957 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.817996 24779 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:07.919361 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.885241 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.855967 24214 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:07.940973 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:07.878587 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.944137 24250 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
W20260709 12:19:07.944497 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 88644.1us
I20260709 12:19:07.797781 28324 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:07.946357 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 133104us
I20260709 12:19:07.949050 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:07.919021 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.792014 28504 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.947889 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 2042) took 1086 ms. Trace:
I20260709 12:19:07.954532 24094 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:07.886199 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.962895 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:07.956822 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 138906us
I20260709 12:19:07.954317 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:07.966511 24167 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:07.810458 28553 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:07.810755 28447 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:19:07.930933 24275 heartbeater.cc:646] Failed to heartbeat to 127.22.93.254:36285 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.22.93.254:36285 timed out after 15.000s (SENT)
I20260709 12:19:07.825404 28525 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:07.968840 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:07.969650 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:07.815763 28548 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:19:08.024174 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44611.1us
I20260709 12:19:07.824575 28391 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:07.946020 24214 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:07.975965 24248 raft_consensus.cc:2368] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:19:07.971235 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:07.967849 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:07.976776 24066 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:07.931283 28456 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.960604 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:08.019261 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.806074 28558 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.169s
I20260709 12:19:07.928447 28560 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:08.025658 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:07.959800 28249 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:08.031875 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:08.032342 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 55868.7us
I20260709 12:19:07.815465 28551 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:08.028975 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 83101.8us
I20260709 12:19:08.042265 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:08.024204 24169 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:07.963873 28502 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:07.807744 28512 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.061076 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:07.856248 28459 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.885123 28535 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.855755 28439 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:07.965036 28268 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:07.979777 28553 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:07.950059 28463 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:07.976578 28504 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:07.950170 28557 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:19:08.025417 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55889.3us
I20260709 12:19:08.078603 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:07.979339 28503 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:07.979322 28447 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:07.822546 28510 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:08.063517 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:08.019752 28495 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:08.030205 28324 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:08.069257 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:08.069379 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:08.033092 28511 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.073263 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:08.073938 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:08.028637 28391 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:08.036337 28406 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:08.039978 28249 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.038139 28548 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:08.056303 28560 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:07.941329 28549 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.062310 28502 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:08.118198 28502 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:08.120028 28549 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:08.068132 28525 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:08.035025 28456 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.125610 28456 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:08.107007 24248 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:19:08.133780 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:08.110968 24094 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:08.107992 24242 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:08.116890 28548 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:08.141062 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:08.142288 28324 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:08.103794 28447 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:08.115716 28488 consensus_meta.cc:287] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.513s	user 0.013s	sys 0.000s
I20260709 12:19:08.080305 28553 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:08.150970 24175 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:08.098846 28335 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:07.966923 24245 rpcz_store.cc:276] 0709 12:19:06.861685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.123483 (+261798us) service_pool.cc:224] Handling call
0709 12:19:07.438156 (+314673us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:07.438455 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:07.508044 (+ 69589us) log.cc:844] Serialized 14 byte log entry
0709 12:19:07.947472 (+439428us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:07.947551 (+    79us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:07.947622 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:07.947715 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:07.947825 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2484,"prepare.queue_time_us":227570,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":5756,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":9502,"thread_start_us":458215,"threads_started":2}
I20260709 12:19:08.157002 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:08.074215 28459 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.085155 28439 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:08.114214 28249 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:08.110603 28391 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:08.078034 28535 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:08.171247 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66844.8us
I20260709 12:19:08.149977 28505 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:08.146977 24241 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:19:08.113373 28495 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:08.105166 28504 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.148664 28406 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.186347 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:08.191316 24246 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:08.166239 28550 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.190076 28406 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:08.197126 28509 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:08.169685 28488 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:08.202716 28352 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.024s	sys 0.010s
I20260709 12:19:08.194126 28505 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:08.315840 24176 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:19:08.237735 28509 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:19:08.293800 28352 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.024s	sys 0.010s
W20260709 12:19:08.326975 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:08.329978 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:08.330960 24170 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:08.331912 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:08.342442 24170 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:19:08.329783 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:08.344324 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:08.346228 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:08.350453 24169 raft_consensus.cc:2368] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:19:08.351483 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:08.352250 24175 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:08.352728 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:08.346424 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 368419us
I20260709 12:19:08.327482 28509 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:08.357226 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:08.353799 24216 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:08.354202 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:08.355798 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:08.346138 28259 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.025s	sys 0.027s
I20260709 12:19:08.344343 28512 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:08.299882 28502 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.389045 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:08.391508 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:08.393287 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:08.449923 28459 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:08.451609 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:08.452297 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:08.452504 24245 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:08.453779 28550 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:08.454187 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:08.452987 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 99287.2us
I20260709 12:19:08.456547 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:08.455757 28504 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:08.457818 28502 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:08.459816 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:08.462165 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:08.462793 24169 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:19:08.480818 28439 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:08.483086 28535 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:19:08.392284 28259 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.025s	sys 0.027s
I20260709 12:19:08.487381 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:08.348377 28508 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.067s
I20260709 12:19:08.359504 28525 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.292659 28324 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.525669 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:08.526624 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:08.486611 24169 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
W20260709 12:19:08.519743 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 543016us
I20260709 12:19:08.528030 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:08.395819 28510 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:08.521595 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:08.425326 28557 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:08.531422 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:19:08.542748 24101 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.023s	sys 0.002s
W20260709 12:19:08.543257 24779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.510s	user 0.005s	sys 0.020s
W20260709 12:19:08.543424 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.015s	sys 0.011s
W20260709 12:19:08.543687 24779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.005s	sys 0.020s
W20260709 12:19:08.543862 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.015s	sys 0.011s
W20260709 12:19:08.544196 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 511501us
I20260709 12:19:08.543336 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:19:08.544658 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 577956us
W20260709 12:19:08.543337 24101 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.023s	sys 0.002s
I20260709 12:19:08.542589 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:19:08.552003 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 509797us
I20260709 12:19:08.557427 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:08.532981 28558 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.562413 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:08.569891 24098 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:08.564563 28552 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:08.566367 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:08.543092 28543 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.008s	sys 0.017s
W20260709 12:19:08.567206 28556 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.021s
I20260709 12:19:08.395399 28505 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.527796 28512 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:19:08.547640 28510 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:08.608477 28510 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:08.609907 28510 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.580971 28535 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:08.574172 28552 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:08.614156 28552 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:08.575238 28459 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:08.628336 24100 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:08.629892 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:08.585600 28574 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 12:19:08.586640 28582 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:19:08.587466 28439 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:08.593502 28488 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:08.561002 28495 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:08.531994 28525 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.666438 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:08.676683 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 110429us
W20260709 12:19:08.679987 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 101898us
W20260709 12:19:08.678301 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 221851us
W20260709 12:19:08.658157 28543 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.008s	sys 0.018s
I20260709 12:19:08.685024 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:08.648864 28491 consensus_meta.cc:287] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.991s	user 0.015s	sys 0.000s
W20260709 12:19:08.677560 28556 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.007s	sys 0.021s
I20260709 12:19:08.708720 28292 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:08.683854 28459 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:08.715071 28292 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:08.716241 28292 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:08.716759 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 556) took 1057 ms. Trace:
I20260709 12:19:08.716991 28459 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:08.677198 28511 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.725936 28511 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.713047 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:08.717355 24243 rpcz_store.cc:276] 0709 12:19:07.661528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.715918 (+ 54390us) service_pool.cc:224] Handling call
0709 12:19:07.716714 (+   796us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:07.770879 (+ 54165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.770920 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:07.772111 (+  1191us) log.cc:844] Serialized 501 byte log entry
0709 12:19:08.186152 (+414041us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:08.186201 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:08.186295 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:08.713371 (+527076us) raft_consensus.cc:1685] finished
0709 12:19:08.713402 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.713586 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":413547,"threads_started":1,"wal-append.queue_time_us":584123}
W20260709 12:19:08.736294 24094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.012s	sys 0.032s
W20260709 12:19:08.737457 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52547.6us
I20260709 12:19:08.763942 24216 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:08.688899 28535 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:19:08.711150 28507 consensus_meta.cc:287] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.963s	user 0.008s	sys 0.007s
W20260709 12:19:08.771227 24094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.012s	sys 0.033s
I20260709 12:19:08.728380 28511 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:08.775367 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:08.717368 28292 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:08.778474 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:08.760780 24067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.019s
I20260709 12:19:08.781395 24099 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
W20260709 12:19:08.784454 24067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.007s	sys 0.020s
W20260709 12:19:08.785189 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 589259us
I20260709 12:19:08.785487 24099 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:19:08.781291 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 234301us
I20260709 12:19:08.789443 24216 leader_election.cc:400] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:19:08.790565 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:08.792547 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:08.793857 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:08.794762 24099 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 6: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:08.751837 28352 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:08.796037 24250 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:08.759807 28459 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:08.796829 24250 raft_consensus.cc:606] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:08.797384 24250 raft_consensus.cc:614] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:08.797456 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:08.798882 24247 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:08.709440 28491 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:08.812493 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:08.818089 28249 consensus_meta.cc:287] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.608s	user 0.012s	sys 0.000s
I20260709 12:19:08.837574 28249 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.822106 28548 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:08.841001 28525 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:08.841517 28249 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:08.836221 28509 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.843173 28491 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:08.843906 28509 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:08.844390 24808 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:19:08.810439 28456 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:08.787092 28586 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:08.849936 28586 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:08.852777 28586 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:08.823369 28535 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.852995 24808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 421) took 1072 ms. Trace:
I20260709 12:19:08.853636 24808 rpcz_store.cc:276] 0709 12:19:07.780060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.790791 (+ 10731us) service_pool.cc:224] Handling call
0709 12:19:08.852666 (+1061875us) spinlock_profiling.cc:243] Waited 989 ms on lock 0x7b540065f254. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:08.852867 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2274875776}
I20260709 12:19:08.797559 28495 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:08.858028 28557 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.807482 28543 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:08.780208 28585 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:08.825961 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:08.863301 28585 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:08.863876 28585 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.864275 28585 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:08.831199 28352 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.892145 28589 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:08.892892 28589 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:08.836510 28406 consensus_meta.cc:287] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.586s	user 0.010s	sys 0.003s
I20260709 12:19:08.820437 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:08.894500 28406 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.896785 24248 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:08.900115 28557 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:08.838195 28447 consensus_meta.cc:287] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.660s	user 0.014s	sys 0.000s
W20260709 12:19:08.839215 28391 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.645s	user 0.006s	sys 0.007s
I20260709 12:19:08.902513 28447 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.902621 28391 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.839326 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 2742) took 1173 ms. Trace:
I20260709 12:19:08.905265 24093 rpcz_store.cc:276] 0709 12:19:07.685835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.720397 (+ 34562us) service_pool.cc:224] Handling call
0709 12:19:07.739539 (+ 19142us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:07.743209 (+  3670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:07.743272 (+    63us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:07.784776 (+ 41504us) log.cc:844] Serialized 26 byte log entry
0709 12:19:08.215689 (+430913us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:08.215732 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:08.215808 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:08.839054 (+623246us) raft_consensus.cc:1685] finished
0709 12:19:08.839096 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.839246 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15362,"raft.queue_time_us":3215,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":112,"thread_start_us":421939,"threads_started":1,"wal-append.queue_time_us":602198}
I20260709 12:19:08.908670 28447 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:08.915792 28552 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:08.862649 24214 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:08.917435 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54886.1us
I20260709 12:19:08.919052 28591 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:08.919637 28591 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.920044 28591 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:08.922312 28543 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:19:08.926621 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 106274us
I20260709 12:19:08.932310 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:08.931798 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:08.949381 24100 raft_consensus.cc:3055] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:08.939198 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:08.949896 24100 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:08.954038 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:08.958053 24171 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:08.961005 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:08.961261 24171 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:08.961931 24094 raft_consensus.cc:2410] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:19:08.963364 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 418481us
I20260709 12:19:08.956180 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:08.964681 24100 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:08.965502 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:08.967167 24100 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:08.969555 28352 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:08.969955 28559 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:08.970436 28559 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:08.973848 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:08.949416 28558 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:08.970799 28559 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:08.975000 28249 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:08.979941 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:08.957062 28509 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:08.957289 28391 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:08.991662 28406 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:19:08.978493 28553 consensus_meta.cc:287] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.793s	user 0.015s	sys 0.001s
I20260709 12:19:08.992698 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:09.046262 24171 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:08.993338 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:08.996717 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 2023) took 1058 ms. Trace:
I20260709 12:19:09.047303 24097 raft_consensus.cc:606] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:19:09.006745 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.029708 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:08.982669 28273 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:09.034665 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.036383 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.057928 24100 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:09.061084 24247 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:09.065865 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:09.066596 24808 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:09.069065 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:09.069329 28558 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:09.047730 28557 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.070809 28557 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.072136 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:09.072800 24170 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.073231 28557 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:09.073786 28589 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:09.054920 28335 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:19:09.075471 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.037505 28509 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:09.076812 28509 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:09.065887 24813 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:09.081040 28597 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:09.052311 24169 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:09.053041 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.083879 24167 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:09.085767 24781 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:09.086661 28586 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:09.089150 24174 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:19:09.107839 24215 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:09.076756 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.110817 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.026036 28317 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:09.091791 24250 raft_consensus.cc:2955] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 5 to 7, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:09.115063 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:09.036806 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 63063.6us
I20260709 12:19:09.053929 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.111559 28543 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:09.045491 28512 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:09.112021 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:09.123056 24173 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:09.103912 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:09.128901 24779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.009s	sys 0.025s
W20260709 12:19:09.135329 24779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.009s	sys 0.025s
I20260709 12:19:09.135970 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:09.137490 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 451516us
I20260709 12:19:09.139052 24066 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:09.139115 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.139881 24173 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:09.070515 28558 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.044844 28249 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:09.155293 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.098554 24170 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:09.157080 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:09.063472 28553 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.162020 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:09.141541 24141 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:09.127739 28543 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.189237 24173 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:19:09.189641 24067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.937s (SENT)
I20260709 12:19:09.192020 24141 leader_election.cc:400] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:19:09.199266 24093 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:09.199923 24141 leader_election.cc:403] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:09.213148 24170 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:09.218628 24171 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:19:09.154551 28512 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:09.160980 28439 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:09.127288 28317 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.227855 24249 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:19:09.227854 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 110260us
I20260709 12:19:09.229382 24176 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:09.188448 28488 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.226918 24781 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:09.208977 28543 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:09.246377 24174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 2000) took 1583 ms (client timeout 1937 ms). Trace:
I20260709 12:19:09.247198 24100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:09.220350 28596 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.247957 24100 raft_consensus.cc:606] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:19:09.250824 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 55774.2us
I20260709 12:19:09.261667 24100 raft_consensus.cc:614] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:09.263304 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:19:09.259209 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 149819us
W20260709 12:19:09.247296 24174 rpcz_store.cc:269] 0709 12:19:07.656559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.657730 (+  1171us) service_pool.cc:224] Handling call
0709 12:19:09.239163 (+1581433us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54002adfd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:09.239282 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432190336}
I20260709 12:19:09.268420 24216 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:09.281484 24066 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:09.284276 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:19:09.287174 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48212.7us
W20260709 12:19:09.287568 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 107924us
I20260709 12:19:09.288345 24141 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:09.241748 28510 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.289566 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:09.242365 28532 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:09.243341 28613 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:09.278633 28551 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:09.312748 24100 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:09.289677 28439 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:09.373148 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:09.374765 24099 raft_consensus.cc:606] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:09.375232 24099 raft_consensus.cc:614] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:09.308629 28292 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.517s	user 0.013s	sys 0.000s
I20260709 12:19:09.292477 28589 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
W20260709 12:19:09.383421 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 193813us
I20260709 12:19:09.316929 28551 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:09.273918 28488 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.304816 28560 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:09.273332 28596 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:09.304550 28608 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:09.308202 28584 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:09.400315 28551 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:09.402690 28607 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:19:09.304338 28510 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.304096 28605 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
W20260709 12:19:09.445178 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 168076us
I20260709 12:19:09.300385 28550 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 12:19:09.445127 24067 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:09.445318 24100 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:19:09.406406 28585 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.542s	user 0.009s	sys 0.004s
I20260709 12:19:09.393498 28606 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:09.448834 28604 log.cc:927] Time spent T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:19:09.385588 28463 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:09.483870 28617 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:19:09.369460 28509 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.387784 28613 raft_consensus.cc:697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:09.308861 28532 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:09.503922 28249 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:09.478966 28630 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.054s	user 0.001s	sys 0.001s
I20260709 12:19:09.403964 28587 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:19:09.514232 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 224729us
W20260709 12:19:09.479023 28610 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:19:09.421627 28488 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:09.405092 28560 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:19:09.494498 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 183056us
W20260709 12:19:09.488822 28616 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
W20260709 12:19:09.522114 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 253774us
W20260709 12:19:09.522224 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:09.526842 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:09.528033 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:09.526126 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:09.486280 28632 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:09.532204 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
W20260709 12:19:09.534189 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44973.5us
I20260709 12:19:09.558007 24216 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:09.404371 28512 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.492651 28535 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:19:09.526801 28553 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:09.558007 24813 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:19:09.529578 28249 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:09.565227 24099 raft_consensus.cc:606] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:09.591454 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:09.509001 28585 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:09.572400 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44472us
I20260709 12:19:09.579216 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.579123 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:09.469803 28608 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:09.550551 28560 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.584215 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:09.588486 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.594342 28273 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:09.600356 28633 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:09.601082 28633 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.600390 28273 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:09.601486 28633 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.601522 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:09.603969 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:09.604333 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 2305) took 1256 ms. Trace:
I20260709 12:19:09.606423 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:09.594919 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:09.608706 24812 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:09.609390 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:09.598531 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:09.586616 28317 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:09.534427 28587 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.604883 24168 rpcz_store.cc:276] 0709 12:19:08.347918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:08.359337 (+ 11419us) service_pool.cc:224] Handling call
0709 12:19:08.474260 (+114923us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:08.523583 (+ 49323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:08.523634 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:08.534807 (+ 11173us) log.cc:844] Serialized 26 byte log entry
0709 12:19:08.981137 (+446330us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:19:08.981187 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:08.981254 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:09.604029 (+622775us) raft_consensus.cc:1685] finished
0709 12:19:09.604065 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:09.604244 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48768,"raft.queue_time_us":54747,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":9907,"thread_start_us":420091,"threads_started":1,"wal-append.queue_time_us":647840}
I20260709 12:19:09.615602 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:09.582026 28636 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:09.622946 24216 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:09.624332 28548 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:09.624539 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:09.626775 24141 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:09.626331 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:09.632268 24812 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:09.625088 28548 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:09.613474 28273 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:09.615864 28488 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:19:09.595917 28249 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.614032 28637 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:09.630807 28406 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:09.631131 28324 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:09.637384 28456 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:09.645645 28636 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:09.676934 28627 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:19:09.679050 28642 consensus_queue.cc:1059] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:19:09.679802 28509 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:09.637009 28463 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:19:09.682129 28608 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:09.685175 28587 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:09.685912 28596 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:09.612188 28613 consensus_queue.cc:237] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:09.645475 28488 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.688683 28488 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:09.689071 28611 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:09.690529 28611 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:09.695201 28637 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.695887 28637 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.680495 28625 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:19:09.716209 28559 consensus_meta.cc:287] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.654s	user 0.010s	sys 0.003s
I20260709 12:19:09.717090 28559 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:09.718127 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 67723.6us
I20260709 12:19:09.718492 24098 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:09.724040 28559 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:09.726959 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:09.713752 28614 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
W20260709 12:19:09.711494 28591 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.791s	user 0.014s	sys 0.003s
I20260709 12:19:09.708267 28611 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:09.654310 28558 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:19:09.654366 28495 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.078s
W20260709 12:19:09.753662 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 441825us
I20260709 12:19:09.700565 28636 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.741498 28643 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.761888 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:09.763419 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:09.764025 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.667945 28640 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.115s
I20260709 12:19:09.768740 24176 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 14: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:09.773705 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:09.774397 24100 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:09.776362 28644 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.776937 28644 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.779150 28317 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.779318 28644 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:09.779771 28317 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.783886 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:09.752686 28510 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:09.798425 28249 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:09.765564 28585 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:09.757741 28636 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:09.770617 28558 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:09.763257 28632 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.729238 28625 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:09.743644 28591 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.783174 28553 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.740643 28548 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.820288 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:09.802309 28637 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:09.800977 28532 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:09.807440 28558 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:09.812110 28317 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:09.837899 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.844903 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.845959 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:09.765884 28643 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.848762 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.849089 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.849943 24243 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:19:09.850109 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:09.818048 28632 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.826504 28510 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:19:09.853420 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:09.868891 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.863404 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:09.882623 24245 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:09.880576 24242 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:19:09.858361 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:09.850823 24241 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:09.851305 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:09.853116 24813 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:09.820479 28553 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:09.853892 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:09.909267 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 55480.2us
I20260709 12:19:09.850880 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.913625 24246 raft_consensus.cc:2368] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12.
I20260709 12:19:09.931975 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:09.932884 24247 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:09.935657 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.917315 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:09.937523 24141 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:19:09.856365 28543 consensus_meta.cc:287] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.596s	user 0.009s	sys 0.005s
I20260709 12:19:09.857843 28635 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:09.941097 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:09.941776 24242 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:09.868290 28509 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:09.864286 28591 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:09.945664 24250 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:09.853649 28652 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:09.913789 28317 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:09.868494 28625 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:09.910915 28597 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:09.939857 28512 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:09.967895 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:09.858850 28503 raft_consensus.cc:3055] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:09.962343 24811 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:19:09.969388 24250 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:09.970307 24141 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:09.047294 24101 rpcz_store.cc:276] 0709 12:19:07.938601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.939402 (+   801us) service_pool.cc:224] Handling call
0709 12:19:07.939707 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:07.939926 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:08.545702 (+605776us) log.cc:844] Serialized 14 byte log entry
0709 12:19:08.981477 (+435775us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:19:08.981526 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:08.981570 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:08.996466 (+ 14896us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:08.996641 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":507999,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"raft.queue_time_us":21750,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":19646,"thread_start_us":955114,"threads_started":2}
I20260709 12:19:09.973296 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:09.973770 24100 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:09.976713 24175 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:09.977167 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.977569 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:09.978767 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:09.981688 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:09.944054 28509 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:09.951270 28652 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:09.980772 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.989521 24095 raft_consensus.cc:2393] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 14: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:09.989650 24168 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:09.952302 28317 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:09.994164 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:09.979403 24174 raft_consensus.cc:2376] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14. Re-sending same reply.
I20260709 12:19:09.995783 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:09.996866 24100 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:09.997915 24214 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:09.986373 28606 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:09.999722 28606 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:10.000214 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:10.000743 28606 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:10.003597 28633 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.005988 28633 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:10.028230 24241 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:09.854305 28558 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.029883 24214 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.047673 24214 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.031052 28656 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:19:10.052299 28643 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:10.052685 28552 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.008342 28317 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:10.035506 28591 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:09.947449 28635 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.059242 28633 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:19:10.063549 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48982us
I20260709 12:19:10.066314 28635 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:10.066442 24098 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:10.067510 28633 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:19:10.067625 28552 consensus_queue.cc:1059] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:10.068949 28552 raft_consensus.cc:3055] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:10.069330 28552 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:10.072808 24170 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 7: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:19:10.079949 24245 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:10.070256 28552 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.087626 28636 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:10.090324 28658 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:19:09.998942 28652 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:09.991166 28503 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:09.948283 28543 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:10.075342 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:10.115635 24249 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 2249) took 2335 ms (client timeout 1923 ms). Trace:
W20260709 12:19:10.116474 28659 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:19:10.117265 28638 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:10.117777 28638 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:10.118629 28638 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:10.116226 24249 rpcz_store.cc:269] 0709 12:19:07.776673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:07.778123 (+  1450us) service_pool.cc:224] Handling call
0709 12:19:10.111570 (+2333447us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400358ed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:10.111729 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3257807744}
I20260709 12:19:10.120257 28638 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.124410 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:10.126082 24098 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:10.128142 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.131052 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.102874 28558 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:09.965480 28597 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:10.123510 28551 consensus_meta.cc:287] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.634s	user 0.007s	sys 0.007s
I20260709 12:19:10.141494 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.148924 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.112349 28552 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:10.155831 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:19:10.135535 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 60267.8us
I20260709 12:19:10.144629 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.150569 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.160153 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:10.164799 24141 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.168453 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:10.169121 24172 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.132818 28509 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.172513 28509 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:10.179589 28510 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:10.180595 28503 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.181767 28503 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.185159 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:10.185774 24094 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.171252 28637 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:19:10.191828 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.194505 24172 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:10.142175 28532 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:10.236042 24094 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:10.201176 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.201483 28611 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:10.249778 28639 log.cc:927] Time spent T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 12:19:10.250296 24098 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:10.251518 28611 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.210146 28553 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:10.162916 28551 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.253213 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:10.254880 28551 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.255663 24099 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:10.256008 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:10.257229 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:10.258320 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:10.213383 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:10.217530 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.220970 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:10.224153 28459 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:10.225728 28317 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:10.192636 28597 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.232076 24097 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:10.233861 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:10.238528 28532 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:10.240288 28543 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:10.195614 28463 consensus_queue.cc:1175] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fa8cfbff90bf4881a56772b05008aadb" responder_term: 11 status { last_received { term: 8 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: [10.6-10.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:10.185808 28642 consensus_queue.cc:1059] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:19:10.242280 28636 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.153612 28525 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:10.153903 28584 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:10.196684 28637 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:10.249436 28560 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.638s	user 0.014s	sys 0.000s
I20260709 12:19:10.254686 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:10.265498 24175 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:19:10.277855 28488 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.589s	user 0.015s	sys 0.000s
I20260709 12:19:10.277412 28459 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.227648 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.293422 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:10.298542 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:19:10.308789 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 144099us
I20260709 12:19:10.309633 24171 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:10.314229 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:19:10.315090 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 118108us
I20260709 12:19:10.280838 28317 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:10.353732 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:10.323419 28643 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.342962 24216 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.336170 24168 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:19:10.361425 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.372135 28592 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:19:10.343039 28637 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:10.385810 28584 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:10.386425 28584 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:10.365204 24175 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:10.328994 24214 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:10.396828 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53967.2us
I20260709 12:19:10.398082 24216 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.345947 28488 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.386901 28584 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:19:10.409613 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 80716.9us
I20260709 12:19:10.355288 28548 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:19:10.349267 28560 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.418556 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:10.402278 28553 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:10.404740 28550 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:10.423795 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:10.428661 24168 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:10.431528 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:10.439301 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:10.443212 24092 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.420051 28532 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.459131 28611 raft_consensus.cc:3055] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:10.459651 28611 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:10.460610 28611 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.461896 28611 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.414916 28543 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:10.473272 28560 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.476301 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:10.477140 24176 raft_consensus.cc:2368] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12.
W20260709 12:19:10.483342 28616 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:19:10.490722 24167 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:10.502689 24172 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:10.529801 24066 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:10.540278 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.542368 24096 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:10.539276 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.470837 28632 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:10.552042 24066 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:10.557334 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:10.557655 28598 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:10.558192 28488 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.557221 24066 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:10.559084 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:10.559604 24066 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:10.560388 28249 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:10.560993 28548 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:10.561982 28654 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:10.563346 28654 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:10.563562 28625 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:10.563730 28654 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:10.564056 28625 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:10.560320 28635 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:10.564857 28635 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.565446 28625 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.566890 28625 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:10.561259 28249 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.564157 28654 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:10.569322 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.515465 28592 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:19:10.577255 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:10.574865 24247 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:10.535842 28543 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:10.581697 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:10.578500 24092 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:10.547376 28552 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:10.586246 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:10.580364 24244 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:10.584736 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:10.588980 24808 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:10.586184 24241 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:10.599273 24094 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:10.567934 28635 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:10.601766 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.604790 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:10.601447 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:10.556454 28638 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:10.605006 24093 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
W20260709 12:19:10.610138 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 248843us
I20260709 12:19:10.616731 24141 leader_election.cc:400] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12.
I20260709 12:19:10.619445 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.622519 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.613467 28635 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:10.635352 28652 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.004s
I20260709 12:19:10.649446 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:10.648345 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50819.7us
I20260709 12:19:10.655009 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.665648 24243 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:10.633828 28636 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:10.645413 28459 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:10.640084 28649 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:10.671496 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:19:10.668574 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.676383 24250 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:10.674317 24241 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:10.679082 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.664803 28558 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:10.680919 24066 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.682204 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:10.686604 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:10.686775 24249 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:10.666887 28503 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:10.669482 28638 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:10.686812 24176 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:10.678683 28636 raft_consensus.cc:697] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:10.700469 28636 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.706707 24099 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:10.709074 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:10.713794 28509 consensus_meta.cc:287] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.541s	user 0.007s	sys 0.005s
I20260709 12:19:10.686053 28324 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:19:10.716372 28324 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:10.716744 28324 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:10.716964 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:10.717849 24172 raft_consensus.cc:2393] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:10.684995 28558 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:10.651080 28635 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.683502 28649 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:10.687911 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:10.717687 28324 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.654063 28652 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.719367 24101 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:19:10.726598 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.730494 24066 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.744781 28637 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.751021 28509 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:19:10.752192 28324 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.756518 28637 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.759517 24175 raft_consensus.cc:1240] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 5. Current term is 6. Ops: []
I20260709 12:19:10.763684 24095 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:10.769521 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:10.770485 24247 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:10.698868 28642 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:10.781368 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:10.783114 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 52743.6us
I20260709 12:19:10.783905 24066 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.786453 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:10.736116 28669 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.095s	user 0.002s	sys 0.002s
W20260709 12:19:10.735884 28670 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.109s	user 0.000s	sys 0.003s
I20260709 12:19:10.728636 28503 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:10.788774 24173 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:10.779603 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:10.789420 24250 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:10.792232 24214 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:10.732260 28558 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.656667 28543 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.793243 28626 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:10.788388 24216 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:10.815913 24216 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:10.819751 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 155134us
I20260709 12:19:10.816772 24249 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:10.790123 28552 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:10.793469 28560 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:10.798339 28249 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:19:10.830489 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 45505.7us
I20260709 12:19:10.735172 28638 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.834834 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:10.844121 24175 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:10.845070 28463 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:19:10.846040 28463 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:10.846385 28463 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:10.847292 28463 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.848522 28463 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:10.854782 28550 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:10.855700 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:10.835501 28624 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:10.835943 28249 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:10.798053 28557 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:19:10.863979 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:10.797823 28525 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:19:10.829710 28273 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:19:10.875113 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 82174.2us
I20260709 12:19:10.888701 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.889989 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:10.876389 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66928.4us
W20260709 12:19:10.877897 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:10.842100 28634 raft_consensus.cc:2764] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 12:19:10.871860 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56092.7us
I20260709 12:19:10.896759 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.871084 28249 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:10.899384 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.883683 28505 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.905062 24779 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:10.892107 28502 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.894217 28611 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:10.919081 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:10.879379 28596 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:19:10.930209 28656 raft_consensus.cc:2764] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:19:10.928027 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.924162 24241 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:10.941459 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:10.943667 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:10.945066 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:10.908577 28597 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:10.894155 28273 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.915537 28613 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:10.917181 28439 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:10.953498 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:10.933147 28634 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:10.960875 24216 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.941342 28560 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:10.889029 28649 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.964211 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:10.951606 28456 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:10.956614 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:10.909518 28503 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:10.968567 24241 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:10.976469 28598 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:19:10.982438 24241 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
W20260709 12:19:10.968078 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52740.3us
I20260709 12:19:10.977723 28686 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:10.970155 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:10.974157 28557 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:10.997249 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:10.967787 28652 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.962643 28439 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.006727 28558 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.007685 24096 raft_consensus.cc:2410] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 12:19:11.009981 28558 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:10.963357 28268 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:19:11.012400 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:11.013463 24247 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:11.014953 24246 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:11.001258 28505 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:11.039695 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:11.042413 28550 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:11.043033 28550 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:11.043468 28550 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:10.978024 28635 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:11.080807 24244 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:11.086874 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 89717us
I20260709 12:19:11.088964 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:11.090687 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:11.067332 28638 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:11.067291 28664 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:19:11.056334 28632 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:10.974561 28560 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:11.102061 28688 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:19:11.095772 28557 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:11.103324 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:11.085582 28684 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
W20260709 12:19:11.105405 28654 consensus_meta.cc:287] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.519s	user 0.012s	sys 0.000s
I20260709 12:19:11.105906 28654 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:11.106885 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:11.107352 24098 raft_consensus.cc:2393] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:11.109417 24098 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:11.111744 24094 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:11.001672 28535 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:19:11.094735 28652 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:11.143873 24098 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:11.139750 28532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.032s	sys 0.033s
I20260709 12:19:11.099555 28632 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:11.113619 28558 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 12:19:11.130625 28543 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:11.152499 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:11.160677 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 156412us
I20260709 12:19:11.134799 28456 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:11.151645 28532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.033s	sys 0.034s
I20260709 12:19:11.168068 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:11.131283 28391 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:19:11.139982 28686 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:19:11.169610 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 164709us
I20260709 12:19:11.148546 28652 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.187812 24067 leader_election.cc:400] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12.
I20260709 12:19:11.189427 24067 leader_election.cc:403] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:19:11.191340 28686 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.169898 28456 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.154788 28690 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:19:11.196599 28502 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:11.207558 28502 raft_consensus.cc:697] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:11.208820 28456 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:11.208674 28502 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.211347 28654 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:11.216673 28439 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:11.229394 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 77032.8us
W20260709 12:19:11.232759 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:11.234028 28584 consensus_meta.cc:287] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.811s	user 0.014s	sys 0.000s
I20260709 12:19:11.234508 28584 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.178874 28550 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.236977 28584 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.237506 28550 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:11.239020 24167 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:11.239233 28249 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.241559 28249 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:11.242230 24241 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:11.242725 24812 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:19:11.245085 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:11.245464 28652 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.250753 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 2344) took 1094 ms. Trace:
I20260709 12:19:11.255434 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:11.255261 24173 rpcz_store.cc:276] 0709 12:19:10.155911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.278603 (+122692us) service_pool.cc:224] Handling call
0709 12:19:10.278915 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:10.808252 (+529337us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:11.250452 (+442200us) spinlock_profiling.cc:243] Waited 510 ms on lock 0x7b54003b10d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:19:11.250658 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1172116864}
I20260709 12:19:11.257170 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:11.261103 28652 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:19:11.267760 28584 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:11.277330 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:11.286010 28624 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:11.287524 28624 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.283712 28463 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.301951 28671 raft_consensus.cc:3055] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:11.303670 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 2787) took 1195 ms. Trace:
I20260709 12:19:11.307631 24092 rpcz_store.cc:276] 0709 12:19:10.104728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.105338 (+   610us) service_pool.cc:224] Handling call
0709 12:19:11.299777 (+1194439us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54002d6ed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:11.299892 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":731075456}
I20260709 12:19:11.309000 28671 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:11.316474 28671 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:11.318215 28463 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.321616 28463 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.323432 24092 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:11.327493 28656 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:11.341856 28701 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.347640 28663 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:11.348579 28663 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:11.342831 28701 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.365219 28273 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.377295 24098 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:19:11.397564 28701 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.410326 28611 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:11.410847 28611 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:11.411381 28560 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.412166 28611 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:11.414083 28611 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:11.415282 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 253824us
I20260709 12:19:11.418303 28684 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:19:11.419359 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 237781us
I20260709 12:19:11.420120 28532 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12.
I20260709 12:19:11.420754 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:11.421928 28696 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:19:11.422079 24067 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:11.423200 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:11.423243 28654 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:11.424129 28654 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:11.421929 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:11.425132 28654 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.430078 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:11.430804 24250 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:19:11.431327 24097 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:11.433938 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:11.434011 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:11.436343 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:11.422820 28632 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.437448 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:11.437688 28632 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:11.438452 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:11.439736 24099 raft_consensus.cc:606] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:11.439613 28532 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:11.440174 24099 raft_consensus.cc:614] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:11.444322 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:11.447561 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:11.449815 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:11.439185 28684 raft_consensus.cc:3055] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:11.458220 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:11.459092 24244 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:11.402109 28663 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.471204 28488 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:11.469871 28317 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:11.457800 28447 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:11.472515 28447 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.473510 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:11.457432 28684 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:19:11.478718 28710 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:19:11.471562 28551 raft_consensus.cc:3055] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:11.478341 28684 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.479242 28551 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:11.480072 28684 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:11.472465 28317 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.480186 28551 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.481796 28551 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:11.483155 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:11.494153 24101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:11.494925 24101 raft_consensus.cc:606] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:11.495400 24101 raft_consensus.cc:614] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:11.465548 28681 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:11.506079 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:11.506160 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:11.508613 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:11.510205 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 62766.4us
I20260709 12:19:11.512614 24242 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:11.512904 24066 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:11.514427 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:11.564486 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45372.8us
I20260709 12:19:11.569481 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:11.571475 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:11.573586 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:11.578814 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:11.569851 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:11.585382 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:19:11.587428 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 74589.1us
I20260709 12:19:11.589298 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:11.592429 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 98758.8us
I20260709 12:19:11.564723 28317 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:11.610321 28598 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:11.619712 28598 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:11.620146 28598 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:11.587693 28605 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:11.623109 28509 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:19:11.635366 24098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30d4ada45d4b4872986993abc4470158"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:11.636163 24098 raft_consensus.cc:606] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:11.636528 24098 raft_consensus.cc:614] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:11.583420 28642 consensus_queue.cc:1059] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:19:11.648008 28642 raft_consensus.cc:3055] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:19:11.648505 28642 raft_consensus.cc:740] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:11.649051 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 2044) took 1062 ms. Trace:
I20260709 12:19:11.649447 28642 consensus_queue.cc:260] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.653697 28605 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.649502 24167 rpcz_store.cc:276] 0709 12:19:10.586757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:10.586906 (+   149us) service_pool.cc:224] Handling call
0709 12:19:10.587247 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:19:11.239491 (+652244us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:11.648789 (+409298us) spinlock_profiling.cc:243] Waited 651 ms on lock 0x7b54002ae4d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:19:11.648976 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498412800}
I20260709 12:19:11.671372 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:11.680980 24101 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:11.681473 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:11.684233 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:11.689282 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:11.690713 24141 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:11.693506 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:11.703542 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:11.713400 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:11.715185 24248 raft_consensus.cc:1240] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:11.716502 24245 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8665b055009a4659b6d86621874dddbd"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:11.658504 28696 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:11.721163 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:11.648067 28447 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.711930 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:11.658674 28596 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:11.688099 28532 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:11.678908 28637 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:19:11.726404 28551 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:11.783944 28605 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.793645 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:11.794661 24242 raft_consensus.cc:2393] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:11.699916 28502 consensus_queue.cc:1059] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:19:11.801254 28502 raft_consensus.cc:3055] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:11.801705 28502 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:11.802627 28502 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.719772 28584 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:11.719653 28558 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:19:11.805871 28633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.051s	sys 0.086s
W20260709 12:19:11.806324 28633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.051s	sys 0.086s
I20260709 12:19:11.809621 24095 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:19:11.801251 28598 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.812458 24098 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:11.812850 28598 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:11.821864 28704 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.430s	user 0.002s	sys 0.000s
I20260709 12:19:11.836305 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:11.749802 28596 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:11.879841 28707 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:11.881688 28553 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:11.882414 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:11.882577 28553 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:19:11.898600 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:11.903465 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:11.903993 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:11.887712 28553 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:11.881994 28596 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.898213 28584 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:11.898381 28633 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:11.908041 28553 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:11.933872 28553 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.935537 28553 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:11.942850 28584 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:11.945405 28584 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:11.950947 28681 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:11.978071 28642 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:19:11.985682 28532 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:11.986492 28532 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:12.012969 28685 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:12.013707 28685 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:12.014955 28685 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:12.015723 28671 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:12.016331 28685 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:12.044749 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 95998.9us
W20260709 12:19:12.053162 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 341372us
I20260709 12:19:12.054581 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.100467 24245 raft_consensus.cc:606] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:12.101148 24245 raft_consensus.cc:614] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:12.100467 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:12.103231 23995 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 11 to 12, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 12 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:12.111074 28626 consensus_queue.cc:1059] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:12.112502 28626 raft_consensus.cc:3055] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:12.112898 28626 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:12.113847 28626 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.114666 28632 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.115228 28632 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.117429 28632 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:12.057770 28701 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.125597 23995 catalog_manager.cc:5697] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 9 to 12, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 12 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:12.128188 23995 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 11 to 13, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 13 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:12.059755 28633 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.139870 23995 catalog_manager.cc:5697] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 9 to 12, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 12 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:12.143149 24245 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:12.152408 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.153381 24245 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:12.153517 24100 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:19:12.148602 23995 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 8 to 10, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:12.144063 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:12.165688 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 75722.5us
I20260709 12:19:12.154507 28626 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:12.151623 28633 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.167784 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.202046 23999 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 194) took 10903 ms. Trace:
W20260709 12:19:12.206401 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 299874us
W20260709 12:19:12.208050 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.166759 28324 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:19:12.211097 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 494494us
I20260709 12:19:12.207083 28463 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.204515 28649 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:12.222450 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:12.228811 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 326148us
I20260709 12:19:12.231599 24779 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.211066 28502 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:12.206069 23999 rpcz_store.cc:276] 0709 12:19:01.298470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:01.301068 (+  2598us) service_pool.cc:224] Handling call
0709 12:19:12.201954 (+10900886us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:07.471473 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:07.472462 (+   989us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:07.472529 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:19:07.472577 (+    48us) tablet.cc:662] Decoding operations
0709 12:19:07.473975 (+  1398us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:07.474140 (+   165us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:07.474183 (+    43us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:19:07.476228 (+  2045us) tablet.cc:701] Row locks acquired
0709 12:19:07.476296 (+    68us) write_op.cc:260] PREPARE: finished
0709 12:19:07.476543 (+   247us) write_op.cc:270] Start()
0709 12:19:07.476759 (+   216us) write_op.cc:276] Timestamp: P: 1783599547476461 usec, L: 0
0709 12:19:07.476795 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:19:07.543583 (+ 66788us) log.cc:844] Serialized 4402 byte log entry
0709 12:19:09.447858 (+1904275us) op_driver.cc:464] REPLICATION: finished
0709 12:19:09.732577 (+284719us) write_op.cc:301] APPLY: starting
0709 12:19:09.740703 (+  8126us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:10.246138 (+505435us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:10.246252 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:10.851244 (+604992us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:10.851550 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:19:10.851603 (+    53us) write_op.cc:312] APPLY: finished
0709 12:19:10.852004 (+   401us) log.cc:844] Serialized 105 byte log entry
0709 12:19:10.874404 (+ 22400us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:10.874581 (+   177us) write_op.cc:454] Released schema lock
0709 12:19:10.874643 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:10.875181 (+   538us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:10.875212 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":818342,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":219077,"apply.run_cpu_time_us":29850,"apply.run_wall_time_us":1163308,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":108278,"prepare.run_cpu_time_us":47879,"prepare.run_wall_time_us":567822,"raft.queue_time_us":472258,"raft.run_cpu_time_us":39313,"raft.run_wall_time_us":323807,"replication_time_us":1909900,"thread_start_us":893830,"threads_started":5,"wal-append.queue_time_us":804016,"wal-append.run_cpu_time_us":23201,"wal-append.run_wall_time_us":2895517}]]}
W20260709 12:19:12.240069 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 328795us
I20260709 12:19:12.244123 24100 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:12.244602 24100 raft_consensus.cc:606] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:12.242141 28638 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.220835 28391 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.236176 28463 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.247375 28732 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:12.262589 28732 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:12.264815 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.220187 28560 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:19:12.268567 28584 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:12.264194 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.274067 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:12.277225 24243 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:12.275038 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:12.272435 28591 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.282742 24247 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:12.285636 24248 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:12.263041 28732 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:12.289549 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.297701 28605 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:12.314047 24094 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:12.317018 28724 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.311480 28605 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.317729 28724 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.319408 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.320046 28605 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:12.320587 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:12.307917 28525 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:12.292817 28335 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.283990 28611 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:19:12.333475 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.308676 28633 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:12.290941 28591 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.345676 24094 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:12.347318 24101 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:12.348901 24099 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:19:12.349502 24245 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:12.354813 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.355616 24101 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:12.342938 28724 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:12.382138 28701 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:12.383111 28701 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.399848 24173 raft_consensus.cc:1275] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:19:12.400440 24173 pending_rounds.cc:85] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 8
I20260709 12:19:12.400671 24173 pending_rounds.cc:107] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:19:12.400871 24172 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:12.401273 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:12.402132 24176 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:19:12.402279 24172 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:12.403450 24170 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.400898 24173 raft_consensus.cc:2889] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:12.404682 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.405866 24169 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:12.354432 28684 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:19:12.407948 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.408612 24099 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:12.410205 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:12.419941 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:12.423939 28605 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:19:12.426076 28591 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:12.428151 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:12.405773 28488 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.428345 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:12.431589 28488 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.433264 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:12.433852 28488 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:12.434478 24216 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:12.438023 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.439618 24170 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:12.439994 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.443405 28656 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:12.463215 28488 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 12:19:12.469660 28728 log.cc:927] Time spent T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260709 12:19:12.455394 28727 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:12.477063 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:12.448206 28591 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:12.448801 28724 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:12.447780 28391 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:19:12.490721 28701 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:12.491405 28391 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:12.491922 28391 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.492277 28391 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:12.503680 28730 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.215s	user 0.004s	sys 0.000s
I20260709 12:19:12.416399 28532 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.507431 28532 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:12.508008 28740 log.cc:927] Time spent T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:19:12.508941 28741 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:19:12.513132 28391 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.447566 28550 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.515578 28391 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:12.515986 24101 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:12.427903 28503 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:19:12.444720 28611 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:19:12.525416 28633 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.526049 28633 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:12.528533 28633 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:12.533183 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:12.548174 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.549150 24099 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:12.551038 24095 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:12.553756 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.554702 24092 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:12.558655 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.559096 24168 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
W20260709 12:19:12.571548 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 89895.3us
I20260709 12:19:12.489455 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:19:12.576545 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 87167.4us
W20260709 12:19:12.554699 28742 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:19:12.579375 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:12.586252 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:12.581858 28391 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:12.590902 28391 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.591297 28391 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.598080 24170 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:12.601615 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:12.602828 24175 raft_consensus.cc:2410] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:19:12.603574 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:12.606025 24171 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 13: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:12.576633 28699 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:12.607196 24067 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.620652 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 2052) took 1044 ms. Trace:
I20260709 12:19:12.612906 24214 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:12.627867 24168 rpcz_store.cc:276] 0709 12:19:11.576557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:11.578459 (+  1902us) service_pool.cc:224] Handling call
0709 12:19:12.620466 (+1042007us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b540037ad54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:12.620579 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142129536}
I20260709 12:19:12.625562 28690 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:12.630333 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:12.584342 28591 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.633137 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.636828 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:12.642217 24094 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:12.642319 24248 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:19:12.635335 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:12.635354 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.643762 24247 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:12.599772 28463 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:12.638680 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:12.565943 28525 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:19:12.627322 28535 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:19:12.621703 28699 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:12.643569 28611 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:12.622109 28273 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:19:12.647639 28642 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:19:12.649272 28503 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.633121 24101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:12.686173 24101 raft_consensus.cc:606] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:12.686590 24101 raft_consensus.cc:614] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:12.600014 28633 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:12.648773 24249 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:12.636484 28690 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.639176 28685 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:19:12.638492 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:12.689515 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:12.650156 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:12.716356 24096 raft_consensus.cc:2393] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:19:12.716849 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 66775.1us
I20260709 12:19:12.727370 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:19:12.729616 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:12.741983 24100 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.744134 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:12.728308 24140 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:12.653601 28556 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:12.657464 28598 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:12.673761 28626 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:12.756522 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:12.715004 28502 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.714380 28690 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:12.718192 28503 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.690897 28463 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:12.777791 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:12.735679 28642 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:19:12.785138 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 172352us
I20260709 12:19:12.648710 28591 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.757390 28556 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.780023 28598 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:12.757004 28652 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:12.715958 28633 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:12.864910 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 75104.7us
W20260709 12:19:12.857501 28744 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:19:12.787201 28503 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:12.955516 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 177892us
I20260709 12:19:12.860741 28591 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:12.787775 28695 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:12.953763 28598 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:12.860088 28732 consensus_meta.cc:287] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.554s	user 0.013s	sys 0.000s
I20260709 12:19:12.847256 28652 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:12.805182 28556 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:12.807013 28734 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:12.783471 28502 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:12.764035 28626 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:12.991137 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:12.993955 28503 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:12.968286 28634 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:12.963972 24100 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:19:13.004278 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:13.009578 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:13.011520 28543 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.012162 28543 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.015143 28543 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:12.956909 28488 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:19:12.988121 28652 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:12.789984 28463 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:12.976800 28691 consensus_queue.cc:1048] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:19:12.978230 28591 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:19:12.988193 28732 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:13.037508 28749 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:12.977259 28695 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.049111 28634 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.112277 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:13.113260 24092 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
W20260709 12:19:13.117451 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 89197us
I20260709 12:19:12.999787 28734 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.132707 28734 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.136976 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:13.137765 24171 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:13.139477 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:13.142418 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.143179 24244 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:13.145520 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:13.149075 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:13.171321 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:13.173677 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:13.116523 28634 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:13.155022 28391 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.005s
I20260709 12:19:13.110666 28626 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:13.204187 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 67370.2us
I20260709 12:19:13.156975 28734 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:13.209177 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:13.170720 28273 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.198659 28502 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:13.224447 28753 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
I20260709 12:19:13.212126 28734 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:19:13.239421 28750 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:19:13.240342 28634 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:13.226290 28633 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:19:13.243165 28756 log.cc:927] Time spent T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:19:13.223533 28273 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.245667 28273 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.218529 28732 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.252007 24093 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:19:13.206952 28391 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.277463 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.278208 24244 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 5.
W20260709 12:19:13.279536 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49249.4us
I20260709 12:19:13.282524 24779 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:13.283391 24066 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:13.234587 28649 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:13.252413 28734 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:13.286319 28754 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.153s	user 0.007s	sys 0.001s
I20260709 12:19:13.295817 28273 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:19:13.299222 28732 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:13.302030 28634 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.310560 28273 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.349030 28273 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.324414 28503 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:13.324831 28752 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:13.366930 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.293812 28556 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.339188 28724 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:13.379443 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 98588.6us
I20260709 12:19:13.372646 24242 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
W20260709 12:19:13.389915 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57462.5us
I20260709 12:19:13.390813 24066 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:13.391256 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 74710.4us
I20260709 12:19:13.345083 28649 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:19:13.391287 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 75620.7us
I20260709 12:19:13.394763 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:13.397681 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:13.398541 28774 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:13.399120 28774 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:13.399559 28774 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:13.400774 24167 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:19:13.340353 28634 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.401583 24169 raft_consensus.cc:2393] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 6: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:13.403465 24247 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:13.370355 28463 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:13.402031 24216 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:13.369463 28695 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.414074 28649 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.396268 28724 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:13.414793 28690 consensus_meta.cc:287] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.627s	user 0.013s	sys 0.000s
I20260709 12:19:13.420250 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.405006 28598 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:13.424408 28598 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.378715 28503 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.427325 28463 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:13.416656 28391 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.388931 28752 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:13.442632 28757 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.210s	user 0.000s	sys 0.001s
I20260709 12:19:13.424870 28598 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:13.422683 28591 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:13.459302 28732 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:13.444646 28556 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:13.454195 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:13.469411 24244 raft_consensus.cc:2393] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:13.474877 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:13.477720 24141 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:13.485319 28503 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.487890 28634 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:13.446632 28690 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:13.465648 28591 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.491544 28591 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:13.502372 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.506213 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:13.509352 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.477239 28391 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.524746 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.522390 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:13.523566 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.505043 28724 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.505442 28690 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:13.522327 28525 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.523757 28684 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:13.545643 28734 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.529388 28391 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.548343 28652 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.549808 28727 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:13.555413 28732 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:13.524669 28488 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:13.579062 28488 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:13.581514 28488 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:13.574038 28727 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:13.583256 28727 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.585067 28727 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:13.601485 28391 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.603689 28652 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.604882 28752 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.605769 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:13.606412 28671 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:13.606858 28671 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:13.607414 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:13.608111 24092 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:13.607872 28671 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.609229 28671 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:19:13.603572 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69372.7us
I20260709 12:19:13.610172 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:13.565896 28525 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.569237 28684 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:13.610965 24100 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 13: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:13.627182 28684 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:13.627763 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:13.628558 28598 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.630772 28598 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.563158 28699 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.632412 28699 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:13.612429 24141 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:13.613538 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.634672 24250 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:13.614354 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:13.636114 24245 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:13.614540 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.637326 24241 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:13.637892 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:13.638617 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:13.639206 24250 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:13.641417 24168 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:13.623447 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:13.614199 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.635264 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:13.638806 24169 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:13.651415 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:13.652245 24170 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:19:13.662463 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:13.623356 28790 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:19:13.675617 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:13.676870 24167 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:13.685448 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:13.686363 24100 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:13.622473 28525 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.623602 28766 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:13.638083 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.699977 24250 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
W20260709 12:19:13.699352 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 43982.6us
I20260709 12:19:13.708662 24066 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:13.709622 24245 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
W20260709 12:19:13.694231 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61473.8us
I20260709 12:19:13.661720 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:13.697186 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:13.693524 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:13.633503 28785 consensus_queue.cc:1175] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "fa8cfbff90bf4881a56772b05008aadb" responder_term: 8 status { last_received { term: 8 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 8 index: 6 } }
I20260709 12:19:13.700007 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:13.624907 28734 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:13.717926 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 56324.2us
I20260709 12:19:13.722729 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:13.728091 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:13.684803 28439 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:13.695430 28552 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:13.748687 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:13.753069 24246 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:13.747172 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:13.754663 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:13.762065 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 50500.2us
I20260709 12:19:13.762940 24214 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:13.773754 24100 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
W20260709 12:19:13.761957 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 56313us
I20260709 12:19:13.722576 28532 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.733958 28695 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:13.738009 28727 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:13.785533 28273 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.786289 28352 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:13.786868 24101 raft_consensus.cc:2368] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:19:13.798848 24141 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:13.799491 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:13.799832 28652 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:13.799986 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:13.800220 24167 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:19:13.800834 28652 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:13.777274 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:13.801819 24249 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:19:13.745622 28525 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:13.802850 28525 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.803296 28525 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:13.752581 28649 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:13.745491 28633 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:13.807452 28695 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:13.811971 28695 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.812249 28727 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:13.813759 28773 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.465s	user 0.000s	sys 0.002s
I20260709 12:19:13.805320 28792 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.815789 28792 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:13.784128 28532 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.822319 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:13.775319 28560 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:13.823467 28560 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:13.823786 28792 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:13.754189 28439 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:13.824851 28560 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:13.807024 28611 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.011s	sys 0.016s
W20260709 12:19:13.826398 28611 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.011s	sys 0.016s
I20260709 12:19:13.764671 28552 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:13.828388 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:13.822296 28633 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.835141 24806 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:19:13.776989 28779 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:13.872849 28642 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:19:13.874311 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 88205.1us
I20260709 12:19:13.887773 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:13.881266 28763 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:13.873654 28642 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.889727 28701 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.873719 28591 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.889333 28752 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:13.885566 28779 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:13.885941 28792 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:13.915161 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:13.919109 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:13.822337 28774 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.921968 24167 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:19:13.922418 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:13.923259 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:13.907049 28691 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:13.933032 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:13.935626 24167 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:19:13.938869 24168 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:13.922101 28752 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.937340 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:13.940069 28727 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.909852 28763 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.924911 28707 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:13.963343 28591 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:13.963765 28525 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.965348 28439 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:13.965813 28707 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:13.966080 28525 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.967347 28774 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.968081 28779 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.969100 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:13.969794 24100 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:13.970605 28532 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.966939 28707 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:13.939479 28691 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:13.977144 28691 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:13.977371 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 2121) took 1288 ms. Trace:
I20260709 12:19:13.977805 24247 rpcz_store.cc:276] 0709 12:19:12.688943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.689194 (+   251us) service_pool.cc:224] Handling call
0709 12:19:13.977158 (+1287964us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b5400358ed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:13.977303 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1592914816}
I20260709 12:19:13.912622 28701 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:13.981112 28701 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.925211 28633 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:13.993569 24100 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:13.995057 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:13.958900 28764 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:14.000473 28763 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:13.923421 28792 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:14.006500 28553 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:14.008848 28764 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.045807 28764 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:14.046442 28553 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:14.059223 28642 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:14.065171 28801 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:19:14.067814 28752 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.075773 28792 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.076977 28552 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:14.078871 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 2066) took 1330 ms. Trace:
I20260709 12:19:14.079308 24173 rpcz_store.cc:276] 0709 12:19:12.748636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:12.748900 (+   264us) service_pool.cc:224] Handling call
0709 12:19:12.749394 (+   494us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:13.585351 (+835957us) spinlock_profiling.cc:243] Waited 1.32 ms on lock 0x7b18003a4bc0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b
0709 12:19:13.585510 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:19:13.585543 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:13.586113 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:19:13.751357 (+165244us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:19:13.751395 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:14.078520 (+327125us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54003f9154. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:19:14.078575 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:19:14.078625 (+    50us) raft_consensus.cc:1685] finished
0709 12:19:14.078649 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:19:14.078804 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150453,"raft.queue_time_us":227905,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"spinlock_wait_cycles":566969600,"thread_start_us":235993,"threads_started":2,"wal-append.queue_time_us":233082}
I20260709 12:19:14.087903 28273 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.091387 28553 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:14.093698 28790 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.312s	user 0.006s	sys 0.002s
I20260709 12:19:14.099408 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.110436 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:14.117182 24100 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:14.118127 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.141342 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.102355 28605 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:14.143882 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.150391 24100 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:14.163195 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:14.143126 28685 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.164283 24092 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.144901 28543 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:14.182590 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.194468 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.155138 28605 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.203920 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.207798 28626 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.212495 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:14.213397 24098 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.218542 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:14.223070 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.212015 24092 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:14.174310 28685 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.229903 24092 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:14.181143 28543 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.231164 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.231889 24097 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:14.236083 24100 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:14.191314 28764 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:14.238461 24140 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.251747 28685 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.252276 28605 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.247752 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.259123 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:14.265623 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:14.270159 28762 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:14.270817 28762 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.272718 24214 leader_election.cc:400] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:19:14.273079 24214 leader_election.cc:403] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:14.273697 28553 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:19:14.274881 28632 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:14.275254 28762 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:14.275580 28632 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.277866 28632 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:14.278887 28543 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:14.280870 28764 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:14.282948 28488 raft_consensus.cc:2764] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:19:14.285530 24098 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:14.286783 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.290302 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.290588 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:14.291296 24171 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:14.292284 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.255246 28701 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:14.298619 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.303613 24171 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:19:14.305090 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:14.305214 28633 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:14.306803 28792 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:14.306583 28633 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.307366 28792 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:14.308363 28792 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:14.313326 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.320086 24093 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:14.316124 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:14.316824 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.324846 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:14.298046 28605 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:14.330914 24140 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:14.107445 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:14.338343 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.339143 28765 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:14.339576 28765 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.339917 28765 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.339977 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.340871 24245 raft_consensus.cc:2393] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:14.341745 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:14.338460 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.302361 28772 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.351181 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.349812 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.350939 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.349030 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:14.352123 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.352813 24167 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:19:14.301357 28691 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:14.319839 28707 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:14.351889 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.329129 28701 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.309011 28633 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:14.357215 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.392655 24171 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:19:14.358940 24169 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:14.353545 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:14.360178 24096 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:14.393128 24216 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:14.365675 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:14.391868 24100 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:19:14.383898 28684 raft_consensus.cc:993] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:14.386152 28626 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 12:19:14.389375 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.406283 24066 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.419960 24092 raft_consensus.cc:2368] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 14. Current term is 15.
I20260709 12:19:14.398522 24094 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:14.380430 28772 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:14.369680 28810 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:19:14.411754 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.415580 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:14.354720 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:19:14.393232 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45183.3us
I20260709 12:19:14.429473 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:14.423414 24140 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.429823 24175 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.428392 23995 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 103) took 9111 ms. Trace:
W20260709 12:19:14.433676 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 80210us
I20260709 12:19:14.435236 28752 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:14.354440 28632 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:19:14.435570 28352 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:14.435698 28752 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:14.436172 28752 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:14.436489 28632 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:14.436195 28352 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:14.436945 28632 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:14.437917 28632 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.357326 28691 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:14.349562 28391 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:19:14.356439 28707 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.359040 28649 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:14.439491 28352 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:14.440817 28697 raft_consensus.cc:1081] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:14.445662 24806 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:14.456802 24244 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:14.440840 28634 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.463055 28649 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:14.464109 28649 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.457690 28352 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.473421 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.473842 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:14.474530 24245 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.477690 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:14.478190 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.479944 24246 raft_consensus.cc:2368] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:19:14.479408 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.484275 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.441330 28684 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.444270 28685 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:14.496409 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:14.495013 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.503469 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:14.511453 24248 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:14.430956 23995 rpcz_store.cc:276] 0709 12:19:05.317358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:05.317705 (+   347us) service_pool.cc:224] Handling call
0709 12:19:14.428318 (+9110613us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:12.315541 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:12.418803 (+103262us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:12.420953 (+  2150us) write_op.cc:435] Acquired schema lock
0709 12:19:12.427564 (+  6611us) tablet.cc:662] Decoding operations
0709 12:19:12.514077 (+ 86513us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:12.514175 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:12.514201 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:19:12.514789 (+   588us) tablet.cc:701] Row locks acquired
0709 12:19:12.514809 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:19:12.514974 (+   165us) write_op.cc:270] Start()
0709 12:19:12.515139 (+   165us) write_op.cc:276] Timestamp: P: 1783599552514920 usec, L: 0
0709 12:19:12.515165 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:19:12.516005 (+   840us) log.cc:844] Serialized 2132 byte log entry
0709 12:19:13.415972 (+899967us) op_driver.cc:464] REPLICATION: finished
0709 12:19:13.579167 (+163195us) write_op.cc:301] APPLY: starting
0709 12:19:13.579274 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:13.591018 (+ 11744us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:13.591148 (+   130us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:13.594643 (+  3495us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:13.594883 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 12:19:13.594939 (+    56us) write_op.cc:312] APPLY: finished
0709 12:19:13.595229 (+   290us) log.cc:844] Serialized 57 byte log entry
0709 12:19:13.596460 (+  1231us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:13.596598 (+   138us) write_op.cc:454] Released schema lock
0709 12:19:13.596645 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:13.597080 (+   435us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:13.597111 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":116691,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":162877,"apply.run_cpu_time_us":8384,"apply.run_wall_time_us":17905,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25037,"num_ops":5,"prepare.queue_time_us":120909,"prepare.run_cpu_time_us":43134,"prepare.run_wall_time_us":467689,"raft.queue_time_us":332446,"raft.run_cpu_time_us":23111,"raft.run_wall_time_us":121512,"replication_time_us":900607,"thread_start_us":706188,"threads_started":4,"wal-append.queue_time_us":507306}]]}
I20260709 12:19:14.515203 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.522148 24141 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.523634 24141 leader_election.cc:400] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:19:14.523955 24141 leader_election.cc:403] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:19:14.495719 28632 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:14.526474 24779 leader_election.cc:400] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 14. Current term is 15.
I20260709 12:19:14.531427 24779 leader_election.cc:403] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:14.527814 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:14.509169 28273 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:14.499080 28391 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:19:14.532960 24101 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.537015 24808 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 12:19:14.441942 28765 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.535634 24067 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:14.538287 24245 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:14.538846 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:14.541397 24067 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:14.543776 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.544564 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:14.536751 28596 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:19:14.533423 28763 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:14.566623 24175 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:14.545491 28611 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:19:14.558876 28352 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:14.593282 28352 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:14.593770 28352 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:14.595528 28779 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:14.563654 28273 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.607023 28752 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.609274 28752 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.543097 28776 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260709 12:19:14.617856 28553 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7.
I20260709 12:19:14.534008 28605 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.582192 24101 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:14.548007 28685 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:14.602766 28765 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.639524 24093 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:19:14.562913 28699 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:14.636956 24250 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:19:14.640654 28685 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:14.647640 28685 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.659025 28685 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.623637 28707 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:14.623461 28611 raft_consensus.cc:697] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:14.700052 28596 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 14. Current term is 15.
I20260709 12:19:14.703771 28611 consensus_queue.cc:237] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.692085 28779 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:19:14.625643 28598 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:19:14.720449 24101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:14.721212 24101 raft_consensus.cc:606] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:14.721612 24101 raft_consensus.cc:614] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:14.663939 28699 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:14.726841 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 228233us
I20260709 12:19:14.723973 28598 consensus_queue.cc:1243] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:19:14.732456 24101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:14.735575 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:14.722515 28779 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:14.736202 24099 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.738372 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:14.739424 24094 raft_consensus.cc:2368] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:19:14.731329 28684 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
W20260709 12:19:14.748276 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 218346us
I20260709 12:19:14.755087 24167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
W20260709 12:19:14.755316 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 224589us
I20260709 12:19:14.755848 24167 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:14.756246 24167 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:14.756799 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:14.757647 28768 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:14.759265 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.759593 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.761428 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.771121 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.771847 24172 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:19:14.773875 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.776063 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:14.778765 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:14.781124 24216 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:14.782848 24216 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:14.779399 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:14.786825 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 231102us
I20260709 12:19:14.787189 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:14.783805 24167 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:14.807126 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 58017.9us
I20260709 12:19:14.807344 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:14.808637 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:14.809695 24245 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:14.800099 28752 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:14.810844 24248 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:14.820779 24249 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:14.820245 24140 leader_election.cc:400] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
I20260709 12:19:14.821693 24140 leader_election.cc:403] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:19:14.823150 24167 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.832959 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:14.786609 28556 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.833796 24249 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:14.837728 28752 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:14.742965 28779 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.797076 28634 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:14.845053 28779 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.845701 28779 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:14.788744 28815 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:14.804926 28598 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:14.813584 28751 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:14.854522 24249 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:14.810837 28764 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:19:14.876081 28685 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:14.879843 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69148.6us
I20260709 12:19:14.855371 28751 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:14.850234 28488 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:19:14.847916 28352 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.860158 28598 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:14.898101 28352 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:14.891633 28681 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:19:14.904429 28772 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:14.905153 24811 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:14.889403 28751 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:14.919616 28699 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.927050 28598 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:14.927995 28752 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10.
W20260709 12:19:14.988593 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 163807us
I20260709 12:19:15.007426 24096 raft_consensus.cc:3055] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:15.007853 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:15.010548 24096 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:15.013815 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:15.015333 24098 raft_consensus.cc:2393] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:15.016466 24101 raft_consensus.cc:606] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:15.016883 24096 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:15.020929 24096 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:15.041544 24167 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:14.930965 28751 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.071161 24099 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:15.094758 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:15.073417 28751 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:15.101609 24100 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:15.091732 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:15.106899 28684 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.123920 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c552e5996384fef9c032a7fda531298"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:15.124251 28684 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.125134 24097 raft_consensus.cc:606] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:15.125641 24097 raft_consensus.cc:614] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:19:15.129446 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 65028.8us
I20260709 12:19:15.149077 28556 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:15.149513 28596 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:15.127193 28817 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:15.233961 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:15.243198 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:15.251585 28724 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.252580 28724 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.255586 28817 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.256875 28317 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:15.257633 28317 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.242502 28543 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:19:15.268205 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 130619us
I20260709 12:19:15.271513 28352 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:15.272173 28352 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:15.273759 28352 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:15.275645 24100 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:19:15.277172 28684 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:15.244112 24097 raft_consensus.cc:606] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:15.277385 28776 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:15.277932 24097 raft_consensus.cc:614] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:15.278203 28543 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.281454 28543 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:15.277957 28611 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:15.285097 28611 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.288437 28317 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:15.258757 28817 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:15.284108 28724 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:15.228093 28596 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:15.294605 28832 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:15.311008 24096 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 12:19:15.316391 24096 pending_rounds.cc:85] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 10
W20260709 12:19:15.319286 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48290.4us
W20260709 12:19:15.317389 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 96250.9us
I20260709 12:19:15.288393 28611 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:15.326424 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 514596us
I20260709 12:19:15.334746 24243 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:15.316776 24096 pending_rounds.cc:107] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 12:19:15.321461 28832 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.350449 24100 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:15.351828 28832 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:15.354493 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:15.355489 24093 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 15: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:15.360134 28632 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:15.361011 28632 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.363756 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:15.367432 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:15.368574 24099 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:19:15.370359 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 303329us
I20260709 12:19:15.370456 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:15.371250 24099 raft_consensus.cc:606] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:15.379616 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:15.384335 24092 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:15.389125 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:15.346468 24096 raft_consensus.cc:2889] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:15.411058 24244 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:15.415935 28707 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 12:19:15.408849 24101 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:15.440182 24250 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:15.440344 24247 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:15.450466 28613 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:19:15.450456 24244 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:15.457593 28835 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:19:15.460692 28273 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:19:15.469169 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 66407.4us
I20260709 12:19:15.471482 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:15.455471 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:15.472584 28596 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:15.490007 28596 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:19:15.490302 28829 consensus_queue.cc:1175] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "729aa4b1ccec48b588c14e67652c61e1" responder_term: 12 status { last_received { term: 10 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: [11.12-11.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:19:15.492234 24249 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:19:15.497822 28632 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:15.511687 28752 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:15.512457 28752 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:15.513636 28752 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.515435 28663 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:19:15.516451 28827 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:15.529932 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:15.538156 28751 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:15.539825 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:15.536971 24247 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
W20260709 12:19:15.568863 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 83184.1us
I20260709 12:19:15.481660 28611 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:19:15.572633 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 140700us
I20260709 12:19:15.584539 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:15.584460 28632 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:15.615089 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:15.615332 28626 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:15.615688 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:15.617158 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:15.618166 28699 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:15.619095 28699 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.618263 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:15.624389 24099 raft_consensus.cc:2368] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:19:15.621869 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:15.621093 24247 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:15.625043 24243 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:19:15.625921 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:15.626636 28779 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:15.627429 28779 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.628177 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:15.628902 24242 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:15.628979 24250 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:15.629937 28779 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:15.608494 28611 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.653636 24214 leader_election.cc:400] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:19:15.654201 24214 leader_election.cc:403] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:15.657567 28317 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:15.638603 28632 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:19:15.663327 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 84167.1us
W20260709 12:19:15.666502 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:15.684525 28686 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:19:15.702527 28632 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.673830 28352 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:19:15.682689 28324 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:19:15.718536 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:15.718864 28695 consensus_queue.cc:1059] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:15.660710 28317 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.727207 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:15.793639 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 51744.6us
I20260709 12:19:15.734100 28699 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:15.802152 24247 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:15.778972 28324 raft_consensus.cc:697] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:19:15.826726 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:15.833817 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 121749us
I20260709 12:19:15.841603 24092 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:19:15.844446 24067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.505s (SENT) [suppressed 1 similar messages]
I20260709 12:19:15.856189 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:15.857287 28611 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:15.857601 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 79128.3us
I20260709 12:19:15.859252 28751 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:15.864053 28317 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:15.867681 28324 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.871927 24808 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:19:15.872447 24808 pending_rounds.cc:85] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Aborting all ops after (but not including) 11
I20260709 12:19:15.872726 24808 pending_rounds.cc:107] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:19:15.872999 24808 raft_consensus.cc:2889] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:15.851656 28556 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:19:15.880735 28833 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:15.881596 28833 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:15.885041 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:15.887727 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:15.889909 28817 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:15.891242 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:15.892083 28724 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:15.892644 28724 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:15.892767 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:15.893126 28724 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:15.895505 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:15.896164 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:15.898909 24097 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:15.868453 24101 raft_consensus.cc:3055] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:19:15.902027 24101 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:15.949079 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:15.954218 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 121722us
I20260709 12:19:15.982070 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:15.991178 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 83567us
I20260709 12:19:15.997912 24101 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.091288 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:16.092360 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 160432us
W20260709 12:19:16.093456 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 155568us
I20260709 12:19:16.095692 24096 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
W20260709 12:19:16.095024 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 87375.8us
I20260709 12:19:16.110903 24066 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:16.111033 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:16.121104 28273 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:19:16.133090 24101 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:19:16.121379 28611 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:16.111433 28752 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:16.126168 28352 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
W20260709 12:19:16.167874 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 308896us
W20260709 12:19:16.179935 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44259.9us
W20260709 12:19:16.181216 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 73180.9us
I20260709 12:19:16.162532 28611 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.195997 28611 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:16.232957 28853 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:16.212136 28752 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:16.233403 28833 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:16.325134 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 137135us
I20260709 12:19:16.259701 28751 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:16.337098 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:16.301301 28817 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.319059 28699 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:19:16.350574 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 255972us
I20260709 12:19:16.326363 28853 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:16.321892 28273 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:16.315883 28852 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:16.380395 24101 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:16.353775 28751 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.360155 28853 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:16.407799 28273 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.410605 28273 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.411228 28862 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:16.412595 28861 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.087s	user 0.000s	sys 0.001s
I20260709 12:19:16.415678 28865 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:16.415822 28858 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:19:16.416244 28352 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:16.418727 28752 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:16.461206 28865 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.385663 28817 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.463924 28865 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.464145 28817 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.384277 28852 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.466784 28852 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.420233 28866 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:16.468125 28866 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.423302 28877 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.472035 28877 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.389124 28699 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:16.423899 28847 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:16.474159 28847 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.475540 28779 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:16.476363 28699 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:16.476493 28847 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:16.393209 28686 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:19:16.427714 28792 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:16.477906 28792 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:16.431857 28724 consensus_meta.cc:287] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.538s	user 0.013s	sys 0.003s
I20260709 12:19:16.479230 28724 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.426182 28874 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:16.480433 28874 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.481765 28724 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.471201 28866 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.483774 28877 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:16.485286 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:16.486045 28792 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.447656 28862 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.489179 28862 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:16.476238 28779 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.491680 28779 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.435316 28751 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:16.520932 28867 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:16.527190 28867 raft_consensus.cc:697] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:16.528347 28686 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:16.527374 23994 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 9, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:16.528513 28867 consensus_queue.cc:237] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.529057 28686 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:16.529712 23994 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 9, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:16.482856 28874 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.533514 28686 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:16.553881 28853 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.557202 28853 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:16.567612 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 224962us
I20260709 12:19:16.570940 24095 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:16.573547 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:16.577324 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:16.580263 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 226971us
I20260709 12:19:16.581351 28324 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:16.584038 23994 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:16.582280 28324 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.596335 28885 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:19:16.621352 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 243014us
W20260709 12:19:16.675752 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45709.2us
W20260709 12:19:16.677093 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 51358.1us
I20260709 12:19:16.728561 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.729628 24173 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
W20260709 12:19:16.730147 23998 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 193) took 25158 ms (client timeout 15000 ms). Trace:
I20260709 12:19:16.679877 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:16.629041 23994 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 11 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:16.624445 28751 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260709 12:19:16.752038 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.752790 24243 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:19:16.752897 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.731810 28886 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.754136 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.628021 28611 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.760324 28771 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.760520 28884 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:19:16.760922 28848 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:19:16.779910 28611 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.766755 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:16.780190 28884 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:16.750948 28885 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.784000 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:16.754513 28866 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:16.784727 24250 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:19:16.784963 28866 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.782699 28771 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.758733 23994 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 13 to 14, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 14 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:16.774425 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.787935 28886 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.787981 24245 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:16.789232 28771 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:16.790293 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.791401 24171 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:16.793144 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.793313 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.794142 24172 raft_consensus.cc:2368] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16.
I20260709 12:19:16.794341 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.796911 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.798537 28324 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.797705 28844 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 7 to 10, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:16.800354 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:19:16.730667 23998 rpcz_store.cc:269] 0709 12:18:51.571066 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:18:51.571346 (+   280us) service_pool.cc:224] Handling call
0709 12:19:16.729838 (+25158492us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":102830,"reported_tablets":48}
I20260709 12:19:16.802168 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.803053 24169 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:16.805301 28853 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:16.806082 28853 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:16.808544 28853 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:16.810549 28886 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:16.810776 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 383251us
I20260709 12:19:16.870728 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.800789 28866 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.812887 23994 catalog_manager.cc:5697] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 14, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 14 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:16.814859 28884 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:16.815516 28885 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.819413 28882 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.815549 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:16.842478 24171 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:19:16.850178 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 89991.8us
I20260709 12:19:16.865568 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.880667 24250 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:19:16.891016 28761 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:16.884478 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 112183us
I20260709 12:19:16.906437 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.907373 24174 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:16.908521 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.908975 24171 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:16.910065 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:16.881161 28352 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:16.911835 28352 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.912575 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.912878 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.914093 28352 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:16.914688 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.915089 28882 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.916347 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.897879 23994 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 7 to 8, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:16.916976 24250 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:19:16.917568 28882 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.918531 24175 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:16.918749 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.919873 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.920024 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.920676 28882 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:16.922608 28882 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.918334 23994 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 9, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:16.923995 28686 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:16.924620 28686 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.925359 23994 catalog_manager.cc:5697] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 10 to 11, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:16.927294 23994 catalog_manager.cc:5697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 11, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:16.928789 28686 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.930068 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:16.929792 23994 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:16.930892 24250 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 16: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:16.931104 28882 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.932232 23994 catalog_manager.cc:5697] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 13, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 13 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:16.892730 28853 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:16.934348 28853 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.933961 23994 catalog_manager.cc:5697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 11, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 11 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:16.935392 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:16.935894 24092 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:16.943109 24173 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:19:16.903136 28626 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:16.950470 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:16.953262 23994 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 5 to 7, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 9 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:16.902922 28761 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:16.965585 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:16.949595 28867 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:16.966912 28867 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.967643 28761 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:16.976965 24097 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 7 to 10, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:16.979532 28891 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.182s	user 0.004s	sys 0.000s
I20260709 12:19:16.965340 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:16.981189 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:16.982136 24249 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:16.982767 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:16.947372 28893 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:16.984434 28893 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.956487 28626 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:16.981271 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:16.989435 24169 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:19:16.991050 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.991668 24174 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
I20260709 12:19:16.994277 24168 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:19:16.989430 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.997210 23994 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 10, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 10 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:17.000347 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.005326 24167 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:16.990494 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.015841 24249 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:19:17.019770 24170 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 16: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:17.020617 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.993395 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.021533 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:17.021770 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.023355 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.986967 28893 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.033622 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:16.991321 28867 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.037966 24176 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 13: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:17.023528 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.032615 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:17.041522 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:17.041756 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.042209 24174 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.042910 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:17.047360 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:17.048189 24175 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 16: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:17.052620 24066 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.054045 24066 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.054364 24174 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:19:17.055826 28611 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:17.056279 28611 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:17.056677 28611 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:17.041592 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.059775 28686 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:17.070034 24173 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:16.997336 28626 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.078387 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.021096 28882 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:17.086416 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.074898 23994 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 6 to 8, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 8 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:17.088085 28882 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.088940 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.089462 23994 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:17.091617 23994 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 11 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:17.090687 28882 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.102095 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.108793 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.109618 24173 raft_consensus.cc:2376] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14. Re-sending same reply.
I20260709 12:19:17.115530 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.116534 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.116799 24095 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:17.118664 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.120246 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.124540 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.125931 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.093403 23994 catalog_manager.cc:5697] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 14, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 14 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:17.109555 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.129983 23994 catalog_manager.cc:5697] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 10, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:17.163638 24241 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:17.165967 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.170418 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.176555 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.160305 28751 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:17.189425 28751 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.189898 28751 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.201468 23994 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 10 to 12, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:17.206432 28853 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.209209 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.210701 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.213217 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.215334 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.215418 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.215497 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.216543 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.216961 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:17.216601 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.217959 24098 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 14: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:19:17.222518 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 168551us
I20260709 12:19:17.231750 24099 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:19:17.240089 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:17.251116 24099 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 16: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:17.252079 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.253729 28867 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:17.253784 24066 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.254225 28867 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:17.254675 28867 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:17.255110 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 94062.5us
I20260709 12:19:17.256781 28317 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:17.257297 28317 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:17.257755 28317 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.262563 28771 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:17.263244 28771 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:17.265803 28771 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:17.236735 28626 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.267532 28626 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.267809 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:17.269951 28626 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.270857 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.276667 28751 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.282207 24215 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:17.283828 28611 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.236618 24141 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:17.286134 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49648.4us
I20260709 12:19:17.286247 28882 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.287119 28860 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.287827 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.291944 28892 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:17.292604 28892 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.297369 28892 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:17.306077 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:17.307197 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 53485.6us
I20260709 12:19:17.307054 24095 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 8.
I20260709 12:19:17.330049 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:17.336238 24214 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.315143 28724 raft_consensus.cc:2764] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:19:17.318678 28893 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:17.350523 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.351300 28751 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:17.347940 28860 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:19:17.360015 28860 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.360519 28860 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:17.365592 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.365718 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.366564 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.367106 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.368641 24096 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:17.369206 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.373241 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.342736 28890 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:19:17.378654 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:17.375638 28880 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.015s	sys 0.004s
I20260709 12:19:17.381651 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.366709 28317 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.386574 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.375499 28611 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.378314 28724 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:17.447587 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 108938us
W20260709 12:19:17.387153 28880 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.016s	sys 0.004s
I20260709 12:19:17.419984 28866 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:19:17.483717 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 159887us
I20260709 12:19:17.485606 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.489777 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.468263 28893 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:17.480084 28724 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:17.504541 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 82994.5us
I20260709 12:19:17.487778 28751 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:17.488071 28844 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35632 (request call id 1) took 3050 ms. Trace:
W20260709 12:19:17.530825 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 110420us
I20260709 12:19:17.537407 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:17.541627 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 246285us
I20260709 12:19:17.557439 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.504119 28893 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.562824 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.563814 24248 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:19:17.563932 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.564229 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.564896 24245 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
W20260709 12:19:17.567438 28910 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260709 12:19:17.543939 28890 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:17.570468 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.573232 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.575137 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:17.535863 28751 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.558248 28885 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:17.588878 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54792.6us
I20260709 12:19:17.590974 24140 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.587103 24244 raft_consensus.cc:2955] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 7 to 10, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:17.597347 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.593128 28829 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:19:17.625463 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:17.627148 28922 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.527168 28844 rpcz_store.cc:276] 0709 12:19:14.413240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:14.414704 (+  1464us) service_pool.cc:224] Handling call
0709 12:19:14.512718 (+ 98014us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b4c00026640. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03847a20 00007f4c03858a29 00007f4c0381e644 00007f4c03845f2d 00007f4c03845b93 00007f4c054d41af 00007f4c054d3f3e 00007f4c05559888 00007f4c0557675c 00007f4c0557776a 00007f4c0557691b
0709 12:19:14.515203 (+  2485us) log.cc:844] Serialized 501 byte log entry
0709 12:19:14.927708 (+412505us) spinlock_profiling.cc:243] Waited 6.34 ms on lock 0x7b5400489520. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054f4142 00007f4c054d4eaa 00007f4c054dbd53 00007f4c054dbcd9 00007f4c054dbc69 00007f4c054dbc31 00007f4c054dadfd 0000000000388634 0000000000388479 00007f4c0248e475
0709 12:19:14.930305 (+  2597us) spinlock_profiling.cc:243] Waited 8.72 ms on lock 0x7b5400489520. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054fbb26 00007f4c054f549a 00007f4c054f4714 00007f4c054d4eaa 00007f4c054dbd53 00007f4c054dbcd9 00007f4c054dbc69 00007f4c054dbc31 00007f4c054dadfd 0000000000388634
0709 12:19:17.447063 (+2516758us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3062,"raft.run_cpu_time_us":7104,"raft.run_wall_time_us":358737,"spinlock_wait_cycles":39511040,"thread_start_us":209249,"threads_started":1,"wal-append.queue_time_us":325657,"wal-append.run_cpu_time_us":9231,"wal-append.run_wall_time_us":1270748}
W20260709 12:19:17.624970 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 173875us
I20260709 12:19:17.633477 28917 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:17.624989 28920 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:17.641320 28917 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.634460 28613 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:17.641367 28920 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.644649 28613 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:17.646911 28920 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.648604 28751 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:17.621263 28882 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:19:17.644009 28917 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.616978 28867 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.653012 28724 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.653311 24098 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:17.625120 28890 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:17.654840 28890 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.660868 28867 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.662483 28613 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:17.666002 28912 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:19:17.676482 28317 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:17.680096 28860 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.758917 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:17.758570 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.761457 24098 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:17.764930 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.768923 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.771206 24248 raft_consensus.cc:2368] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:19:17.773838 28893 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:17.770653 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.776388 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.778143 28924 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.774127 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b29f161fe0e24b51ad5c1903bdc5112c with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:17.718253 28860 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:17.793283 24067 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.781986 28884 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.811124 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.797673 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:17.796561 28929 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:17.795748 28920 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:19:17.799574 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.823601 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.831212 24246 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 14: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:17.761175 28866 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:19:17.840476 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.843453 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.797363 28921 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:17.845109 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.847400 28924 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:17.847892 28885 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.848563 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:17.849316 24096 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:17.849231 24140 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.797953 28917 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:17.851352 28885 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.851744 28917 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:17.852226 28917 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:17.859778 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:17.829492 28893 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:17.863817 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.863915 28918 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:17.864953 28918 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.870970 24066 leader_election.cc:400] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:19:17.867532 28918 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:17.871670 24066 leader_election.cc:403] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:19:17.839015 28884 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:19:17.892987 28930 log.cc:927] Time spent T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260709 12:19:17.893736 24096 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:19:17.897852 28920 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:17.900609 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:17.904486 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:17.902513 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 120251us
W20260709 12:19:17.905784 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 75408.7us
W20260709 12:19:17.905911 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 62755.6us
I20260709 12:19:17.905911 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:17.912282 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:17.911743 24140 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.916566 24140 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.917339 28317 raft_consensus.cc:2764] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:19:17.917696 28922 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:19:17.920022 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.920233 28925 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:17.921376 28925 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.922559 28885 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:19:17.908273 28907 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:19:17.923645 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.924677 28907 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.910789 28686 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.937877 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:17.941182 28885 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.944973 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.915721 28920 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:17.960210 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.963968 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:17.964864 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50548.2us
I20260709 12:19:17.958079 28907 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:17.961303 28885 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.962810 28922 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.975515 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:17.976262 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59893.6us
I20260709 12:19:17.976922 28878 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:17.975507 24140 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.977355 28878 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:17.977491 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:17.979017 28878 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:17.979422 28887 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:17.979672 24140 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.980005 28751 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:17.980894 24214 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.981448 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:17.981951 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:17.982161 28887 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:17.983179 28880 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:17.983675 28880 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:17.984089 28880 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:17.985802 28923 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.985922 28887 raft_consensus.cc:697] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:17.986840 28924 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.987407 24140 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.985826 28751 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:19:17.987957 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.988306 28924 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:17.988826 24140 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.989138 28887 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:17.989722 28924 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:17.990178 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.990478 28776 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.991082 28924 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:17.968336 28884 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:19:17.975064 28882 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:17.991639 24140 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:17.975630 28907 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:18.005466 28907 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:18.006253 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:18.007037 28724 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:18.009191 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.009480 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.010103 24169 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:18.013762 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.015364 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.016816 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.017678 28317 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:18.018299 28317 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:18.033681 24169 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:18.019368 28317 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.044116 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.042510 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.048332 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.035306 28878 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.053113 28878 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:18.055637 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.056406 24167 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.058616 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.059617 24171 raft_consensus.cc:2368] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 13. Current term is 14.
I20260709 12:19:18.066671 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:18.069024 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.070333 24067 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.073169 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:18.072018 24067 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.076546 24093 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 14: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:18.079324 24216 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:18.036216 28880 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.036818 28917 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.038341 24780 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.039624 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.040997 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.041808 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:19:18.099359 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 52043.1us
I20260709 12:19:18.107805 24170 raft_consensus.cc:2368] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16.
I20260709 12:19:18.102281 24100 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: [8.5-8.5]
W20260709 12:19:18.110493 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 72268.4us
I20260709 12:19:18.076519 28878 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:18.079815 28927 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:18.080106 28686 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:18.101514 28907 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:18.135936 24099 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:19:18.106479 28860 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:19:18.114586 28776 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:18.139748 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:18.201362 24167 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:19:18.204203 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:19:18.216645 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 88795.5us
I20260709 12:19:18.217334 24242 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:19:18.225526 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 93016.2us
I20260709 12:19:18.192052 28613 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:18.307212 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:18.236634 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:18.314885 28880 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:18.317613 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:18.317864 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:18.318528 24099 raft_consensus.cc:606] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:18.319965 28613 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:18.273710 28917 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:18.233896 28925 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
W20260709 12:19:18.324159 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 92075.2us
I20260709 12:19:18.328249 24244 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:19:18.323278 24808 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:19:18.343466 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.344306 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.347386 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.347213 28929 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:18.348361 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.348747 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.349648 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.350353 24169 raft_consensus.cc:2368] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:19:18.353724 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.347740 24173 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:19:18.356274 28613 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:18.357424 24176 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:19:18.362466 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.365310 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:18.366618 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.374365 24169 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:19:18.375900 24245 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:18.374322 24244 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:18.378608 24244 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:18.380025 24093 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 8. Current term is 9. Ops: []
I20260709 12:19:18.381245 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.384075 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.394706 24067 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.397889 24067 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.399610 24067 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.402144 24067 leader_election.cc:400] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:19:18.409300 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.411870 24216 leader_election.cc:400] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 13. Current term is 14.
I20260709 12:19:18.412249 24216 leader_election.cc:403] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:19:18.413466 24216 leader_election.cc:400] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16.
I20260709 12:19:18.413759 24216 leader_election.cc:403] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:18.414976 28751 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 13. Current term is 14.
I20260709 12:19:18.402372 28890 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:18.401176 28918 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:18.403038 28917 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:18.405020 28893 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:19:18.416603 28924 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:18.413750 28724 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:19:18.432045 28880 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16.
I20260709 12:19:18.493718 28947 consensus_queue.cc:1059] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:18.508220 28724 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:18.528895 28724 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:18.529110 28947 raft_consensus.cc:3055] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:18.529663 28947 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:18.529966 28724 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.531780 28724 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:18.539287 24066 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:18.540865 28853 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:18.541311 28853 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:18.541756 28853 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.543530 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:18.550046 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:18.550752 24099 raft_consensus.cc:606] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:19:18.511854 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 108549us
W20260709 12:19:18.515966 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 102648us
I20260709 12:19:18.554966 24067 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.556079 24216 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:18.523154 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 112453us
I20260709 12:19:18.558034 28880 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:18.558542 28939 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:19:18.570909 28885 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:18.572095 28885 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:18.572453 28885 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:18.557454 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:18.573344 28885 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.574452 28885 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:18.574648 28880 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:18.575424 28880 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:18.557543 28907 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:18.559887 28626 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:18.578248 28626 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:18.578717 28626 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:18.581101 28626 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.583977 28880 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.585124 28882 consensus_queue.cc:1059] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:18.586336 28866 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:18.586719 28866 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:18.587654 28866 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.589022 23994 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 212) took 5437 ms. Trace:
I20260709 12:19:18.592046 28866 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:18.582820 28626 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:18.607441 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:18.608336 24099 raft_consensus.cc:606] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:18.608798 24099 raft_consensus.cc:614] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:18.602708 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:18.589430 23994 rpcz_store.cc:276] 0709 12:19:13.151345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.151528 (+   183us) service_pool.cc:224] Handling call
0709 12:19:18.588924 (+5437396us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:17.641508 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:17.642353 (+   845us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:17.642412 (+    59us) write_op.cc:435] Acquired schema lock
0709 12:19:17.642455 (+    43us) tablet.cc:662] Decoding operations
0709 12:19:17.644427 (+  1972us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:17.644534 (+   107us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:17.644588 (+    54us) tablet.cc:685] Acquiring locks for 21 operations
0709 12:19:17.646361 (+  1773us) tablet.cc:701] Row locks acquired
0709 12:19:17.646416 (+    55us) write_op.cc:260] PREPARE: finished
0709 12:19:17.646622 (+   206us) write_op.cc:270] Start()
0709 12:19:17.646787 (+   165us) write_op.cc:276] Timestamp: P: 1783599557646544 usec, L: 0
0709 12:19:17.646830 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:19:17.793106 (+146276us) log.cc:844] Serialized 8278 byte log entry
0709 12:19:17.889366 (+ 96260us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c024710ac 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b
0709 12:19:18.332807 (+443441us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b5400030820. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054f0dbe 00007f4c054fb930 00007f4c054fb8d8 00007f4c054fb858 00007f4c054fb813 00007f4c054faa9c 00007f4c0b3e62f6 00007f4c0b3e0aa8 00007f4c055377cb 00007f4c0553a2c0
0709 12:19:18.430606 (+ 97799us) op_driver.cc:464] REPLICATION: finished
0709 12:19:18.474263 (+ 43657us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c05576e28 00007f4c08fb1581 00007f4c08fb0d58 00007f4c08fb59f1 00007f4c08fb59a9 00007f4c08fb5939 00007f4c08fb5901 00007f4c08fb4b2d 0000000000388634 0000000000388479
0709 12:19:18.518669 (+ 44406us) write_op.cc:301] APPLY: starting
0709 12:19:18.518799 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:18.531825 (+ 13026us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:18.531868 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:18.544816 (+ 12948us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:18.545252 (+   436us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 12:19:18.545317 (+    65us) write_op.cc:312] APPLY: finished
0709 12:19:18.545909 (+   592us) log.cc:844] Serialized 188 byte log entry
0709 12:19:18.546939 (+  1030us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:18.547203 (+   264us) write_op.cc:454] Released schema lock
0709 12:19:18.547289 (+    86us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:18.548970 (+  1681us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:18.548999 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":23060,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":87614,"apply.run_cpu_time_us":27107,"apply.run_wall_time_us":30315,"cfile_cache_hit":86,"cfile_cache_hit_bytes":91949,"num_ops":21,"prepare.queue_time_us":267349,"prepare.run_cpu_time_us":43741,"prepare.run_wall_time_us":836687,"raft.queue_time_us":65293,"raft.run_cpu_time_us":2248,"raft.run_wall_time_us":106679,"replication_time_us":769712,"spinlock_wait_cycles":243183616,"thread_start_us":437366,"threads_started":4,"wal-append.queue_time_us":183136}]]}
W20260709 12:19:18.600751 28960 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.078s	user 0.002s	sys 0.000s
I20260709 12:19:18.626628 28907 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:19:18.644126 24170 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:18.631605 28939 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:19:18.663254 24099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:18.665367 24099 raft_consensus.cc:606] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:18.665798 24099 raft_consensus.cc:614] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:18.530602 28947 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.672493 28939 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:18.673110 28939 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:18.674208 28939 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:18.688414 24216 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:18.691681 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:18.732872 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 43545.3us
W20260709 12:19:18.739626 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 51318.8us
W20260709 12:19:18.739885 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48323us
I20260709 12:19:18.742293 24099 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:18.748950 24099 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:19:18.753916 24094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:18.754643 24094 raft_consensus.cc:606] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:18.756189 28880 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:18.760138 28860 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:18.750761 28613 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:18.680181 28929 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260709 12:19:18.763871 28947 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:18.798236 23996 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:18.800827 23996 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:18.789003 28352 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:19:18.802876 23996 catalog_manager.cc:5697] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 13, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 13 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:18.700201 28918 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:19:18.822409 28918 raft_consensus.cc:993] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:18.822959 28918 raft_consensus.cc:1081] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:18.825575 23996 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 12 to 14, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 14 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.843047 23996 catalog_manager.cc:5697] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:18.846391 24174 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:18.851631 23996 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 11 to 14, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 14 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:18.856035 23996 catalog_manager.cc:5697] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:18.787887 28939 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:18.858021 23996 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 13, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 13 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:18.850011 24174 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:18.901335 24174 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:18.901803 24174 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:18.919165 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64043.8us
I20260709 12:19:18.914108 23996 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:18.932417 23996 catalog_manager.cc:5697] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:18.897531 28880 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:19:18.955921 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 99159.1us
I20260709 12:19:18.949648 23996 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:18.971177 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:18.973611 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:18.974613 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:18.985868 28853 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:18.990688 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:18.990942 28853 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:18.982350 23996 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:19.014185 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:19.015221 23996 catalog_manager.cc:5697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:19.033932 24174 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.016894 23996 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 7 to 8, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:19.040532 24066 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:19.042824 23996 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 11 to 15, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 15 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:19.045723 23996 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:19.072984 24174 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:19.080410 28972 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.178s	user 0.008s	sys 0.000s
I20260709 12:19:19.094645 28955 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:19.095055 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:19.095358 28955 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:19.095984 24099 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:19.096426 24099 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:19.097473 24099 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.075147 28979 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:19.098969 24099 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:19.105381 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:19.122376 24250 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:19.107743 24167 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:19.118707 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:19.119290 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:19.145062 24096 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: []
W20260709 12:19:19.120003 28969 log.cc:927] Time spent T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:19:19.153017 24175 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:19:19.153510 24175 pending_rounds.cc:85] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 4
I20260709 12:19:19.153762 24175 pending_rounds.cc:107] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:19:19.153990 24175 raft_consensus.cc:2889] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:19.098829 28955 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:19.199108 24250 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
W20260709 12:19:19.212460 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 111225us
I20260709 12:19:19.239403 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:19.247550 24141 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:19.252620 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:19.256036 24099 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:19:19.255578 28882 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:19.268396 28983 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:19:19.256414 28963 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:19:19.299824 28980 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:19:19.308663 28989 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:19.321022 28963 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:19.322279 28963 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.390137 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet 51d85bfbe5fb4a4ba1caf713a20ce874 with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:46626
W20260709 12:19:19.421135 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 43930.3us
I20260709 12:19:19.481861 28884 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:19:19.493465 28947 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:19.506451 28947 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:19.507505 28947 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:19.468632 28950 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
W20260709 12:19:19.514746 28986 log.cc:927] Time spent T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.218s	user 0.000s	sys 0.009s
I20260709 12:19:19.547802 28995 tablet_replica.cc:333] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:19:19.571513 28976 raft_consensus.cc:993] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:19.572325 28976 raft_consensus.cc:1081] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:19.574285 24094 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:19.585276 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:19.586205 24168 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:19.586745 24168 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:19.603400 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 47719.5us
I20260709 12:19:19.650679 24168 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.626573 28947 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.671792 24168 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:19.673149 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:19.674121 24096 raft_consensus.cc:3055] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:19.674526 24096 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:19.679383 24096 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.684087 24096 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:19.696342 28920 raft_consensus.cc:993] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:19.697172 28977 raft_consensus.cc:1081] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:19.698382 28995 raft_consensus.cc:2243] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:19.699534 28995 raft_consensus.cc:2272] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:19.704538 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:19.705298 24168 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:19.705679 24168 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.713177 24096 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:19.716567 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:19.717262 24247 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:19.718410 24140 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:19.731688 28990 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:19.750795 24168 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.743597 28995 ts_tablet_manager.cc:1916] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:19:19.784173 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 65856.9us
I20260709 12:19:19.784597 28884 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:19.785272 28884 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:19.788962 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:19.789911 24096 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:19.790212 24096 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:19.795769 24168 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:19.799125 24096 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.811717 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:19.812494 24250 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.830719 24096 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:19.828188 24247 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:19.786366 28884 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.856647 24096 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:19:19.870859 24140 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:19.863521 28724 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:19.905289 24250 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:19:19.876425 28885 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:19.916046 28724 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.933866 28885 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:19.981238 29013 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.200004 29013 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:19.974018 28611 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.205279 28884 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:20.212817 29004 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.240s	user 0.004s	sys 0.006s
I20260709 12:19:20.217326 28995 ts_tablet_manager.cc:1929] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.6
I20260709 12:19:20.216897 28885 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.218271 28989 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:20.235002 24247 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:19:20.241123 29007 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.268s	user 0.002s	sys 0.000s
I20260709 12:19:20.265604 24095 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:20.267212 28724 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:20.330760 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70778.9us
I20260709 12:19:20.335345 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:20.336198 24250 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:20.339346 28995 log.cc:1199] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/51d85bfbe5fb4a4ba1caf713a20ce874
I20260709 12:19:20.319955 29016 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:20.319166 28611 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.378332 28611 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.379550 29016 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.382612 29016 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.382854 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:20.383507 28887 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:20.383567 24249 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:20.384117 28887 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.351830 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:20.323647 28884 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.385468 24099 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:19:20.368664 29013 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.327562 28989 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.334358 29017 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.345068 28724 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:19:20.386945 28884 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.389465 28989 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:20.386638 28887 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:19:20.396473 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 57523.7us
I20260709 12:19:20.395550 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:20.390097 28882 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:19:20.395419 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:20.397881 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 44596.7us
I20260709 12:19:20.398051 24098 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:20.389813 29017 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.402637 29017 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.403250 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet 51d85bfbe5fb4a4ba1caf713a20ce874 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:20.404489 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:20.405236 24099 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:20.406754 29015 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:20.410792 29015 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:20.411226 29015 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:20.413749 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:20.414340 24140 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:20.415640 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:19:20.413699 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 71253.5us
I20260709 12:19:20.423274 28923 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:20.423718 28923 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.424072 28923 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:20.427454 28686 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:20.427948 28686 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.428241 28922 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:20.428296 28686 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.428798 28922 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.429245 28922 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.437007 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:20.442770 24245 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
W20260709 12:19:20.442425 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 100130us
I20260709 12:19:20.448395 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:20.456012 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:20.457384 24243 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:20.457314 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:20.454679 24066 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:20.461328 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:20.443508 28882 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.467227 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:20.465724 29016 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:20.471421 29016 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.471839 29016 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:20.478044 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:20.478945 24245 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:19:20.479907 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:20.487376 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:20.488042 24243 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:19:20.498474 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:20.500415 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:20.505859 24092 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 11: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:20.538436 24092 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:20.482137 28882 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.548604 24243 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:20.554852 29013 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:20.563519 28882 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.563886 24168 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:20.566874 28885 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:20.586220 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:20.545002 28686 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.588245 24243 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:20.591233 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:20.592723 29015 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.593408 28885 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:20.594049 24173 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:20.594269 28885 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:20.595305 28885 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:20.597848 29015 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.599237 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:20.600515 24243 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:20.586205 29016 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.627635 24093 raft_consensus.cc:2368] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:19:20.628914 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:20.629058 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 168421us
I20260709 12:19:20.630103 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:20.630342 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:20.630899 24099 raft_consensus.cc:2368] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:19:20.631732 24094 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:20.653324 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:20.654404 24173 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.663352 24140 leader_election.cc:400] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:19:20.665119 24140 leader_election.cc:403] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:19:20.680773 24214 leader_election.cc:400] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:19:20.681254 24214 leader_election.cc:403] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:20.677134 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:20.662247 28989 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:20.687678 29001 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:19:20.725011 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:20.695415 28686 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.695504 28989 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:20.697917 28923 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.735733 28989 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:20.738416 24173 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:19:20.727133 29016 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.741246 24067 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:20.747040 24169 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:20.740358 29013 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
W20260709 12:19:20.758450 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 291882us
I20260709 12:19:20.746040 28686 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:20.743269 28922 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.767688 24096 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:20.771402 24242 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:19:20.774314 28686 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:20.775486 28686 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.779765 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:20.780459 24243 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.780956 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:20.787211 28922 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.789603 24176 raft_consensus.cc:2368] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:19:20.811978 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:20.812714 24244 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.822592 24243 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:19:20.809598 28955 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:19:20.844105 24096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:20.845391 24096 raft_consensus.cc:606] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:20.845992 24096 raft_consensus.cc:614] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:19:20.848704 24244 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:19:20.850529 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:20.854506 24098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:20.855233 24098 raft_consensus.cc:606] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:20.856472 28923 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.858390 24098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6831162b73f4c16a41519abb392404b"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:20.859083 24098 raft_consensus.cc:606] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:20.870718 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:20.873463 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:20.877960 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:20.866681 29013 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:20.882522 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:20.885675 24067 leader_election.cc:400] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:19:20.886061 24067 leader_election.cc:403] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:19:20.883641 24098 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:19:20.886390 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:20.888278 29013 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:20.889312 29013 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.881129 29016 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:20.898394 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:20.902837 24096 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:20.921303 24098 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:19:20.935962 28920 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:19:20.938380 28885 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:20.940966 28885 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:20.957384 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:20.961987 29015 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:19:20.904322 29016 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:20.972883 24140 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:20.988505 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:21.008397 24098 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:20.977258 28882 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:21.007694 29016 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:21.011952 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:21.017292 28989 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:21.018446 24244 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:21.024327 28989 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:21.028465 29001 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10.
I20260709 12:19:21.039327 24244 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:21.048676 28979 raft_consensus.cc:993] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:21.049336 28979 raft_consensus.cc:1081] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:21.053153 28977 raft_consensus.cc:993] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:21.053716 28977 raft_consensus.cc:1081] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:21.079056 24247 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:21.082515 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:19:21.090613 29036 log.cc:927] Time spent T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.086s	user 0.000s	sys 0.002s
I20260709 12:19:21.106694 29026 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:21.110836 29026 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:21.114454 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:21.115550 24094 raft_consensus.cc:2393] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 15: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:19:21.116731 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:21.117470 24169 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 15.
I20260709 12:19:21.119987 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:21.113503 29026 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:21.122068 28843 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:21.122479 28843 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:21.122892 28843 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.130519 24098 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:21.134621 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:21.135526 24168 raft_consensus.cc:2368] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12.
I20260709 12:19:21.135666 24169 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6831162b73f4c16a41519abb392404b"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:21.136360 24169 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:21.136461 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:21.136754 24169 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.137699 24175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:21.138345 24175 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:21.138741 24175 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:21.138540 24066 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:21.137220 24176 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:19:21.140399 28920 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:21.141012 28920 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:21.142038 28920 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:21.153385 29013 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:21.154935 29013 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:21.158244 29013 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:21.160641 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:21.161103 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:21.166226 29015 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:21.166920 29015 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:21.168126 29015 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:21.179209 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:21.187196 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:21.189730 24216 leader_election.cc:400] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12.
I20260709 12:19:21.190111 24216 leader_election.cc:403] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:19:21.202812 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:21.205209 24140 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:21.200860 24175 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:21.207325 24169 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:21.217289 28963 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:21.209723 28979 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:19:21.209522 28887 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12.
I20260709 12:19:21.230142 24244 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:21.244467 24176 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:19:21.245870 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:21.246340 24169 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:21.246654 24244 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.237913 24175 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:21.239022 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:21.248592 24096 raft_consensus.cc:3055] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:21.248929 24096 raft_consensus.cc:740] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:21.242156 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:21.249825 24243 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:21.251367 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:21.252033 24098 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:21.252352 24098 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:21.256783 24096 consensus_queue.cc:260] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:21.266635 24244 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:19:21.249961 28979 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:21.264463 24098 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:21.268262 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:21.270913 28953 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:21.271474 28953 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:21.272435 28953 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:21.268189 24096 raft_consensus.cc:3060] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:21.283216 24098 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:21.259682 29016 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:19:21.280038 28979 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:21.320035 28843 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:21.352427 24243 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:21.353814 24141 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:21.354737 28724 raft_consensus.cc:2804] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:21.355298 28724 raft_consensus.cc:697] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:21.356225 28724 consensus_queue.cc:237] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:21.358448 28843 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:21.359928 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:21.360720 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:21.370383 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 195) took 4769 ms. Trace:
I20260709 12:19:21.377430 24176 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 15.
I20260709 12:19:21.384275 24096 raft_consensus.cc:2468] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:21.381374 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:21.386565 24098 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:19:21.370867 23996 rpcz_store.cc:276] 0709 12:19:16.601301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:16.601651 (+   350us) service_pool.cc:224] Handling call
0709 12:19:21.370302 (+4768651us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:19.552716 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:19.553363 (+   647us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:19.553407 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:19:19.553430 (+    23us) tablet.cc:662] Decoding operations
0709 12:19:19.555389 (+  1959us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:19.579370 (+ 23981us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:19.583888 (+  4518us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:19:19.765769 (+181881us) tablet.cc:701] Row locks acquired
0709 12:19:19.765799 (+    30us) write_op.cc:260] PREPARE: finished
0709 12:19:19.766026 (+   227us) write_op.cc:270] Start()
0709 12:19:19.766248 (+   222us) write_op.cc:276] Timestamp: P: 1783599559765966 usec, L: 0
0709 12:19:19.766282 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:19:19.780835 (+ 14553us) log.cc:844] Serialized 6333 byte log entry
0709 12:19:20.564698 (+783863us) op_driver.cc:464] REPLICATION: finished
0709 12:19:20.681191 (+116493us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557832a 00007f4c054fdf14 00007f4c054fdec3 00007f4c054fde38 00007f4c054fddf3 00007f4c054fd0dc 00007f4c05526e16 00007f4c0550ecbb 00007f4c054f939d 00007f4c054fcd75
0709 12:19:20.699450 (+ 18259us) write_op.cc:301] APPLY: starting
0709 12:19:20.724615 (+ 25165us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:20.933762 (+209147us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:20.933793 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:21.130032 (+196239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:21.130425 (+   393us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:19:21.130473 (+    48us) write_op.cc:312] APPLY: finished
0709 12:19:21.130909 (+   436us) log.cc:844] Serialized 148 byte log entry
0709 12:19:21.131181 (+   272us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:21.131384 (+   203us) write_op.cc:454] Released schema lock
0709 12:19:21.131447 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:21.131932 (+   485us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:21.131963 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7284,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":123721,"apply.run_cpu_time_us":30125,"apply.run_wall_time_us":439215,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71039,"num_ops":16,"prepare.queue_time_us":329916,"prepare.run_cpu_time_us":38802,"prepare.run_wall_time_us":365021,"raft.queue_time_us":149213,"raft.run_cpu_time_us":22766,"raft.run_wall_time_us":164661,"replication_time_us":798147,"spinlock_wait_cycles":47714816,"thread_start_us":566697,"threads_started":4,"wal-append.queue_time_us":134217}]]}
I20260709 12:19:21.413751 28979 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:21.423904 24093 raft_consensus.cc:2368] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 15. Current term is 16.
I20260709 12:19:21.431260 24779 leader_election.cc:400] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 15. Current term is 16.
I20260709 12:19:21.431999 24247 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:21.403599 28843 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:21.451870 24176 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:19:21.467891 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:21.468683 24168 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:21.437034 29015 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:19:21.457979 28843 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:21.458303 23999 catalog_manager.cc:5697] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 10 to 11, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:21.479079 28920 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:19:21.508714 24168 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:19:21.510521 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:21.520390 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:21.519418 28977 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:21.523792 28977 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:21.524827 28977 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:21.531229 24096 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:21.533294 28922 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:21.558391 28843 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:21.507007 28979 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:21.579794 29045 log.cc:927] Time spent T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:19:21.641579 24096 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:21.643263 28724 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:21.665532 24243 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:21.667748 28979 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:21.708767 24169 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:21.711666 28979 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:21.725970 24249 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:21.733877 29015 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:19:21.739712 24243 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:21.742136 29015 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:19:21.867466 29054 log.cc:927] Time spent T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.086s	user 0.006s	sys 0.004s
I20260709 12:19:21.932981 24094 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:21.950455 29062 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:19:21.958657 29055 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.135s	user 0.000s	sys 0.003s
W20260709 12:19:21.990928 29059 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:19:22.011628 24093 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:22.034490 24243 raft_consensus.cc:1275] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:22.048635 23995 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 7 to 11, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 11 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.062752 24168 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:19:22.064150 29062 consensus_queue.cc:1048] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:22.069118 24096 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 15. Current term is 16. Ops: []
I20260709 12:19:22.071038 28764 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:22.071835 28764 consensus_queue.cc:1243] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer 729aa4b1ccec48b588c14e67652c61e1 log is divergent from this leader: its last log entry 16.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260709 12:19:22.072304 28829 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:22.072739 28829 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:22.073711 28829 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:22.076079 28829 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:22.089687 28611 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260709 12:19:22.146795 29061 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:22.186100 23995 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 104) took 6594 ms. Trace:
I20260709 12:19:22.186694 23995 rpcz_store.cc:276] 0709 12:19:15.645373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:15.711026 (+ 65653us) service_pool.cc:224] Handling call
0709 12:19:22.186010 (+6474984us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:22.152447 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:22.153062 (+   615us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:22.153100 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:19:22.153118 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:22.153486 (+   368us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:22.153549 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:22.153577 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:22.153789 (+   212us) tablet.cc:701] Row locks acquired
0709 12:19:22.153807 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:19:22.153972 (+   165us) write_op.cc:270] Start()
0709 12:19:22.154120 (+   148us) write_op.cc:276] Timestamp: P: 1783599562153916 usec, L: 0
0709 12:19:22.154149 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:19:22.154854 (+   705us) log.cc:844] Serialized 536 byte log entry
0709 12:19:22.157318 (+  2464us) op_driver.cc:464] REPLICATION: finished
0709 12:19:22.157815 (+   497us) write_op.cc:301] APPLY: starting
0709 12:19:22.157897 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:22.158862 (+   965us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:22.158952 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:22.160032 (+  1080us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:22.162415 (+  2383us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:22.162491 (+    76us) write_op.cc:312] APPLY: finished
0709 12:19:22.162751 (+   260us) log.cc:844] Serialized 25 byte log entry
0709 12:19:22.162964 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.163115 (+   151us) write_op.cc:454] Released schema lock
0709 12:19:22.163174 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:22.163653 (+   479us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.163680 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":140864,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":261,"apply.run_cpu_time_us":3671,"apply.run_wall_time_us":5790,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":117,"prepare.run_cpu_time_us":2748,"prepare.run_wall_time_us":2754,"replication_time_us":2978,"spinlock_wait_cycles":6016}]]}
I20260709 12:19:22.198675 24811 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 15. (term mismatch)
I20260709 12:19:22.199283 24811 pending_rounds.cc:85] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Aborting all ops after (but not including) 14
I20260709 12:19:22.199561 24811 pending_rounds.cc:107] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Aborting uncommitted NO_OP operation due to leader change: 15.15
I20260709 12:19:22.199842 24811 raft_consensus.cc:2889] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:19:22.206404 28920 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:19:22.226708 23994 catalog_manager.cc:5697] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:22.232002 23994 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.233975 23994 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.235672 23994 catalog_manager.cc:5697] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:22.253042 23994 catalog_manager.cc:5697] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 7 to 9, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 9 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:22.255501 23994 catalog_manager.cc:5697] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 11 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:22.256918 23994 catalog_manager.cc:5697] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 13, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 13 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.258394 23994 catalog_manager.cc:5697] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:22.260838 23994 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 10, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 10 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.262912 23994 catalog_manager.cc:5697] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 14 to 16, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 16 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:22.290253 23999 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 194) took 9162 ms. Trace:
I20260709 12:19:22.290838 23999 rpcz_store.cc:276] 0709 12:19:13.127745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:13.133318 (+  5573us) service_pool.cc:224] Handling call
0709 12:19:22.290137 (+9156819us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:21.636752 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:21.637424 (+   672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:21.637462 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:19:21.637482 (+    20us) tablet.cc:662] Decoding operations
0709 12:19:21.731548 (+ 94066us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:21.731680 (+   132us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:21.731735 (+    55us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:21.732026 (+   291us) tablet.cc:701] Row locks acquired
0709 12:19:21.732054 (+    28us) write_op.cc:260] PREPARE: finished
0709 12:19:21.732278 (+   224us) write_op.cc:270] Start()
0709 12:19:21.736317 (+  4039us) write_op.cc:276] Timestamp: P: 1783599561732215 usec, L: 0
0709 12:19:21.736365 (+    48us) op_driver.cc:348] REPLICATION: starting
0709 12:19:21.737827 (+  1462us) log.cc:844] Serialized 541 byte log entry
0709 12:19:21.905452 (+167625us) op_driver.cc:464] REPLICATION: finished
0709 12:19:22.010680 (+105228us) write_op.cc:301] APPLY: starting
0709 12:19:22.010823 (+   143us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:22.012099 (+  1276us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:22.012195 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:22.013131 (+   936us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:22.014464 (+  1333us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:22.014510 (+    46us) write_op.cc:312] APPLY: finished
0709 12:19:22.014751 (+   241us) log.cc:844] Serialized 25 byte log entry
0709 12:19:22.014943 (+   192us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.015059 (+   116us) write_op.cc:454] Released schema lock
0709 12:19:22.015102 (+    43us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":46140,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":95069,"apply.run_cpu_time_us":3818,"apply.run_wall_time_us":5316,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":106677,"prepare.run_cpu_time_us":3861,"prepare.run_wall_time_us":101421,"replication_time_us":129861,"thread_start_us":217364,"threads_started":2}]]}
I20260709 12:19:22.327003 23994 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:22.340296 23994 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 14 to 15, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 15 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:22.475734 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:22.533988 23996 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.574613 23996 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 10, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.593178 23996 catalog_manager.cc:5697] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 7 to 10, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 12 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:22.594172 23994 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 213) took 1466 ms. Trace:
I20260709 12:19:22.594938 23994 rpcz_store.cc:276] 0709 12:19:21.127829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.129387 (+  1558us) service_pool.cc:224] Handling call
0709 12:19:22.594056 (+1464669us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:22.412019 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:22.412666 (+   647us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:22.412708 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:19:22.412723 (+    15us) tablet.cc:662] Decoding operations
0709 12:19:22.413879 (+  1156us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:22.413944 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:22.413979 (+    35us) tablet.cc:685] Acquiring locks for 12 operations
0709 12:19:22.415146 (+  1167us) tablet.cc:701] Row locks acquired
0709 12:19:22.415169 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:19:22.415335 (+   166us) write_op.cc:270] Start()
0709 12:19:22.415489 (+   154us) write_op.cc:276] Timestamp: P: 1783599562415283 usec, L: 0
0709 12:19:22.415514 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:19:22.416336 (+   822us) log.cc:844] Serialized 4810 byte log entry
0709 12:19:22.422878 (+  6542us) op_driver.cc:464] REPLICATION: finished
0709 12:19:22.423403 (+   525us) write_op.cc:301] APPLY: starting
0709 12:19:22.423495 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:22.449440 (+ 25945us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:22.453229 (+  3789us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:22.493676 (+ 40447us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:22.493920 (+   244us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0709 12:19:22.493963 (+    43us) write_op.cc:312] APPLY: finished
0709 12:19:22.494299 (+   336us) log.cc:844] Serialized 113 byte log entry
0709 12:19:22.494505 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.494667 (+   162us) write_op.cc:454] Released schema lock
0709 12:19:22.494723 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:22.499222 (+  4499us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.499262 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27206,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":280,"apply.run_cpu_time_us":17284,"apply.run_wall_time_us":75737,"cfile_cache_hit":48,"cfile_cache_hit_bytes":50184,"num_ops":12,"prepare.queue_time_us":562,"prepare.run_cpu_time_us":4681,"prepare.run_wall_time_us":4681,"replication_time_us":7204,"spinlock_wait_cycles":66944}]]}
I20260709 12:19:22.684128 23994 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 14 to 16, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 16 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:22.685432 23994 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.686764 23994 catalog_manager.cc:5697] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 14 to 15, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 15 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.709857 23994 catalog_manager.cc:5697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.712054 24249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:22.712761 24249 raft_consensus.cc:606] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:22.729839 23994 catalog_manager.cc:5697] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 11 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:22.732304 24249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:22.733057 24249 raft_consensus.cc:606] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:22.738119 24249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:22.738646 24249 raft_consensus.cc:606] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:22.741315 24249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:22.741797 24249 raft_consensus.cc:606] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:22.749006 24249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:22.751092 24249 raft_consensus.cc:606] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:22.755184 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 196) took 1193 ms. Trace:
I20260709 12:19:22.755640 23996 rpcz_store.cc:276] 0709 12:19:21.562102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:21.562317 (+   215us) service_pool.cc:224] Handling call
0709 12:19:22.755113 (+1192796us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:22.632567 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:22.633159 (+   592us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:22.633195 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:19:22.633214 (+    19us) tablet.cc:662] Decoding operations
0709 12:19:22.633764 (+   550us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:22.633828 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:22.633855 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:19:22.634202 (+   347us) tablet.cc:701] Row locks acquired
0709 12:19:22.634223 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:19:22.634369 (+   146us) write_op.cc:270] Start()
0709 12:19:22.634489 (+   120us) write_op.cc:276] Timestamp: P: 1783599562634320 usec, L: 0
0709 12:19:22.634517 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:19:22.648201 (+ 13684us) log.cc:844] Serialized 1312 byte log entry
0709 12:19:22.652675 (+  4474us) op_driver.cc:464] REPLICATION: finished
0709 12:19:22.653072 (+   397us) write_op.cc:301] APPLY: starting
0709 12:19:22.653165 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:22.655149 (+  1984us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:22.655234 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:22.657061 (+  1827us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:22.657239 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:19:22.657282 (+    43us) write_op.cc:312] APPLY: finished
0709 12:19:22.657516 (+   234us) log.cc:844] Serialized 41 byte log entry
0709 12:19:22.658349 (+   833us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.658453 (+   104us) write_op.cc:454] Released schema lock
0709 12:19:22.658491 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:22.658906 (+   415us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:22.658941 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34326,"reported_tablets":21,"spinlock_wait_cycles":2816,"child_traces":[["op",{"apply.queue_time_us":124,"apply.run_cpu_time_us":5165,"apply.run_wall_time_us":5805,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":1953,"prepare.run_cpu_time_us":3107,"prepare.run_wall_time_us":15975,"replication_time_us":17141,"spinlock_wait_cycles":1855360}]]}
I20260709 12:19:22.767370 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:19:22.769681 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:22.773883 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:22.808632 29064 raft_consensus.cc:993] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:22.810428 29064 raft_consensus.cc:1081] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:22.815538 24175 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59344
I20260709 12:19:22.816236 24175 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:22.816668 24175 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:22.842898 24175 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:22.845281 24175 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:22.846221 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:22.846707 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:22.846975 24249 raft_consensus.cc:3055] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:22.847378 24808 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:22.847410 24249 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:22.851078 24249 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:22.855976 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet b29f161fe0e24b51ad5c1903bdc5112c with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:55732
I20260709 12:19:22.852317 24249 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:22.877841 24249 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:22.884621 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:22.888718 28884 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:22.891670 28884 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:22.892393 24808 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:22.892760 28884 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:22.909281 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 51752.4us
W20260709 12:19:22.911772 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 96605.3us
I20260709 12:19:22.943413 29075 tablet_replica.cc:333] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:19:22.944947 29075 raft_consensus.cc:2243] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:22.946008 29075 raft_consensus.cc:2272] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:22.971312 23994 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 8 to 9, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:22.973476 29075 ts_tablet_manager.cc:1916] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:22.977849 29071 raft_consensus.cc:993] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:23.015574 29071 raft_consensus.cc:1081] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:23.019412 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:23.020082 24096 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.020499 24096 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:23.071775 29064 raft_consensus.cc:993] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:23.072438 29064 raft_consensus.cc:1081] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:23.075608 24092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:23.076258 24092 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.076635 24092 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:23.093029 29075 ts_tablet_manager.cc:1929] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 12:19:23.093853 29075 log.cc:1199] T b29f161fe0e24b51ad5c1903bdc5112c P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/b29f161fe0e24b51ad5c1903bdc5112c
I20260709 12:19:23.098294 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet b29f161fe0e24b51ad5c1903bdc5112c (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:23.149320 24096 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:23.172796 24092 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:23.174345 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:23.175156 24243 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:23.175468 24243 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:23.176097 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:23.176811 24808 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:23.176381 24243 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:23.177820 24096 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:23.178099 24243 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:23.188927 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:23.189570 24168 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:23.190636 24808 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:19:23.197412 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:23.198423 29074 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:23.199002 29074 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:23.199998 29074 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:23.234336 29071 raft_consensus.cc:993] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:23.235191 29064 raft_consensus.cc:1081] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:23.242395 28632 raft_consensus.cc:993] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:23.243341 29071 raft_consensus.cc:1081] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:23.244026 24092 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:23.244421 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:23.244622 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:23.245149 24168 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:19:23.245373 24249 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:23.245822 24249 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:23.246682 24249 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:23.249083 24249 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:23.251405 24243 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:19:23.258847 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:23.261422 24092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:23.262221 24092 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.262669 24092 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:23.245149 24096 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:23.267302 24096 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:23.279291 28920 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:23.280023 28920 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:23.281042 28920 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:23.297266 24092 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:23.297864 24249 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:19:23.303462 24096 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:23.304664 24092 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:23.305641 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:23.306300 24175 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:23.308395 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:23.308856 24249 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:23.309047 24249 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:23.311075 24096 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:23.312637 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:23.313311 24243 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:23.313586 24243 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:23.314363 24243 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:23.315755 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:23.316039 24243 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:23.316407 24808 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:23.327462 24243 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:23.329820 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:23.330686 28977 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:23.331522 28977 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:23.332685 28977 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:23.316154 24249 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:23.341794 24249 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:23.348068 24175 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:19:23.363180 24247 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:23.365739 29061 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:23.368008 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:23.375233 24249 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:19:23.392328 29074 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:23.393184 29074 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:23.394593 29074 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:23.376569 24808 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:23.405670 23999 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 15 to 16, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 16 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.480325 23999 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 15 to 16, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 16 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.481585 24808 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:23.482082 23999 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 12 to 13, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 13 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.484364 23999 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 14 to 15, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 15 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:23.487423 28922 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:23.661360 24247 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:23.664713 28977 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:23.749495 24808 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:23.752306 29074 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:23.762538 24243 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:23.780763 29074 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:23.821045 24168 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:23.822877 28920 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:23.871798 24808 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:23.874123 29074 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:23.891024 24175 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:19:23.901206 24247 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:19:23.901433 28977 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:23.911136 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:23.913005 28920 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:23.929224 24249 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:19:23.934598 28920 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
W20260709 12:19:24.105490 29094 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:19:24.114092 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70481.8us
I20260709 12:19:24.316286 24092 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
W20260709 12:19:24.361456 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 168597us
W20260709 12:19:24.432428 24066 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8bcb2b2e4d1146f7a8201d801a112ca0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.436275 24244 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:24.439832 24169 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:24.449908 29117 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:24.456386 29116 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:19:24.551486 24168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8665b055009a4659b6d86621874dddbd"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:55734
I20260709 12:19:24.552294 24168 raft_consensus.cc:606] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:24.560022 24168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "984475bb8f024d469921acdc98196b93"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:55734
I20260709 12:19:24.560730 24168 raft_consensus.cc:606] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:24.561069 29119 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.063s	user 0.000s	sys 0.002s
I20260709 12:19:24.563848 24168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:55734
I20260709 12:19:24.564502 24168 raft_consensus.cc:606] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:24.565915 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:19:24.568361 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:24.569296 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:24.634923 29074 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:24.639346 24244 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:24.644649 24175 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:24.672238 28922 raft_consensus.cc:993] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:24.672818 28922 raft_consensus.cc:1081] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:24.675343 24098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8665b055009a4659b6d86621874dddbd"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37604
I20260709 12:19:24.675966 24098 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:24.676368 24098 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:24.679170 23999 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:24.682595 24244 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:24.686241 29107 raft_consensus.cc:993] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:24.695564 29107 raft_consensus.cc:1081] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:24.691385 24098 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:24.699975 24093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "984475bb8f024d469921acdc98196b93"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37604
I20260709 12:19:24.700616 24093 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:24.700999 24093 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:24.702126 24098 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:24.703318 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:24.703963 24249 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:24.714102 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:24.720438 24175 raft_consensus.cc:3055] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:24.730899 24175 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:24.734206 24249 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:24.737993 24066 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:24.739670 29117 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:24.740293 29117 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:24.741293 29117 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:24.735249 24175 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:24.746280 24175 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:19:24.758260 24215 consensus_peers.cc:597] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c617be9ee61e4bb583e2fecf7f8cd9b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:24.760345 24098 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:24.762262 29113 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:24.770952 24173 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:24.773681 24093 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:24.789565 24175 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:24.797919 24093 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:24.801414 29113 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:24.814591 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:24.815323 24173 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:24.815613 24173 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:24.805621 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:24.816242 24249 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:24.816437 24173 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:24.817929 24173 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:24.852710 24249 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:24.853956 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:24.856710 29117 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:24.863495 24173 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:19:24.867218 28632 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:24.870671 29117 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:24.871790 29117 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:24.875211 24173 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:24.892427 24093 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:24.911042 29131 ts_tablet_manager.cc:933] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:19:24.940737 29131 tablet_copy_client.cc:323] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
I20260709 12:19:24.953231 24096 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
W20260709 12:19:24.985424 29132 log.cc:927] Time spent T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:19:24.998778 29099 raft_consensus.cc:993] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:24.999455 29099 raft_consensus.cc:1081] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:25.019959 24098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37604
I20260709 12:19:25.023041 24098 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:25.023528 24098 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.017653 23996 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.057404 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet 8bcb2b2e4d1146f7a8201d801a112ca0 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:19:25.058290 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet 8bcb2b2e4d1146f7a8201d801a112ca0 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-8bcb2b2e4d1146f7a8201d801a112ca0
I20260709 12:19:25.064697 24098 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:25.076851 24243 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:25.079070 24111 tablet_copy_source_session.cc:215] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:25.084157 24176 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:25.085882 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:25.087160 24098 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:25.087342 24243 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:25.089701 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:25.079218 29114 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:19:25.090415 24176 raft_consensus.cc:3055] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:25.091656 24176 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:25.093322 24176 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:25.095408 24176 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:25.104053 24066 consensus_peers.cc:597] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73fc2a59a00e4ea6a3b63c28c6f58512. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:25.104993 24243 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:25.110340 29074 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:19:25.116211 23994 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 9 to 10, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.117940 23994 catalog_manager.cc:5697] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 12 to 13, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 13 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.124179 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:25.125758 29131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bcb2b2e4d1146f7a8201d801a112ca0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:25.130427 29137 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:25.136077 29137 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:25.153501 24176 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:25.162129 24173 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:25.164115 29074 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:25.172955 24176 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:25.156510 29114 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:25.147547 29137 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:25.340276 24176 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
W20260709 12:19:25.446125 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 134666us
I20260709 12:19:25.449406 24244 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:25.468539 24249 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:25.481958 29114 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:25.486115 24245 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:19:25.496646 24096 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:19:25.507133 29097 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:25.544538 29131 tablet_copy_client.cc:806] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:25.547256 29131 tablet_copy_client.cc:670] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:25.550648 29097 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:19:25.562500 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 56893.8us
I20260709 12:19:25.561733 23999 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 10, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 14 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:25.598402 29157 ts_tablet_manager.cc:933] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
W20260709 12:19:25.629809 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 51524.6us
I20260709 12:19:25.631781 24169 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:25.652848 29074 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:25.669116 29131 tablet_copy_client.cc:538] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:25.670789 24244 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:19:25.676074 24247 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:25.690858 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:25.709895 29159 ts_tablet_manager.cc:933] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:25.738314 29157 tablet_copy_client.cc:323] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
W20260709 12:19:25.773427 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 131804us
I20260709 12:19:25.785470 29116 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:19:25.788324 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet 73fc2a59a00e4ea6a3b63c28c6f58512 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:19:25.788465 29149 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260709 12:19:25.789186 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet 73fc2a59a00e4ea6a3b63c28c6f58512 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-73fc2a59a00e4ea6a3b63c28c6f58512
I20260709 12:19:25.812112 29131 tablet_bootstrap.cc:492] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:25.811388 28922 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:25.815694 24170 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:25.824753 24093 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:25.826957 29150 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 12:19:25.831188 24141 consensus_peers.cc:597] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e37f672475a541c4b15e807dbe8bcd7d. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:25.871120 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 90650.3us
I20260709 12:19:25.905782 24111 tablet_copy_source_session.cc:215] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:25.916728 23994 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 10 to 11, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:25.893472 29159 tablet_copy_client.cc:323] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:19:25.950910 29157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73fc2a59a00e4ea6a3b63c28c6f58512. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:26.037381 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 155576us
I20260709 12:19:26.086676 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet c617be9ee61e4bb583e2fecf7f8cd9b2 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:19:26.087466 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet c617be9ee61e4bb583e2fecf7f8cd9b2 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-c617be9ee61e4bb583e2fecf7f8cd9b2
I20260709 12:19:26.123541 24250 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:26.096225 23996 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:26.163414 29157 tablet_copy_client.cc:806] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:26.164248 29157 tablet_copy_client.cc:670] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:26.199082 29157 tablet_copy_client.cc:538] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:19:26.215517 29131 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:19:26.242879 24098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:26.254434 24098 raft_consensus.cc:606] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:26.264393 24259 tablet_copy_source_session.cc:215] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:26.268806 29157 tablet_bootstrap.cc:492] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:26.272259 29159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c617be9ee61e4bb583e2fecf7f8cd9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:26.262814 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:26.277316 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:26.301383 29131 tablet_bootstrap.cc:492] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:26.302745 29131 tablet_bootstrap.cc:492] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:26.303706 29131 ts_tablet_manager.cc:1403] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.505s	user 0.053s	sys 0.032s
I20260709 12:19:26.305619 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:26.329485 29147 raft_consensus.cc:993] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:26.330248 29147 raft_consensus.cc:1081] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:26.335295 24245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 12:19:26.336757 24245 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:26.337196 24245 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:26.355974 29131 raft_consensus.cc:359] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:26.357152 29131 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:26.358017 29131 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:26.364988 29131 ts_tablet_manager.cc:1434] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.061s	user 0.006s	sys 0.002s
I20260709 12:19:26.368479 24111 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-8bcb2b2e4d1146f7a8201d801a112ca0 received from {username='slave'} at 127.0.0.1:50598
I20260709 12:19:26.369102 24111 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-8bcb2b2e4d1146f7a8201d801a112ca0 on tablet 8bcb2b2e4d1146f7a8201d801a112ca0 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:26.383714 29159 tablet_copy_client.cc:806] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:26.384684 29159 tablet_copy_client.cc:670] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:26.394446 29159 tablet_copy_client.cc:538] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:26.404769 24245 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:26.412940 24245 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:26.413590 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:26.414196 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:26.414496 24096 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:26.414832 24096 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:26.414849 24173 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:26.416326 24096 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:26.418955 24096 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:26.432619 29131 ts_tablet_manager.cc:933] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:26.456243 29131 tablet_copy_client.cc:323] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:19:26.516732 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet e37f672475a541c4b15e807dbe8bcd7d from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:19:26.517556 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet e37f672475a541c4b15e807dbe8bcd7d from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-e37f672475a541c4b15e807dbe8bcd7d
I20260709 12:19:26.528364 24173 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:26.530784 24186 tablet_copy_source_session.cc:215] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:26.557121 24808 raft_consensus.cc:1217] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:19:26.567930 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:26.569823 29163 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:26.570432 29163 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:26.572073 29163 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:26.608225 29131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e37f672475a541c4b15e807dbe8bcd7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:26.574625 24096 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:26.644960 29159 tablet_bootstrap.cc:492] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:26.622797 23996 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 10 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:26.773654 29157 tablet_bootstrap.cc:492] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:26.775131 29157 tablet_bootstrap.cc:492] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:26.776289 29157 ts_tablet_manager.cc:1403] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.508s	user 0.047s	sys 0.015s
I20260709 12:19:26.838157 29157 raft_consensus.cc:359] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:26.851369 29157 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:26.852360 29157 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:26.854849 29157 ts_tablet_manager.cc:1434] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:19:26.862769 24111 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-73fc2a59a00e4ea6a3b63c28c6f58512 received from {username='slave'} at 127.0.0.1:50598
I20260709 12:19:26.863350 24111 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-73fc2a59a00e4ea6a3b63c28c6f58512 on tablet 73fc2a59a00e4ea6a3b63c28c6f58512 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:26.882453 29131 tablet_copy_client.cc:806] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:26.884908 29131 tablet_copy_client.cc:670] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:26.890123 29131 tablet_copy_client.cc:538] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:26.957075 29131 tablet_bootstrap.cc:492] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:26.973121 24093 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:26.975509 29163 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:26.980291 24173 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:26.986115 29163 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:26.997542 29117 raft_consensus.cc:1064] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:27.001027 29117 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:27.036352 24808 raft_consensus.cc:1217] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 12:19:27.093627 24808 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:27.113372 24169 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:19:27.126068 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47772us
I20260709 12:19:27.125016 29155 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:27.180760 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 77228.3us
I20260709 12:19:27.187529 24245 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:27.195534 29155 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:27.214614 29146 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:19:27.300273 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 87752.5us
W20260709 12:19:27.328361 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 77160us
W20260709 12:19:27.393569 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 70103.9us
W20260709 12:19:27.419487 29159 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 12:19:27.576192 29117 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:27.584980 24811 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:27.600354 29197 raft_consensus.cc:1064] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:27.604736 29197 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:27.682355 29159 tablet_bootstrap.cc:492] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:27.684379 29159 tablet_bootstrap.cc:492] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:27.685312 29159 ts_tablet_manager.cc:1403] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 1.041s	user 0.047s	sys 0.018s
I20260709 12:19:27.686753 29131 tablet_bootstrap.cc:492] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:27.685051 23996 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:27.687317 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 191500us
I20260709 12:19:27.701493 29131 tablet_bootstrap.cc:492] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:27.702527 29131 ts_tablet_manager.cc:1403] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.748s	user 0.063s	sys 0.125s
I20260709 12:19:27.710435 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:27.755012 29131 raft_consensus.cc:359] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:27.765733 29131 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:27.767478 29131 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:27.724457 29159 raft_consensus.cc:359] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:27.793253 29159 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:27.794272 29159 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:27.797231 29159 ts_tablet_manager.cc:1434] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.111s	user 0.003s	sys 0.005s
I20260709 12:19:27.820281 29131 ts_tablet_manager.cc:1434] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.117s	user 0.009s	sys 0.000s
I20260709 12:19:27.833868 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-e37f672475a541c4b15e807dbe8bcd7d received from {username='slave'} at 127.0.0.1:44066
I20260709 12:19:27.834410 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-e37f672475a541c4b15e807dbe8bcd7d on tablet e37f672475a541c4b15e807dbe8bcd7d with peer c090031f610346ed82285cd847bca6d6
W20260709 12:19:27.839798 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 116460us
I20260709 12:19:27.855710 24241 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:27.857129 24241 raft_consensus.cc:606] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:27.862835 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:27.866369 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:27.870350 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:27.903198 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 135750us
I20260709 12:19:27.912408 24169 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:27.920409 29121 raft_consensus.cc:993] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:27.921075 29121 raft_consensus.cc:1081] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:27.924405 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:27.925119 24096 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:27.925549 24096 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:27.934165 24170 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:27.951052 29200 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:19:27.974216 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 204489us
I20260709 12:19:27.985384 24241 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:27.980679 24096 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:27.987269 24241 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:27.988588 24808 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 14 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:19:27.989876 24096 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:28.004220 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:28.004973 24244 raft_consensus.cc:3055] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:28.005330 24244 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:28.006225 24244 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:28.007748 24244 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:28.017154 29219 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:28.019402 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:28.020134 24808 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:28.020732 24244 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:28.022948 29218 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:28.031001 24808 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:28.032651 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-c617be9ee61e4bb583e2fecf7f8cd9b2 received from {username='slave'} at 127.0.0.1:59766
I20260709 12:19:28.035831 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-c617be9ee61e4bb583e2fecf7f8cd9b2 on tablet c617be9ee61e4bb583e2fecf7f8cd9b2 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:28.042172 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:28.044183 29219 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:28.044751 29219 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:28.045765 29219 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:28.080693 24096 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:28.133747 24811 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:28.135632 29210 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:28.287117 24811 raft_consensus.cc:1217] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
W20260709 12:19:28.309577 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 156332us
W20260709 12:19:28.415859 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 105096us
W20260709 12:19:28.491607 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 102545us
I20260709 12:19:28.565830 24811 raft_consensus.cc:1217] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:19:28.442050 29218 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:28.567070 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 120613us
W20260709 12:19:28.603044 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 51876us
I20260709 12:19:28.634370 24169 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:19:28.703927 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 156805us
I20260709 12:19:28.719898 23996 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 11 to 12, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 12 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:28.732136 29245 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:19:28.746881 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 188248us
I20260709 12:19:28.764806 29244 raft_consensus.cc:1064] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:28.661060 29117 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:28.820691 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 65109.1us
W20260709 12:19:28.838214 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 53413.4us
W20260709 12:19:28.841018 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 53523.1us
W20260709 12:19:28.847895 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 235148us
I20260709 12:19:28.867175 24246 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:28.873284 24243 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:28.874095 24808 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:28.908044 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8bcb2b2e4d1146f7a8201d801a112ca0 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:28.920534 24813 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:28.922520 29236 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:28.921861 24806 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:28.898180 29244 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:28.940292 29219 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:28.932385 24169 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:29.040859 29242 raft_consensus.cc:1064] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:29.050992 23994 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 10 to 11, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:29.085974 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:29.059218 24170 raft_consensus.cc:2955] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:29.102116 29242 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:29.147905 29260 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:19:29.179904 24806 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 8 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:29.186379 24250 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:29.196488 23999 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:29.237116 24093 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:19:29.245116 29253 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:19:29.253309 29228 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:19:29.345571 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 111304us
I20260709 12:19:29.298189 29228 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 12:19:29.514241 24246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:29.515177 24246 raft_consensus.cc:606] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:29.626308 29264 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260709 12:19:29.629341 29262 log.cc:927] Time spent T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
W20260709 12:19:29.652501 29266 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:19:29.665040 29269 log.cc:927] Time spent T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:19:29.593825 29252 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:29.699100 29252 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:29.778115 29252 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:29.791996 24812 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:19:29.800038 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 417881us
W20260709 12:19:29.828800 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 210170us
I20260709 12:19:29.839665 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet 8bcb2b2e4d1146f7a8201d801a112ca0 with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:40964
I20260709 12:19:29.855485 29198 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:29.865602 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:29.868222 29286 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:29.887712 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:29.889329 29286 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:29.891412 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:29.892606 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:29.892614 29286 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:29.919183 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56855.6us
I20260709 12:19:29.965342 24092 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:19:29.966501 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:29.971681 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:29.976852 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 71296.3us
I20260709 12:19:29.981223 24094 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:30.029839 29233 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:19:30.035044 24214 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:30.046793 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:30.048537 29278 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:30.053622 29277 raft_consensus.cc:993] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:30.054919 29252 raft_consensus.cc:1081] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:30.058495 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:30.059166 24096 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:30.059542 24096 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:30.060448 29244 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:30.062346 24246 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:30.072045 24096 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:30.073633 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:30.078526 24096 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:30.086325 24173 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:30.089510 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:30.116818 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 74693.1us
I20260709 12:19:30.122087 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:30.128387 24808 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:30.138872 24808 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 19.
I20260709 12:19:30.139783 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:30.140568 24241 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:19:30.140805 24241 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:30.153293 24241 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:30.168298 29288 tablet_replica.cc:333] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:19:30.175015 24241 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:19:30.177582 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:30.191229 24140 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:30.192575 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49581.1us
I20260709 12:19:30.219085 24241 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 19.
W20260709 12:19:30.244151 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 90876.5us
I20260709 12:19:30.248978 29156 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:30.272342 29232 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:19:30.279069 29270 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:19:30.280067 29270 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:30.281445 29270 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:30.391387 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 168397us
I20260709 12:19:30.399715 29279 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:30.427018 29297 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:30.427868 29297 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:30.430974 29297 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:30.469318 24808 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:30.479265 29234 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:30.435629 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:30.449326 23994 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:30.496340 24096 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:30.457149 24813 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:30.434453 29298 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:30.503428 29298 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:30.504261 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 65893.3us
I20260709 12:19:30.495760 24241 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:19:30.512809 24808 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:30.497126 29291 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:19:30.519255 29298 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:30.527400 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:30.535578 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:30.568910 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:30.537261 24095 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:30.604252 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:30.610948 24140 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:30.631517 29220 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:30.642834 29298 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:19:30.651680 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46636.9us
I20260709 12:19:30.655659 29288 raft_consensus.cc:2243] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:30.660149 29288 raft_consensus.cc:2272] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:30.682482 29288 ts_tablet_manager.cc:1916] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:30.695518 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:30.719094 29240 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:30.720836 29219 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:30.721544 29220 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:46626 (request call id 2) took 1395 ms. Trace:
I20260709 12:19:30.722114 29220 rpcz_store.cc:276] 0709 12:19:29.326306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.326501 (+   195us) service_pool.cc:224] Handling call
0709 12:19:29.742447 (+415946us) spinlock_profiling.cc:243] Waited 396 ms on lock 0x7b1800257100. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c055b673d 00007f4c05581f3f 00007f4c055816b3 00007f4c055799fa 00007f4c0a5414c9 00007f4c03abdc54 00007f4c03abdbe2 00007f4c03abdb11 00007f4c03abda8c 00007f4c03abcd42
0709 12:19:29.936861 (+194414us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b5800488fd0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054d70aa 00007f4c05559447 00007f4c0557670a 00007f4c0557776a 00007f4c0557691b 00007f4c0558203c 00007f4c055816b3 00007f4c055799fa 00007f4c0a5414c9 00007f4c03abdc54
0709 12:19:30.018773 (+ 81912us) log.cc:844] Serialized 501 byte log entry
0709 12:19:30.313333 (+294560us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b54000ff3a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c054fbb26 00007f4c054f549a 00007f4c054f4714 00007f4c054d4eaa 00007f4c054dbd53 00007f4c054dbcd9 00007f4c054dbc69 00007f4c054dbc31 00007f4c054dadfd 0000000000388634
0709 12:19:30.405944 (+ 92611us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b4c00457940. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03847a20 00007f4c03858a29 00007f4c0385913f 00007f4c0381d2ab 00007f4c0384af3c 00007f4c0384b3fe 00007f4c03ad850b 00007f4c054d7381 00007f4c054d526b 00007f4c054dbd53 00007f4c054dbcd9
0709 12:19:30.446341 (+ 40397us) spinlock_profiling.cc:243] Waited 4.06 ms on lock 0x7b180027d300. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:19:30.721421 (+275080us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45471,"raft.queue_time_us":47167,"raft.run_cpu_time_us":6677,"raft.run_wall_time_us":234288,"spinlock_wait_cycles":1258060288,"thread_start_us":179073,"threads_started":1,"wal-append.queue_time_us":212682}
I20260709 12:19:30.725720 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73fc2a59a00e4ea6a3b63c28c6f58512 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:30.727308 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69901.1us
I20260709 12:19:30.738086 24808 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:30.742496 24250 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:30.763389 29254 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:30.769415 23998 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 18 to 19, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 19 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:30.753381 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 142525us
I20260709 12:19:30.862933 24808 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 19 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:19:30.873839 29276 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:19:30.874933 29288 ts_tablet_manager.cc:1929] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 12:19:30.909242 29288 log.cc:1199] T 8bcb2b2e4d1146f7a8201d801a112ca0 P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/8bcb2b2e4d1146f7a8201d801a112ca0
I20260709 12:19:30.892203 24249 raft_consensus.cc:2955] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:30.899538 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 65764.9us
I20260709 12:19:30.910828 29288 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:40964 (request call id 75) took 1072 ms. Trace:
I20260709 12:19:30.923563 29288 rpcz_store.cc:276] 0709 12:19:29.838899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:29.839199 (+   300us) service_pool.cc:224] Handling call
0709 12:19:30.158633 (+319434us) ts_tablet_manager.cc:1151] Deleting tablet 8bcb2b2e4d1146f7a8201d801a112ca0
0709 12:19:30.163719 (+  5086us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:19:30.746743 (+583024us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:30.874735 (+127992us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:30.910731 (+ 35996us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":377816,"tablet-delete.queue_time_us":297025,"thread_start_us":278175,"threads_started":1}
I20260709 12:19:30.937233 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet 8bcb2b2e4d1146f7a8201d801a112ca0 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:30.924335 24175 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:31.037014 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53833.6us
I20260709 12:19:31.073218 23999 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:31.143306 23998 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 11 to 12, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 14 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:31.179124 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet 73fc2a59a00e4ea6a3b63c28c6f58512 with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:55732
I20260709 12:19:31.188136 24168 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:31.263736 24249 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:31.284708 29322 tablet_replica.cc:333] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:19:31.285115 24808 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:31.286010 29322 raft_consensus.cc:2243] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.300252 29322 raft_consensus.cc:2272] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.303187 29156 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:31.306083 29322 ts_tablet_manager.cc:1916] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:31.309513 24093 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:19:31.317018 24813 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:31.318022 29285 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:31.321132 24175 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:31.324740 29253 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:31.327174 29211 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:31.332598 24811 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:31.337625 29211 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:31.339927 29203 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:31.353132 24175 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:31.355919 24097 raft_consensus.cc:2955] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:31.365952 24813 raft_consensus.cc:2955] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:31.402491 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c617be9ee61e4bb583e2fecf7f8cd9b2 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:31.489490 23994 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 8 to 9, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:31.492547 23985 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet c617be9ee61e4bb583e2fecf7f8cd9b2 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER failed with leader fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 10 but the committed config has opid_index of 11
I20260709 12:19:31.494846 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:31.507529 23996 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 10 to 11, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:31.547101 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet c617be9ee61e4bb583e2fecf7f8cd9b2 with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:46626
I20260709 12:19:31.601037 29322 ts_tablet_manager.cc:1929] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:19:31.610510 29322 log.cc:1199] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/73fc2a59a00e4ea6a3b63c28c6f58512
I20260709 12:19:31.612095 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e37f672475a541c4b15e807dbe8bcd7d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:31.613782 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet 73fc2a59a00e4ea6a3b63c28c6f58512 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:31.617136 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet e37f672475a541c4b15e807dbe8bcd7d with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:40964
I20260709 12:19:31.637157 29323 tablet_replica.cc:333] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:19:31.638734 29323 raft_consensus.cc:2243] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.639858 29323 raft_consensus.cc:2272] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.645628 29323 ts_tablet_manager.cc:1916] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:31.669260 29324 tablet_replica.cc:333] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:19:31.679176 29324 raft_consensus.cc:2243] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:31.680585 29324 raft_consensus.cc:2272] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:31.684868 29324 ts_tablet_manager.cc:1916] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:31.747480 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8665b055009a4659b6d86621874dddbd"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:31.750344 24097 raft_consensus.cc:606] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:31.758659 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "984475bb8f024d469921acdc98196b93"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:31.759537 24093 raft_consensus.cc:606] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:31.766117 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:31.768658 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:31.773137 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:31.787982 29324 ts_tablet_manager.cc:1929] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 12:19:31.788658 29324 log.cc:1199] T e37f672475a541c4b15e807dbe8bcd7d P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/e37f672475a541c4b15e807dbe8bcd7d
I20260709 12:19:31.794631 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet e37f672475a541c4b15e807dbe8bcd7d (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:31.804848 29323 ts_tablet_manager.cc:1929] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 12:19:31.805485 29323 log.cc:1199] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/c617be9ee61e4bb583e2fecf7f8cd9b2
I20260709 12:19:31.807698 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet c617be9ee61e4bb583e2fecf7f8cd9b2 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
W20260709 12:19:31.812367 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 43812.5us
I20260709 12:19:31.909847 29281 raft_consensus.cc:993] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:31.910537 29281 raft_consensus.cc:1081] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:31.914642 24250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "984475bb8f024d469921acdc98196b93"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 12:19:31.915329 24250 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:31.915742 24250 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.939868 24250 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:31.958639 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:31.959401 24097 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:31.959733 24097 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:31.960585 24097 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:31.970160 24097 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.971611 24250 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:31.973008 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:31.974145 24176 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:31.986619 24176 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:31.990245 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:31.991315 29211 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:31.991910 29211 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:31.992960 29211 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:32.017177 24097 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:32.045310 23996 catalog_manager.cc:5697] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 13 to 14, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 14 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:32.115773 29218 raft_consensus.cc:993] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:32.116446 29218 raft_consensus.cc:1081] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:32.118402 24250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8665b055009a4659b6d86621874dddbd"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 12:19:32.119097 24250 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:32.119509 24250 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:32.149820 24250 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:32.152325 24250 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:32.153506 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:32.153872 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:32.154255 24175 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:32.154457 24093 raft_consensus.cc:3055] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:32.154825 24093 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:32.155730 24093 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:32.157702 24093 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:32.164211 24175 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:32.168165 24216 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:32.169135 29211 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:32.169704 29211 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:32.170756 29211 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:32.168255 24093 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:32.228173 23996 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 10 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:32.429916 24175 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:32.434581 29211 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:32.535662 24095 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:19:32.540442 29279 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:32.661578 24095 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:32.663537 29211 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:32.717824 24176 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:32.719740 29300 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:32.885730 24175 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
W20260709 12:19:32.928697 24141 consensus_peers.cc:597] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7c552e5996384fef9c032a7fda531298. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:32.932031 24097 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:32.934338 28922 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:32.952622 24250 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:32.958802 29240 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:32.967757 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:33.000610 29339 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.080s	user 0.014s	sys 0.025s
I20260709 12:19:33.022403 28922 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.024096 24095 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.069201 24244 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:33.072103 24243 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Committing config change with OpId 10.7: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.073985 23996 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 10 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.108703 24095 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:33.119084 24175 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:19:33.116693 24215 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f4b7521a95604ae58fb9e26c98b5e4a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:33.119622 29300 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:19:33.133370 29211 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:33.139278 24244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:33.140080 24244 raft_consensus.cc:606] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:33.146246 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:33.148679 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:33.149653 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:33.182595 29211 raft_consensus.cc:993] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:33.184350 29211 raft_consensus.cc:1081] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:33.212580 29300 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.214471 24093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:33.215597 24093 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:33.216022 24093 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.222051 24175 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.228726 24093 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:33.241400 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:33.240603 24095 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.242208 24176 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.260425 24093 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:33.266889 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:33.268004 24244 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:33.268481 24244 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:33.272433 24244 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:33.286922 24244 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:33.355736 23999 catalog_manager.cc:5697] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.330710 24167 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:33.420681 24176 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:33.424355 24067 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:33.428777 29281 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:33.486876 24244 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
W20260709 12:19:33.497396 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 62110.4us
I20260709 12:19:33.475543 29281 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:33.517868 29281 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:33.566407 24141 consensus_peers.cc:597] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d4ba8a9e171042a4a56a0f731bf431cc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:33.622215 29363 ts_tablet_manager.cc:933] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:33.631335 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 122325us
I20260709 12:19:33.633463 29361 ts_tablet_manager.cc:933] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:33.696695 24244 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:33.697486 23999 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 11 to 12, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 12 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:33.715003 24095 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:33.726869 29240 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:33.756006 29361 tablet_copy_client.cc:323] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:19:33.760386 29364 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:33.771904 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet 7c552e5996384fef9c032a7fda531298 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:19:33.772591 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet 7c552e5996384fef9c032a7fda531298 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-7c552e5996384fef9c032a7fda531298
I20260709 12:19:33.790019 29363 tablet_copy_client.cc:323] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:19:33.794643 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet f4b7521a95604ae58fb9e26c98b5e4a6 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:19:33.795866 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet f4b7521a95604ae58fb9e26c98b5e4a6 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-f4b7521a95604ae58fb9e26c98b5e4a6
I20260709 12:19:33.811120 29364 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.816669 24095 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.819849 24259 tablet_copy_source_session.cc:215] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:33.816751 24186 tablet_copy_source_session.cc:215] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:33.836535 29361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c552e5996384fef9c032a7fda531298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:33.837461 23999 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 6, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.839499 29363 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4b7521a95604ae58fb9e26c98b5e4a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:33.859951 29361 tablet_copy_client.cc:806] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:33.860764 29361 tablet_copy_client.cc:670] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:33.891217 29361 tablet_copy_client.cc:538] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:33.891896 24243 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:33.902640 24167 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:33.909010 29351 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:33.948380 29363 tablet_copy_client.cc:806] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:33.949119 29363 tablet_copy_client.cc:670] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:33.953754 29363 tablet_copy_client.cc:538] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:33.982403 24243 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:33.985338 29284 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:33.998481 29363 tablet_bootstrap.cc:492] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:34.009229 24093 consensus_queue.cc:237] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:34.072577 29372 ts_tablet_manager.cc:933] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:19:34.092970 24066 consensus_peers.cc:597] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66b5cb14ed8f4b58a27e168bcac560d2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:34.101624 24176 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:19:34.119551 29374 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.088s	user 0.000s	sys 0.006s
I20260709 12:19:34.124809 29361 tablet_bootstrap.cc:492] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:34.109411 29281 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:19:34.147296 24250 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:19:34.153695 29218 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:19:34.187614 29372 tablet_copy_client.cc:323] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:19:34.189694 29351 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:34.195703 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet d4ba8a9e171042a4a56a0f731bf431cc from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:19:34.196405 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet d4ba8a9e171042a4a56a0f731bf431cc from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-d4ba8a9e171042a4a56a0f731bf431cc
I20260709 12:19:34.226586 24250 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:34.204170 24168 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Committing config change with OpId 7.5: config changed from index -1 to 5, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:34.241072 24186 tablet_copy_source_session.cc:215] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:34.334622 29372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4ba8a9e171042a4a56a0f731bf431cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.346295 23994 catalog_manager.cc:5697] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 5, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:34.425634 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:34.491357 29372 tablet_copy_client.cc:806] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:34.492147 29372 tablet_copy_client.cc:670] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:34.516383 29372 tablet_copy_client.cc:538] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:34.529716 29361 tablet_bootstrap.cc:492] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:34.530952 29361 tablet_bootstrap.cc:492] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:34.538468 29361 ts_tablet_manager.cc:1403] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.414s	user 0.043s	sys 0.015s
I20260709 12:19:34.537573 29372 tablet_bootstrap.cc:492] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:34.542078 29361 raft_consensus.cc:359] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:34.556704 29361 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:34.557592 29361 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:34.560807 29361 ts_tablet_manager.cc:1434] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.005s
I20260709 12:19:34.572377 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-7c552e5996384fef9c032a7fda531298 received from {username='slave'} at 127.0.0.1:44066
I20260709 12:19:34.572916 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-7c552e5996384fef9c032a7fda531298 on tablet 7c552e5996384fef9c032a7fda531298 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:34.618350 29361 ts_tablet_manager.cc:933] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:19:34.639169 29361 tablet_copy_client.cc:323] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
I20260709 12:19:34.642215 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet 66b5cb14ed8f4b58a27e168bcac560d2 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:19:34.642803 29372 tablet_bootstrap.cc:492] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:34.642940 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet 66b5cb14ed8f4b58a27e168bcac560d2 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-66b5cb14ed8f4b58a27e168bcac560d2
I20260709 12:19:34.644172 29372 tablet_bootstrap.cc:492] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:34.645107 29372 ts_tablet_manager.cc:1403] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.108s	user 0.048s	sys 0.018s
I20260709 12:19:34.649501 29372 raft_consensus.cc:359] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:34.650488 29372 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:34.651284 29372 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:34.654608 29372 ts_tablet_manager.cc:1434] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.003s
I20260709 12:19:34.657501 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-d4ba8a9e171042a4a56a0f731bf431cc received from {username='slave'} at 127.0.0.1:44066
I20260709 12:19:34.657989 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-d4ba8a9e171042a4a56a0f731bf431cc on tablet d4ba8a9e171042a4a56a0f731bf431cc with peer c090031f610346ed82285cd847bca6d6
W20260709 12:19:34.659538 29363 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.125s	user 0.004s	sys 0.000s
I20260709 12:19:34.697264 24111 tablet_copy_source_session.cc:215] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:34.738955 29361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66b5cb14ed8f4b58a27e168bcac560d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:34.800978 29363 tablet_bootstrap.cc:492] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=1 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:34.814548 29363 tablet_bootstrap.cc:492] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:34.815685 29363 ts_tablet_manager.cc:1403] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.820s	user 0.074s	sys 0.038s
I20260709 12:19:34.823096 29361 tablet_copy_client.cc:806] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:34.823951 29361 tablet_copy_client.cc:670] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:34.828785 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:34.830422 29361 tablet_copy_client.cc:538] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:34.830384 24097 raft_consensus.cc:606] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:34.832847 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:34.835412 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:34.836457 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:34.827705 29363 raft_consensus.cc:359] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:34.844915 29363 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:34.851694 29363 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:34.877310 29363 ts_tablet_manager.cc:1434] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.000s
I20260709 12:19:34.886152 29361 tablet_bootstrap.cc:492] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:34.890547 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-f4b7521a95604ae58fb9e26c98b5e4a6 received from {username='slave'} at 127.0.0.1:59766
I20260709 12:19:34.891135 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-f4b7521a95604ae58fb9e26c98b5e4a6 on tablet f4b7521a95604ae58fb9e26c98b5e4a6 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:35.103245 24811 raft_consensus.cc:1217] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 LEARNER]: Deduplicated request from leader. Original: 10.6->[10.7-10.7]   Dedup: 10.7->[]
I20260709 12:19:35.111461 24813 raft_consensus.cc:1217] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 12:19:35.127144 29361 tablet_bootstrap.cc:492] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:35.128345 29361 tablet_bootstrap.cc:492] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:35.129191 29361 ts_tablet_manager.cc:1403] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.243s	user 0.042s	sys 0.002s
I20260709 12:19:35.188179 29361 raft_consensus.cc:359] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:35.189312 29361 raft_consensus.cc:740] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:35.190125 29361 consensus_queue.cc:260] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:35.197925 29361 ts_tablet_manager.cc:1434] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.068s	user 0.010s	sys 0.000s
I20260709 12:19:35.199975 24111 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-66b5cb14ed8f4b58a27e168bcac560d2 received from {username='slave'} at 127.0.0.1:50598
I20260709 12:19:35.200462 24111 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-66b5cb14ed8f4b58a27e168bcac560d2 on tablet 66b5cb14ed8f4b58a27e168bcac560d2 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:35.300082 29393 raft_consensus.cc:993] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:35.300786 29393 raft_consensus.cc:1081] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:35.305219 24244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 12:19:35.305908 24244 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:35.306279 24244 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.333647 24244 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:35.346838 24813 raft_consensus.cc:1217] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 12:19:35.352217 24244 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:35.353606 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:35.354169 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:35.354497 24097 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:35.354846 24813 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.354959 24097 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:35.356585 24097 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:35.359381 24097 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:35.364050 24813 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:19:35.367954 24215 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:35.371309 29344 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:35.372236 29344 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:35.372839 24097 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:19:35.373291 29344 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:35.445699 23999 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 14 to 15, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 15 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:35.607628 29376 raft_consensus.cc:1064] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:35.626170 29401 raft_consensus.cc:1064] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:35.632207 29401 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 4, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:35.682041 29376 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 5, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:35.517397 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 53914.6us
I20260709 12:19:35.785027 24250 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:35.793462 24811 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:35.804546 29401 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:35.829357 24813 raft_consensus.cc:1217] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.4->[7.5-7.5]   Dedup: 7.5->[]
I20260709 12:19:35.864216 24813 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:35.866724 29344 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:35.878412 29378 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:35.889217 24250 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:35.900063 24808 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:35.930843 29401 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:19:35.952601 29284 raft_consensus.cc:1064] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:35.978123 24092 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:19:35.980588 29211 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:35.988365 29403 raft_consensus.cc:1064] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:35.989665 24093 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:36.006894 29378 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:36.045168 24097 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:35.994848 29403 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:36.086642 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 51051.4us
W20260709 12:19:36.087817 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70328.8us
I20260709 12:19:36.113390 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:36.131493 29284 consensus_queue.cc:237] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 3, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:36.195987 29400 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:19:36.177372 29378 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260709 12:19:36.242100 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 85565.5us
W20260709 12:19:36.239965 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 109294us
W20260709 12:19:36.257738 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 60320.5us
W20260709 12:19:36.257999 29409 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:19:36.313026 24808 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:36.358309 29378 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:36.365213 24175 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:19:36.414287 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 138060us
I20260709 12:19:36.443430 29403 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:36.458469 24094 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:19:36.539063 29402 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:36.552995 29433 log.cc:927] Time spent T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:19:36.559662 24250 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:36.567550 29425 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:19:36.628926 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49269.3us
I20260709 12:19:36.640883 24808 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:19:36.717103 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44315.6us
W20260709 12:19:36.724563 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 51782.1us
I20260709 12:19:36.747049 24169 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:36.774946 24243 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:19:36.843175 24806 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:36.845249 24248 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:36.861253 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 88167.5us
I20260709 12:19:36.862147 24095 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:36.868345 29218 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:36.841321 29400 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:36.872462 24813 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:36.951930 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 57840.9us
I20260709 12:19:36.967748 29385 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:36.969784 29394 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:36.885713 24092 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:37.057884 29378 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.696s	user 0.015s	sys 0.005s
W20260709 12:19:37.100064 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 52109.5us
W20260709 12:19:37.105543 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 98260.2us
I20260709 12:19:37.203493 24248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:37.204457 24248 raft_consensus.cc:606] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:37.206415 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:37.209265 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:37.210767 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:37.217820 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 62475.1us
I20260709 12:19:37.242038 29431 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.263019 24092 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.264417 23996 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:37.268215 23999 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 10 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.269974 29399 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 5 to 6, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.305027 24809 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.337273 24167 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.354835 29362 raft_consensus.cc:993] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:37.355561 29362 raft_consensus.cc:1081] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:37.357924 24096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:37.358604 24096 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:37.358964 24096 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:37.369271 24243 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 5 to 6, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.373512 24096 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:37.388531 24096 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:37.386076 24216 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.22.93.254:36285, user_credentials={real_user=slave}} blocked reactor thread for 52354.9us
I20260709 12:19:37.389478 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:37.389833 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:37.393806 24250 raft_consensus.cc:3055] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:37.394162 24250 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 8 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:37.398610 24250 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:37.399966 24250 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:37.405725 24167 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:37.450347 24167 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:37.442626 24250 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:37.472709 24809 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.479089 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:37.480445 29449 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:37.481042 29449 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:37.482144 29449 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:37.528795 24167 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.584957 24175 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:37.601397 24809 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:37.604946 29378 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:37.632148 24250 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:37.635597 29375 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:37.645102 29378 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.648586 24809 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.686339 24248 raft_consensus.cc:2955] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.678017 23996 catalog_manager.cc:5697] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 5 to 6, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.721442 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d4ba8a9e171042a4a56a0f731bf431cc with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:37.741340 23994 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 7 to 8, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.743510 23994 catalog_manager.cc:5697] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.761677 24175 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:37.787015 24809 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:37.797502 29375 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:37.797533 24248 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:37.803774 29375 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:37.815491 23999 catalog_manager.cc:5697] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 9, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 9 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:37.834203 29400 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.842590 24248 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.846545 24806 raft_consensus.cc:2955] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Committing config change with OpId 10.9: config changed from index 8 to 9, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.847685 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet d4ba8a9e171042a4a56a0f731bf431cc with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:46626
I20260709 12:19:37.864634 24250 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:37.873282 29413 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:37.885329 24092 consensus_queue.cc:237] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:37.906162 24809 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:37.906288 24175 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:19:37.908182 29443 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:37.909271 29413 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:37.923560 29449 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.926234 24167 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.928402 24175 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:37.928658 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7c552e5996384fef9c032a7fda531298 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:37.936746 29399 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:37.949837 24813 raft_consensus.cc:2955] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:37.954495 23998 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 8 to 9, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 10 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:37.962410 24249 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:37.969326 24812 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:37.974956 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 66b5cb14ed8f4b58a27e168bcac560d2 with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:37.977140 24096 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:19:37.979349 29403 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:37.981422 29436 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:38.035591 24091 tablet_service.cc:1558] Processing DeleteTablet for tablet 7c552e5996384fef9c032a7fda531298 with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:46626
I20260709 12:19:38.052853 29362 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:38.063862 24092 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:38.083390 23996 catalog_manager.cc:5697] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 6 to 7, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:38.096728 24806 raft_consensus.cc:2955] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:38.152148 29469 tablet_replica.cc:333] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:19:38.153574 29469 raft_consensus.cc:2243] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.154778 29469 raft_consensus.cc:2272] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.183903 23994 catalog_manager.cc:5697] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 10 to 11, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:38.187583 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet 66b5cb14ed8f4b58a27e168bcac560d2 with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:40964
I20260709 12:19:38.221577 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f4b7521a95604ae58fb9e26c98b5e4a6 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:38.224080 29469 ts_tablet_manager.cc:1916] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:38.236186 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet f4b7521a95604ae58fb9e26c98b5e4a6 with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55732
I20260709 12:19:38.237952 29476 tablet_replica.cc:333] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:19:38.239303 29476 raft_consensus.cc:2243] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.254453 29476 raft_consensus.cc:2272] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.317742 29478 tablet_replica.cc:333] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:19:38.342507 29469 ts_tablet_manager.cc:1929] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.7
I20260709 12:19:38.343472 29469 log.cc:1199] T d4ba8a9e171042a4a56a0f731bf431cc P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/d4ba8a9e171042a4a56a0f731bf431cc
I20260709 12:19:38.344370 29476 ts_tablet_manager.cc:1916] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:38.368678 29469 tablet_replica.cc:333] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:19:38.368911 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet d4ba8a9e171042a4a56a0f731bf431cc (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:38.370397 29469 raft_consensus.cc:2243] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 12:19:38.371716 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 68743.6us
I20260709 12:19:38.375247 29469 raft_consensus.cc:2272] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.391177 29469 ts_tablet_manager.cc:1916] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:38.391742 29478 raft_consensus.cc:2243] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:38.394138 29478 raft_consensus.cc:2272] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:38.399525 29478 ts_tablet_manager.cc:1916] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:38.438431 29476 ts_tablet_manager.cc:1929] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.6
I20260709 12:19:38.442395 29478 ts_tablet_manager.cc:1929] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:19:38.457048 29476 log.cc:1199] T 66b5cb14ed8f4b58a27e168bcac560d2 P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/66b5cb14ed8f4b58a27e168bcac560d2
I20260709 12:19:38.457187 29478 log.cc:1199] T f4b7521a95604ae58fb9e26c98b5e4a6 P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/f4b7521a95604ae58fb9e26c98b5e4a6
I20260709 12:19:38.459923 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet 66b5cb14ed8f4b58a27e168bcac560d2 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:38.459910 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet f4b7521a95604ae58fb9e26c98b5e4a6 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:38.468263 29469 ts_tablet_manager.cc:1929] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.8
I20260709 12:19:38.469053 29469 log.cc:1199] T 7c552e5996384fef9c032a7fda531298 P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/7c552e5996384fef9c032a7fda531298
I20260709 12:19:38.471323 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet 7c552e5996384fef9c032a7fda531298 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:38.769160 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:38.900785 24096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:38.901500 24096 raft_consensus.cc:606] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:38.905989 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:38.912786 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:38.913890 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:39.106091 29399 raft_consensus.cc:993] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:39.106752 29399 raft_consensus.cc:1081] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
W20260709 12:19:39.295055 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 143558us
W20260709 12:19:39.380321 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 84230.2us
I20260709 12:19:39.401379 24173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:39.402160 24173 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:39.402629 24173 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:39.432160 24173 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:39.466197 24173 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:39.473852 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:39.474906 24096 raft_consensus.cc:3055] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:39.475427 24096 raft_consensus.cc:740] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:39.476593 24096 consensus_queue.cc:260] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:39.478009 24096 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:39.489496 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:39.490319 24248 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:39.509196 24248 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:39.516217 24141 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:39.517294 29378 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:39.517835 29378 raft_consensus.cc:697] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:39.518787 29378 consensus_queue.cc:237] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:39.589074 24096 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:39.615742 23998 catalog_manager.cc:5697] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 10 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 11 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:39.626168 24173 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:39.649786 24248 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:19:39.653741 24141 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1388d59244114d37a482e6205f04c237. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:39.658849 24096 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:19:39.662843 29376 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:39.665380 29400 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:39.714555 29400 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:39.716785 24248 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:39.814961 23998 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 10, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 13 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:40.002697 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:40.011114 24173 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:40.063086 24092 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:40.066303 24092 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Committing config change with OpId 13.10: config changed from index -1 to 10, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:40.107532 29400 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:19:40.118142 24248 raft_consensus.cc:1275] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:19:40.121140 29488 consensus_queue.cc:1048] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:19:40.140288 24167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:55734
I20260709 12:19:40.141065 24167 raft_consensus.cc:606] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:40.142798 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:40.145565 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:40.149020 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:40.162761 24248 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:40.182763 29498 ts_tablet_manager.cc:933] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:40.187597 29378 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:19:40.205803 24141 consensus_peers.cc:597] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b5f8a25e7c97459c955d7ca7accd826d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:40.208976 24092 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:40.214846 29378 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:40.306874 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 71286.4us
I20260709 12:19:40.296154 29498 tablet_copy_client.cc:323] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
W20260709 12:19:40.330896 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 73645.8us
W20260709 12:19:40.355034 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 94668.2us
W20260709 12:19:40.536417 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 180967us
W20260709 12:19:40.578016 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 126703us
I20260709 12:19:40.599938 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet 1388d59244114d37a482e6205f04c237 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
W20260709 12:19:40.602881 29501 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:19:40.603976 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet 1388d59244114d37a482e6205f04c237 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-1388d59244114d37a482e6205f04c237
I20260709 12:19:40.620285 24186 tablet_copy_source_session.cc:215] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:19:40.673092 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 208743us
W20260709 12:19:40.691468 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 108390us
W20260709 12:19:40.692066 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 165177us
W20260709 12:19:40.716953 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 186951us
W20260709 12:19:40.752633 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48269.5us
I20260709 12:19:40.783806 29378 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
W20260709 12:19:40.873215 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 62575.3us
W20260709 12:19:40.876830 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 103997us
W20260709 12:19:40.906188 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 62609.2us
I20260709 12:19:40.908550 23996 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:40.919703 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 98136.3us
I20260709 12:19:40.919729 24096 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:40.928270 24092 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:40.951526 29498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1388d59244114d37a482e6205f04c237. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:40.968938 29543 ts_tablet_manager.cc:933] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:40.985127 29530 raft_consensus.cc:993] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:40.985809 29530 raft_consensus.cc:1081] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:40.988971 24244 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
W20260709 12:19:41.005856 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 59516.7us
I20260709 12:19:41.012421 24100 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37604
I20260709 12:19:41.013154 24100 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:41.013578 24100 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:41.104413 24100 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:41.134634 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:41.135789 24809 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:41.137814 24100 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:41.143685 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:41.144430 24176 raft_consensus.cc:3055] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:19:41.144759 24176 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:41.145610 24176 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:41.146872 24176 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:19:41.174474 24243 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:41.182596 29516 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:19:41.185544 24066 consensus_peers.cc:597] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f1c672629a7b441f9e55890cd643e03a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:41.164968 29543 tablet_copy_client.cc:323] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:19:41.189292 24173 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:41.189904 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet b5f8a25e7c97459c955d7ca7accd826d from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:19:41.190686 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet b5f8a25e7c97459c955d7ca7accd826d from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-b5f8a25e7c97459c955d7ca7accd826d
I20260709 12:19:41.196980 29482 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:41.229890 24809 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:41.240773 24066 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:41.241612 24176 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:41.276710 24186 tablet_copy_source_session.cc:215] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:41.251782 29516 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:19:41.287892 29516 raft_consensus.cc:697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:41.288411 29543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5f8a25e7c97459c955d7ca7accd826d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:41.289014 29516 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:41.288498 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:41.325394 29498 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33922 (request call id 652) took 1186 ms. Trace:
I20260709 12:19:41.325992 29498 rpcz_store.cc:276] 0709 12:19:40.138788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.138936 (+   148us) service_pool.cc:224] Handling call
0709 12:19:40.183338 (+ 44402us) ts_tablet_manager.cc:934] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
0709 12:19:40.925854 (+742516us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:41.193216 (+267362us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:41.193368 (+   152us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:41.324434 (+131066us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:41.324831 (+   397us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:41.325229 (+   398us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:41.325293 (+    64us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":74708,"tablet-copy.queue_time_us":43130,"thread_start_us":75372,"threads_started":2}
I20260709 12:19:41.361259 29498 tablet_copy_client.cc:806] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:41.376922 29475 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:41.382697 24249 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:41.416744 24176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30d4ada45d4b4872986993abc4470158"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:55734
I20260709 12:19:41.417622 24176 raft_consensus.cc:606] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:41.390255 29498 tablet_copy_client.cc:670] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:41.463567 29528 raft_consensus.cc:993] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:41.464421 29530 raft_consensus.cc:1081] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:41.469795 24092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30d4ada45d4b4872986993abc4470158"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37604
I20260709 12:19:41.470570 24092 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:41.470849 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:41.471012 24092 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:41.472986 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:41.468264 29498 tablet_copy_client.cc:538] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:41.488570 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:41.488706 24168 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:41.500890 23994 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 8 to 9, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 9 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:41.509223 24092 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:41.518399 24092 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:41.518575 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:41.519326 24173 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:41.519636 24173 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:41.525645 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:41.526345 24244 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:41.530789 24173 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:41.564114 24173 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:41.580541 24244 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:19:41.593600 24066 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:41.589519 29553 log.cc:927] Time spent T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:19:41.600006 29443 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:41.611910 29443 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:41.613092 29443 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:41.635869 23994 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:41.671305 24173 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:19:41.687295 29543 tablet_copy_client.cc:806] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:41.688809 29543 tablet_copy_client.cc:670] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:41.926426 29498 tablet_bootstrap.cc:492] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
W20260709 12:19:41.975720 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 236444us
W20260709 12:19:41.977558 29475 consensus_meta.cc:287] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.585s	user 0.015s	sys 0.000s
I20260709 12:19:42.008495 29555 ts_tablet_manager.cc:933] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
I20260709 12:19:42.035367 23994 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 14 to 15, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 15 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:42.027436 29475 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:45028 (request call id 4) took 1123 ms. Trace:
I20260709 12:19:42.116496 29555 tablet_copy_client.cc:323] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.193:44043
W20260709 12:19:42.139406 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 121989us
W20260709 12:19:42.141382 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 112476us
I20260709 12:19:42.142089 29543 tablet_copy_client.cc:538] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:19:42.243436 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 106901us
W20260709 12:19:42.263008 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 87728.1us
I20260709 12:19:42.083338 29475 rpcz_store.cc:276] 0709 12:19:40.899890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:40.905826 (+  5936us) service_pool.cc:224] Handling call
0709 12:19:40.927742 (+ 21916us) log.cc:844] Serialized 506 byte log entry
0709 12:19:42.022305 (+1094563us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":247,"mutex_wait_us":56936,"raft.queue_time_us":90412,"raft.run_cpu_time_us":1891,"raft.run_wall_time_us":34111,"thread_start_us":171184,"threads_started":1,"wal-append.queue_time_us":219509}
W20260709 12:19:42.285300 29554 log.cc:927] Time spent T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.261s	user 0.002s	sys 0.000s
W20260709 12:19:42.319998 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49625.3us
W20260709 12:19:42.325378 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 62090.1us
I20260709 12:19:42.401681 24809 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:19:42.431025 24173 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:42.433166 24168 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:19:42.560345 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 208697us
I20260709 12:19:42.521389 29482 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 12:19:42.560937 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 130577us
I20260709 12:19:42.509132 29475 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
W20260709 12:19:42.469400 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 152861us
I20260709 12:19:42.580180 24248 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:42.579914 29578 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
W20260709 12:19:42.596525 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 96978.7us
W20260709 12:19:42.587574 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67303.2us
I20260709 12:19:42.637494 29543 tablet_bootstrap.cc:492] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:42.576879 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:42.668402 24111 tablet_copy_service.cc:140] P 729aa4b1ccec48b588c14e67652c61e1: Received BeginTabletCopySession request for tablet f1c672629a7b441f9e55890cd643e03a from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:50598)
I20260709 12:19:42.669134 24111 tablet_copy_service.cc:161] P 729aa4b1ccec48b588c14e67652c61e1: Beginning new tablet copy session on tablet f1c672629a7b441f9e55890cd643e03a from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:50598: session id = c090031f610346ed82285cd847bca6d6-f1c672629a7b441f9e55890cd643e03a
W20260709 12:19:42.723548 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 45765.8us
I20260709 12:19:42.728374 24244 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260709 12:19:42.785162 24215 consensus_peers.cc:597] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8665b055009a4659b6d86621874dddbd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:42.795269 29481 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:42.799654 24111 tablet_copy_source_session.cc:215] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:42.817160 29555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1c672629a7b441f9e55890cd643e03a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:42.874228 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:42.875298 24092 raft_consensus.cc:606] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:42.895053 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 137296us
I20260709 12:19:42.900506 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
W20260709 12:19:42.901051 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 98275.4us
I20260709 12:19:42.901325 24093 raft_consensus.cc:606] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:42.909416 24173 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:42.912060 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:42.921667 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:42.922642 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:42.950647 29566 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:19:42.978031 24093 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:42.985718 29536 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:43.121409 29523 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:43.124466 24092 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:43.176416 29555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33926 (request call id 681) took 1533 ms. Trace:
I20260709 12:19:43.201478 29475 raft_consensus.cc:993] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:43.204778 29475 raft_consensus.cc:1081] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:43.203292 24173 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:43.212025 24250 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40990
I20260709 12:19:43.212678 24250 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:43.213083 24250 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.182149 29555 rpcz_store.cc:276] 0709 12:19:41.643129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:41.643312 (+   183us) service_pool.cc:224] Handling call
0709 12:19:42.009223 (+365911us) ts_tablet_manager.cc:934] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043)
0709 12:19:42.815788 (+806565us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:42.996667 (+180879us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:42.996802 (+   135us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:43.175257 (+178455us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:43.175731 (+   474us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:43.176227 (+   496us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:43.176311 (+    84us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":299,"tablet-copy.queue_time_us":341269,"thread_start_us":303125,"threads_started":2}
I20260709 12:19:43.230317 29555 tablet_copy_client.cc:806] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:43.231096 29555 tablet_copy_client.cc:670] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:43.236090 24250 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:43.239480 29555 tablet_copy_client.cc:538] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:43.252030 29555 tablet_bootstrap.cc:492] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:43.226724 29498 tablet_bootstrap.cc:492] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.259511 29498 tablet_bootstrap.cc:492] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:43.260524 29498 ts_tablet_manager.cc:1403] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 1.334s	user 0.063s	sys 0.013s
I20260709 12:19:43.266100 29498 raft_consensus.cc:359] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:43.272065 23994 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 9, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.281576 24250 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:43.282339 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:43.283092 24095 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:43.283416 24095 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:43.284195 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:43.284840 24813 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.284255 24095 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:43.285790 24095 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:43.300104 24095 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:43.301515 24813 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:43.280719 29498 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:43.306957 24215 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:43.316107 29523 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:43.327991 29523 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:43.333748 29523 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:43.312024 29498 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:43.341984 29498 ts_tablet_manager.cc:1434] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.081s	user 0.010s	sys 0.000s
I20260709 12:19:43.361346 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-1388d59244114d37a482e6205f04c237 received from {username='slave'} at 127.0.0.1:44066
I20260709 12:19:43.364287 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-1388d59244114d37a482e6205f04c237 on tablet 1388d59244114d37a482e6205f04c237 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:43.346748 29543 tablet_bootstrap.cc:492] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.407547 29543 tablet_bootstrap.cc:492] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:43.408653 29543 ts_tablet_manager.cc:1403] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.799s	user 0.048s	sys 0.000s
I20260709 12:19:43.426570 29498 ts_tablet_manager.cc:933] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:43.485077 29565 raft_consensus.cc:993] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:43.485843 29565 raft_consensus.cc:1081] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:43.486555 29543 raft_consensus.cc:359] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:43.487577 29543 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:43.487916 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:43.488530 24168 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:43.488986 24168 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.488348 29543 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:43.539327 24168 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:43.750301 29498 tablet_copy_client.cc:323] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:19:43.752570 29543 ts_tablet_manager.cc:1434] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.343s	user 0.013s	sys 0.001s
I20260709 12:19:43.764750 24186 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-b5f8a25e7c97459c955d7ca7accd826d received from {username='slave'} at 127.0.0.1:44066
I20260709 12:19:43.765275 24186 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-b5f8a25e7c97459c955d7ca7accd826d on tablet b5f8a25e7c97459c955d7ca7accd826d with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:43.778756 24168 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:43.787161 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 249132us
I20260709 12:19:43.814607 23998 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 13 to 14, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 14 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:43.834066 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:43.835405 24095 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:19:43.835740 24095 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:43.836517 24095 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:43.837842 24095 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.881989 24095 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:43.883399 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:43.884392 29526 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:19:43.885004 29526 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:19:43.881222 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 66630.7us
I20260709 12:19:43.886888 24812 raft_consensus.cc:1217] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:19:43.886057 29526 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:43.898864 24813 raft_consensus.cc:1217] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 LEARNER]: Deduplicated request from leader. Original: 13.9->[13.10-13.10]   Dedup: 13.10->[]
W20260709 12:19:43.935979 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 146712us
I20260709 12:19:43.970207 29555 tablet_bootstrap.cc:492] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:43.985599 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:43.986380 24248 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:43.997923 24248 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:19:43.992074 29555 tablet_bootstrap.cc:492] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:44.021526 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 8665b055009a4659b6d86621874dddbd from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:19:44.022279 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 8665b055009a4659b6d86621874dddbd from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-8665b055009a4659b6d86621874dddbd
I20260709 12:19:44.045881 24259 tablet_copy_source_session.cc:215] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:44.046411 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:44.067981 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 58515.6us
I20260709 12:19:44.012310 29555 ts_tablet_manager.cc:1403] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.760s	user 0.049s	sys 0.015s
I20260709 12:19:44.030010 23998 catalog_manager.cc:5697] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 10 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 11 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:44.072695 24092 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:19:44.080024 29520 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:44.098598 29498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8665b055009a4659b6d86621874dddbd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:44.107547 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 70715.8us
I20260709 12:19:44.125197 24809 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:19:44.127522 29542 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:19:44.131654 29555 raft_consensus.cc:359] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:44.132618 29555 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:44.133318 29555 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:44.156533 29555 ts_tablet_manager.cc:1434] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 12:19:44.158937 24111 tablet_copy_service.cc:342] P 729aa4b1ccec48b588c14e67652c61e1: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-f1c672629a7b441f9e55890cd643e03a received from {username='slave'} at 127.0.0.1:50598
I20260709 12:19:44.159492 24111 tablet_copy_service.cc:434] P 729aa4b1ccec48b588c14e67652c61e1: ending tablet copy session c090031f610346ed82285cd847bca6d6-f1c672629a7b441f9e55890cd643e03a on tablet f1c672629a7b441f9e55890cd643e03a with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:44.260457 24248 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:44.261179 24248 raft_consensus.cc:606] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Received request to transfer leadership to TS 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:44.266852 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:44.269246 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:44.274061 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:44.314239 24248 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:44.319084 29378 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:44.335373 29526 raft_consensus.cc:1064] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:44.342294 29498 tablet_copy_client.cc:806] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:44.343356 29498 tablet_copy_client.cc:670] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:44.361861 24094 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:19:44.363552 29508 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:44.377409 29539 raft_consensus.cc:1064] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:44.388535 29498 tablet_copy_client.cc:538] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:44.338729 29526 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 5, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:44.415727 29539 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 8, Current term: 13, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:44.457185 29523 raft_consensus.cc:993] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:44.457752 29523 raft_consensus.cc:1081] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:44.461719 24092 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:44.462359 24092 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:44.462751 24092 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:44.472355 24809 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:44.475193 29508 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:44.478052 24093 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:44.497033 24246 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:19:44.559180 29378 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:44.477469 29498 tablet_bootstrap.cc:492] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:44.512892 24095 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:44.543001 24248 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:19:44.544590 24812 raft_consensus.cc:1217] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:19:44.520107 24813 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:19:44.504805 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45311.7us
I20260709 12:19:44.586258 29526 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:19:44.595261 29508 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:44.596387 29376 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:19:44.618978 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45222.8us
I20260709 12:19:44.635397 29626 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:44.613867 24092 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:44.648492 29613 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:44.691653 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 63027.9us
I20260709 12:19:44.701539 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:44.702397 24241 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:44.702749 24241 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:44.694561 24095 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:44.720754 24092 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:44.724174 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:44.725153 24813 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:44.704031 24241 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:44.762272 24241 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:44.768146 24812 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:44.787397 24813 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
W20260709 12:19:44.795204 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 72085.2us
I20260709 12:19:44.812584 24241 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
I20260709 12:19:44.867659 24246 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:44.870328 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:44.870534 29376 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Committing config change with OpId 13.11: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:44.884047 24249 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:44.880941 23996 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 7 to 8, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:44.900751 24095 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:44.919782 29443 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:44.920607 29443 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:44.925431 29443 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:45.036459 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 87734.9us
W20260709 12:19:45.127288 29548 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:19:45.193315 29639 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
W20260709 12:19:45.208508 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69988.5us
W20260709 12:19:45.214301 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 100378us
W20260709 12:19:45.215075 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 101121us
W20260709 12:19:45.214118 29498 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.112s	user 0.002s	sys 0.003s
W20260709 12:19:45.272725 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 55496.9us
W20260709 12:19:45.373675 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 58919.2us
W20260709 12:19:45.378495 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69224.4us
I20260709 12:19:45.430650 29498 tablet_bootstrap.cc:492] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:45.432612 29498 tablet_bootstrap.cc:492] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:45.433678 29498 ts_tablet_manager.cc:1403] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.956s	user 0.048s	sys 0.060s
I20260709 12:19:45.441823 29498 raft_consensus.cc:359] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:45.447145 29498 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:45.441999 24812 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Committing config change with OpId 13.11: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:45.453639 29498 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:45.474834 29558 raft_consensus.cc:1064] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:45.479465 29558 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:45.510207 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:45.511942 29498 ts_tablet_manager.cc:1434] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.078s	user 0.010s	sys 0.001s
I20260709 12:19:45.527734 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-8665b055009a4659b6d86621874dddbd received from {username='slave'} at 127.0.0.1:59766
I20260709 12:19:45.528321 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-8665b055009a4659b6d86621874dddbd on tablet 8665b055009a4659b6d86621874dddbd with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:45.543147 24249 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:45.554687 24813 raft_consensus.cc:1217] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.8->[11.9-11.9]   Dedup: 11.9->[]
I20260709 12:19:45.597977 23999 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 10 to 11, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 13 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:45.612996 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 53772.1us
I20260709 12:19:45.615931 24173 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:45.617309 29649 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:19:45.619851 29649 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:19:45.620700 24813 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:45.623668 24813 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:45.626857 24246 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:45.655242 29656 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:45.691213 29656 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:45.685413 29649 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
W20260709 12:19:45.912420 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47266.4us
I20260709 12:19:46.194173 29619 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.221277 29680 raft_consensus.cc:1064] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:46.244621 29680 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:46.297616 24169 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.320533 24813 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.347370 24249 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.523725 24813 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:46.528079 29680 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:46.548326 24098 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:46.561789 29659 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:46.563212 24168 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:46.587193 29655 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:46.596069 23999 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 252) took 1604 ms. Trace:
I20260709 12:19:46.617287 23994 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 16 to 17, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 17 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:46.596697 23999 rpcz_store.cc:276] 0709 12:19:44.991486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:44.991684 (+   198us) service_pool.cc:224] Handling call
0709 12:19:46.595794 (+1604110us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:45.962352 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:45.992917 (+ 30565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:46.004455 (+ 11538us) write_op.cc:435] Acquired schema lock
0709 12:19:46.006628 (+  2173us) tablet.cc:662] Decoding operations
0709 12:19:46.019035 (+ 12407us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:46.019157 (+   122us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:46.019202 (+    45us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:46.019670 (+   468us) tablet.cc:701] Row locks acquired
0709 12:19:46.019741 (+    71us) write_op.cc:260] PREPARE: finished
0709 12:19:46.020073 (+   332us) write_op.cc:270] Start()
0709 12:19:46.020264 (+   191us) write_op.cc:276] Timestamp: P: 1783599586019963 usec, L: 0
0709 12:19:46.020306 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:19:46.022183 (+  1877us) log.cc:844] Serialized 599 byte log entry
0709 12:19:46.225765 (+203582us) op_driver.cc:464] REPLICATION: finished
0709 12:19:46.384571 (+158806us) write_op.cc:301] APPLY: starting
0709 12:19:46.384696 (+   125us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:46.386617 (+  1921us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:46.386749 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:46.527969 (+141220us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:46.528286 (+   317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:46.528359 (+    73us) write_op.cc:312] APPLY: finished
0709 12:19:46.528712 (+   353us) log.cc:844] Serialized 25 byte log entry
0709 12:19:46.532122 (+  3410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:46.534919 (+  2797us) write_op.cc:454] Released schema lock
0709 12:19:46.535033 (+   114us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:46.551043 (+ 16010us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:46.551084 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":6912,"child_traces":[["op",{"apply.queue_time_us":154033,"apply.run_cpu_time_us":5812,"apply.run_wall_time_us":166410,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":360497,"prepare.run_cpu_time_us":6225,"prepare.run_wall_time_us":66614,"replication_time_us":156198,"thread_start_us":343891,"threads_started":2}]]}
I20260709 12:19:46.688551 29655 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.695813 24098 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.729322 24813 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.737140 24168 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.764978 23994 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 262) took 1132 ms. Trace:
I20260709 12:19:46.769107 23999 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.765635 23994 rpcz_store.cc:276] 0709 12:19:45.632432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.632750 (+   318us) service_pool.cc:224] Handling call
0709 12:19:46.764879 (+1132129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:46.699177 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:46.700202 (+  1025us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:46.700246 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:19:46.700266 (+    20us) tablet.cc:662] Decoding operations
0709 12:19:46.700688 (+   422us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:46.700783 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:46.700820 (+    37us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:46.701036 (+   216us) tablet.cc:701] Row locks acquired
0709 12:19:46.701062 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:19:46.703276 (+  2214us) write_op.cc:270] Start()
0709 12:19:46.703435 (+   159us) write_op.cc:276] Timestamp: P: 1783599586703214 usec, L: 0
0709 12:19:46.703462 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:19:46.729235 (+ 25773us) log.cc:844] Serialized 536 byte log entry
0709 12:19:46.731507 (+  2272us) op_driver.cc:464] REPLICATION: finished
0709 12:19:46.731983 (+   476us) write_op.cc:301] APPLY: starting
0709 12:19:46.732088 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:46.733105 (+  1017us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:46.733234 (+   129us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:46.734017 (+   783us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:46.734210 (+   193us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:46.734280 (+    70us) write_op.cc:312] APPLY: finished
0709 12:19:46.734502 (+   222us) log.cc:844] Serialized 25 byte log entry
0709 12:19:46.734677 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:46.734771 (+    94us) write_op.cc:454] Released schema lock
0709 12:19:46.734814 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:46.761146 (+ 26332us) spinlock_profiling.cc:243] Waited 24.8 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c05576e28 00007f4c08fb1581 00007f4c08fb0d58 00007f4c08fb59f1 00007f4c08fb59a9 00007f4c08fb5939 00007f4c08fb5901 00007f4c08fb4b2d 0000000000388634 0000000000388479
0709 12:19:46.761441 (+   295us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:46.761479 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":177,"apply.run_cpu_time_us":3250,"apply.run_wall_time_us":3838,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":49021,"prepare.run_cpu_time_us":6610,"prepare.run_wall_time_us":62249,"replication_time_us":27838,"spinlock_wait_cycles":57054464,"thread_start_us":37773,"threads_started":1}]]}
I20260709 12:19:46.838243 23998 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 167) took 1226 ms. Trace:
I20260709 12:19:46.851686 24173 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:46.838766 23998 rpcz_store.cc:276] 0709 12:19:45.611345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.615355 (+  4010us) service_pool.cc:224] Handling call
0709 12:19:46.837989 (+1222634us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 12:19:46.857676 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 288) took 1209 ms. Trace:
I20260709 12:19:46.863494 23996 rpcz_store.cc:276] 0709 12:19:45.637224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:45.637432 (+   208us) service_pool.cc:224] Handling call
0709 12:19:46.846775 (+1209343us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 12:19:46.867589 23994 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 9 to 10, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.868413 24168 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:46.917713 24813 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:46.927103 29526 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:46.960608 24096 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:19:46.962502 29526 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:46.964593 29675 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.974102 24098 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:46.983291 24249 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:46.985931 24809 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:19:46.991231 24809 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:46.994042 24806 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:46.995873 29616 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:46.993821 24249 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:47.004256 29619 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.005431 29656 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:47.010665 24249 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.027282 24806 raft_consensus.cc:2955] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.035319 29508 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:47.039889 29626 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:47.048705 24246 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:47.097805 24809 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:47.105746 23984 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f1c672629a7b441f9e55890cd643e03a with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:47.111374 23995 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 11 to 12, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 13 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.113129 29680 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:47.115343 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1388d59244114d37a482e6205f04c237 with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:47.196646 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50139us
I20260709 12:19:47.205879 24098 raft_consensus.cc:2955] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Committing config change with OpId 13.12: config changed from index 11 to 12, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.225764 24813 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.234962 24246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:47.235965 24246 raft_consensus.cc:606] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:47.241155 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:19:47.243863 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:47.245136 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:47.222970 29526 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.251006 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet 1388d59244114d37a482e6205f04c237 with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:40964
I20260709 12:19:47.257043 23996 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 10 to 11, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 11 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:47.264885 24170 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:19:47.304775 24241 raft_consensus.cc:2955] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Committing config change with OpId 9.9: config changed from index 8 to 9, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.307240 29698 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:19:47.326301 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 156727us
I20260709 12:19:47.339357 29705 tablet_replica.cc:333] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:19:47.372809 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet f1c672629a7b441f9e55890cd643e03a with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55732
I20260709 12:19:47.425834 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b5f8a25e7c97459c955d7ca7accd826d with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:19:47.443910 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 89470.9us
I20260709 12:19:47.456489 23994 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 8 to 9, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 9 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.484655 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet b5f8a25e7c97459c955d7ca7accd826d with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:46626
I20260709 12:19:47.535163 29709 tablet_replica.cc:333] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:19:47.536823 29709 raft_consensus.cc:2243] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.537916 29709 raft_consensus.cc:2272] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.552204 29705 raft_consensus.cc:2243] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.553550 29705 raft_consensus.cc:2272] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.562386 29655 raft_consensus.cc:993] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:47.563488 29681 raft_consensus.cc:1081] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:47.570186 29714 tablet_replica.cc:333] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:19:47.571729 29714 raft_consensus.cc:2243] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.572932 29714 raft_consensus.cc:2272] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.589815 29705 ts_tablet_manager.cc:1916] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:47.597980 29709 ts_tablet_manager.cc:1916] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:47.617599 24809 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:47.619143 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 215996us
I20260709 12:19:47.615592 29681 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.660379 29714 ts_tablet_manager.cc:1916] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:47.678574 23998 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 10 to 11, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.691331 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59344
I20260709 12:19:47.692236 24168 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:47.692682 24168 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.695170 24088 tablet_service.cc:1558] Processing DeleteTablet for tablet 8665b055009a4659b6d86621874dddbd with delete_type TABLET_DATA_TOMBSTONED (TS 729aa4b1ccec48b588c14e67652c61e1 not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:46626
I20260709 12:19:47.707651 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8665b055009a4659b6d86621874dddbd with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:19:47.739907 24170 raft_consensus.cc:2955] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.11: config changed from index 10 to 11, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:47.801836 29709 ts_tablet_manager.cc:1929] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 12:19:47.802634 29709 log.cc:1199] T f1c672629a7b441f9e55890cd643e03a P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/f1c672629a7b441f9e55890cd643e03a
I20260709 12:19:47.824564 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet f1c672629a7b441f9e55890cd643e03a (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:47.839879 24168 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:47.841429 24173 raft_consensus.cc:1240] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:47.857540 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:47.858389 24250 raft_consensus.cc:3055] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:47.858762 24250 raft_consensus.cc:740] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:47.859665 24250 consensus_queue.cc:260] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:47.861263 24250 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.863255 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:47.864842 24095 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:47.864465 24168 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:47.899200 24250 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:47.907645 24141 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:47.908746 29675 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:47.909320 29675 raft_consensus.cc:697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:47.910266 29675 consensus_queue.cc:237] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:47.954555 29714 ts_tablet_manager.cc:1929] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 9.8
I20260709 12:19:47.955367 29714 log.cc:1199] T b5f8a25e7c97459c955d7ca7accd826d P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/b5f8a25e7c97459c955d7ca7accd826d
I20260709 12:19:47.957690 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet b5f8a25e7c97459c955d7ca7accd826d (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:47.964435 29705 ts_tablet_manager.cc:1929] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 13.11
I20260709 12:19:47.965034 29705 log.cc:1199] T 1388d59244114d37a482e6205f04c237 P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/1388d59244114d37a482e6205f04c237
I20260709 12:19:47.960505 24095 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:47.973326 29714 tablet_replica.cc:333] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:19:47.974750 29714 raft_consensus.cc:2243] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:19:47.979637 29714 raft_consensus.cc:2272] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:19:47.982697 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet 1388d59244114d37a482e6205f04c237 (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:47.997923 29714 ts_tablet_manager.cc:1916] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:19:48.018267 23998 catalog_manager.cc:5697] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 11 to 12, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:48.144928 29714 ts_tablet_manager.cc:1929] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.10
I20260709 12:19:48.145607 29714 log.cc:1199] T 8665b055009a4659b6d86621874dddbd P 729aa4b1ccec48b588c14e67652c61e1: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/wals/8665b055009a4659b6d86621874dddbd
I20260709 12:19:48.147538 23984 catalog_manager.cc:5028] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): tablet 8665b055009a4659b6d86621874dddbd (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:19:48.330017 24096 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:48.333714 29675 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:48.429425 24250 raft_consensus.cc:1275] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:19:48.439857 29706 consensus_queue.cc:1048] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:19:48.508306 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 43550.6us
I20260709 12:19:48.768092 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:48.830520 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53637.5us
I20260709 12:19:48.981524 24095 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:48.982316 24095 raft_consensus.cc:606] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:48.989895 24170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:55734
I20260709 12:19:48.990590 24170 raft_consensus.cc:606] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:48.993311 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:48.996022 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:48.996965 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:49.122733 24248 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:49.135782 24095 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:49.137729 29583 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:19:49.146085 24215 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5bc5bc9605e64854a78054b02b3da6dd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.155923 24170 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:19:49.159767 29681 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:49.199388 29583 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:49.201321 24098 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:49.203608 29619 raft_consensus.cc:993] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:49.207350 29619 raft_consensus.cc:1081] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:49.213135 24170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:49.213835 24170 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:49.214184 24170 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.235018 24175 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.8: config changed from index -1 to 8, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:49.253309 24168 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:49.262184 23998 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 8, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:49.238374 24170 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:49.280900 24170 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:49.281980 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:49.291163 24248 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.289819 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:49.291872 24098 raft_consensus.cc:3055] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:49.292165 24098 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:49.298170 24098 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:49.301780 24098 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.321497 24248 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:49.322474 24098 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:49.323381 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:49.327639 29707 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:49.328673 24246 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:49.328195 29707 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:49.338004 29707 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:49.342065 29706 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:49.361611 29675 raft_consensus.cc:993] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:49.362537 29675 raft_consensus.cc:1081] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
W20260709 12:19:49.378750 24141 consensus_peers.cc:597] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44755249cf394d0aa1ea6b45f82eb521. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.381927 24248 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40978
I20260709 12:19:49.382596 24248 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:49.383002 24248 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.389511 24098 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:49.394375 29732 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:49.398586 24248 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:49.402680 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:49.403376 24095 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.478374 29730 raft_consensus.cc:2955] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:49.480825 24246 raft_consensus.cc:2955] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:49.485522 23996 catalog_manager.cc:5697] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 10, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 10 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:49.518379 24168 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:49.529804 24248 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:49.507737 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:49.608393 24170 raft_consensus.cc:3055] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:19:49.608415 24141 consensus_peers.cc:597] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 290d272848834ed2813ddb5e16609dba. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.608736 24170 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:49.540129 23996 catalog_manager.cc:5697] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index -1 to 8, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:49.610538 24170 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:49.610951 24096 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:49.504489 24095 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:49.606526 24246 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:49.612021 24170 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:49.612766 29732 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:49.613786 29730 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:19:49.642686 29707 raft_consensus.cc:2955] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:49.648507 24214 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:49.650283 29728 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:49.651211 29728 raft_consensus.cc:697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:49.647707 24246 raft_consensus.cc:2955] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:49.654666 24170 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:19:49.654361 29728 consensus_queue.cc:237] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:49.664541 29740 ts_tablet_manager.cc:933] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:49.675619 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 266860us
I20260709 12:19:49.720631 24241 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:49.763510 24095 raft_consensus.cc:2955] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
W20260709 12:19:49.798628 24215 consensus_peers.cc:597] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9e016416bdc742068f5568ff2bebabd1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:19:49.833003 24168 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:49.853075 24096 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:19:49.935547 24096 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:19:49.914783 29740 tablet_copy_client.cc:323] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
W20260709 12:19:50.003930 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 186942us
I20260709 12:19:50.012090 23996 catalog_manager.cc:5697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 9 to 10, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 10 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:19:50.076458 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 53074.1us
W20260709 12:19:50.090060 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 71763.4us
W20260709 12:19:50.096602 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48157.7us
I20260709 12:19:50.009689 29750 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 12:19:50.101753 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 5bc5bc9605e64854a78054b02b3da6dd from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:19:50.124763 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 5bc5bc9605e64854a78054b02b3da6dd from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-5bc5bc9605e64854a78054b02b3da6dd
I20260709 12:19:50.119693 29748 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260709 12:19:50.203882 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 259389us
I20260709 12:19:50.157193 29707 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:19:50.254611 24250 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:19:50.266939 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 140489us
W20260709 12:19:50.347807 29747 log.cc:927] Time spent T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.444s	user 0.003s	sys 0.002s
I20260709 12:19:50.357152 24259 tablet_copy_source_session.cc:215] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:19:50.347808 29733 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.054s	user 0.003s	sys 0.000s
I20260709 12:19:50.363123 29775 ts_tablet_manager.cc:933] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:50.371963 29740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc5bc9605e64854a78054b02b3da6dd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:50.395283 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 438878us
I20260709 12:19:50.483697 29776 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:50.487764 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:50.504395 23994 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index -1 to 11, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 15 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:50.547693 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 108345us
I20260709 12:19:50.530833 29775 tablet_copy_client.cc:323] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:19:50.558498 24098 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:19:50.599027 24098 raft_consensus.cc:2955] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index -1 to 11, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:50.629133 29796 ts_tablet_manager.cc:933] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:50.651796 24186 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet 44755249cf394d0aa1ea6b45f82eb521 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:19:50.652725 24186 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet 44755249cf394d0aa1ea6b45f82eb521 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-44755249cf394d0aa1ea6b45f82eb521
I20260709 12:19:50.597209 29785 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:19:50.674077 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 53932.6us
I20260709 12:19:50.683152 24168 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:55734
I20260709 12:19:50.684010 24168 raft_consensus.cc:606] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:50.723623 24176 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:19:50.762728 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 47327us
W20260709 12:19:50.772475 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 66647.7us
I20260709 12:19:50.786151 24176 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:55734
I20260709 12:19:50.809883 24176 raft_consensus.cc:606] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:50.818638 29740 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33918 (request call id 1124) took 1245 ms. Trace:
I20260709 12:19:50.819209 29740 rpcz_store.cc:276] 0709 12:19:49.573065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.573231 (+   166us) service_pool.cc:224] Handling call
0709 12:19:49.665002 (+ 91771us) ts_tablet_manager.cc:934] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
0709 12:19:50.370336 (+705334us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:50.786746 (+416410us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:50.786941 (+   195us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:50.817717 (+ 30776us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:50.818101 (+   384us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:50.818461 (+   360us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:50.818536 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":88066,"tablet-copy.queue_time_us":90690,"thread_start_us":264091,"threads_started":2}
I20260709 12:19:50.820778 29740 tablet_copy_client.cc:806] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:50.821400 29740 tablet_copy_client.cc:670] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:50.833401 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:50.835858 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:19:50.841995 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 55377.5us
I20260709 12:19:50.849789 24096 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:50.874722 29796 tablet_copy_client.cc:323] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.194:36209
I20260709 12:19:50.890338 24185 tablet_copy_service.cc:140] P 5d0f174a97494d0cbf08ae81ec4c807a: Received BeginTabletCopySession request for tablet 290d272848834ed2813ddb5e16609dba from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:44066)
I20260709 12:19:50.899575 24185 tablet_copy_service.cc:161] P 5d0f174a97494d0cbf08ae81ec4c807a: Beginning new tablet copy session on tablet 290d272848834ed2813ddb5e16609dba from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:44066: session id = c090031f610346ed82285cd847bca6d6-290d272848834ed2813ddb5e16609dba
I20260709 12:19:50.911316 24186 tablet_copy_source_session.cc:215] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:50.919265 29750 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:50.959456 29740 tablet_copy_client.cc:538] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:50.974530 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:50.951128 29785 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:19:51.003849 24185 tablet_copy_source_session.cc:215] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:51.038290 29772 raft_consensus.cc:993] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:51.038961 29772 raft_consensus.cc:1081] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:51.109103 29778 raft_consensus.cc:993] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:51.109740 29778 raft_consensus.cc:1081] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:19:51.112054 29775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44755249cf394d0aa1ea6b45f82eb521. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.122598 29740 tablet_bootstrap.cc:492] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:51.127516 29796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 290d272848834ed2813ddb5e16609dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:19:51.144104 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 265) took 1192 ms. Trace:
I20260709 12:19:51.144681 23996 rpcz_store.cc:276] 0709 12:19:49.951904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.952127 (+   223us) service_pool.cc:224] Handling call
0709 12:19:51.144006 (+1191879us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:50.089450 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:50.155322 (+ 65872us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:50.155370 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:19:50.155388 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:50.155822 (+   434us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:50.155890 (+    68us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:50.155926 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:50.158629 (+  2703us) tablet.cc:701] Row locks acquired
0709 12:19:50.158654 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:19:50.161210 (+  2556us) write_op.cc:270] Start()
0709 12:19:50.172188 (+ 10978us) write_op.cc:276] Timestamp: P: 1783599590158786 usec, L: 0
0709 12:19:50.196981 (+ 24793us) op_driver.cc:348] REPLICATION: starting
0709 12:19:50.251686 (+ 54705us) log.cc:844] Serialized 541 byte log entry
0709 12:19:50.671890 (+420204us) op_driver.cc:464] REPLICATION: finished
0709 12:19:51.053329 (+381439us) spinlock_profiling.cc:243] Waited 32.4 ms on lock 0x7b54000024a8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b9379e1 00007f4c0b93664c 00007f4c08fb2845 00007f4c08fb6d61 00007f4c08fb6d19 00007f4c08fb6ca9 00007f4c08fb6c71 00007f4c08fb5e9d 0000000000388634 0000000000388479 00007f4c0248e475
0709 12:19:51.053441 (+   112us) write_op.cc:301] APPLY: starting
0709 12:19:51.053586 (+   145us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:51.109667 (+ 56081us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:51.109692 (+    25us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:51.110548 (+   856us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:51.110733 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:51.110778 (+    45us) write_op.cc:312] APPLY: finished
0709 12:19:51.110962 (+   184us) log.cc:844] Serialized 25 byte log entry
0709 12:19:51.111155 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:51.111240 (+    85us) write_op.cc:454] Released schema lock
0709 12:19:51.111282 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:51.111679 (+   397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:51.111707 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27441,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":112221,"apply.run_cpu_time_us":9104,"apply.run_wall_time_us":295941,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":168,"prepare.run_cpu_time_us":4549,"prepare.run_wall_time_us":186827,"replication_time_us":474672,"spinlock_wait_cycles":74559360,"thread_start_us":101836,"threads_started":1}]]}
I20260709 12:19:51.149252 23994 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 300) took 1145 ms. Trace:
I20260709 12:19:51.145588 29750 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:59764 (request call id 13) took 1407 ms. Trace:
I20260709 12:19:51.150509 29750 rpcz_store.cc:276] 0709 12:19:49.717838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:49.718019 (+   181us) service_pool.cc:224] Handling call
0709 12:19:49.726163 (+  8144us) log.cc:844] Serialized 506 byte log entry
0709 12:19:51.125289 (+1399126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50883,"raft.run_cpu_time_us":2938,"raft.run_wall_time_us":17938,"thread_start_us":87033,"threads_started":2,"wal-append.queue_time_us":78218,"wal-append.run_cpu_time_us":2569,"wal-append.run_wall_time_us":1010838}
I20260709 12:19:51.164422 24244 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40978
I20260709 12:19:51.165310 24244 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:51.165751 24244 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:51.166822 24241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40978
I20260709 12:19:51.167514 24241 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:51.167882 24241 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:51.149765 23994 rpcz_store.cc:276] 0709 12:19:50.003478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.003686 (+   208us) service_pool.cc:224] Handling call
0709 12:19:51.149170 (+1145484us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:50.509345 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:50.509947 (+   602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:50.509981 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:19:50.509998 (+    17us) tablet.cc:662] Decoding operations
0709 12:19:50.510361 (+   363us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:50.510420 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:50.510450 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:50.510653 (+   203us) tablet.cc:701] Row locks acquired
0709 12:19:50.510670 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:19:50.510822 (+   152us) write_op.cc:270] Start()
0709 12:19:50.510945 (+   123us) write_op.cc:276] Timestamp: P: 1783599590510773 usec, L: 0
0709 12:19:50.510962 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:19:50.511692 (+   730us) log.cc:844] Serialized 599 byte log entry
0709 12:19:50.848622 (+336930us) op_driver.cc:464] REPLICATION: finished
0709 12:19:51.063004 (+214382us) write_op.cc:301] APPLY: starting
0709 12:19:51.063114 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:51.107516 (+ 44402us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:51.107721 (+   205us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:51.108709 (+   988us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:51.108915 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:51.108979 (+    64us) write_op.cc:312] APPLY: finished
0709 12:19:51.109230 (+   251us) log.cc:844] Serialized 25 byte log entry
0709 12:19:51.109421 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:51.109505 (+    84us) write_op.cc:454] Released schema lock
0709 12:19:51.109576 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:51.110034 (+   458us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:51.110066 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4479,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":211856,"apply.run_cpu_time_us":4047,"apply.run_wall_time_us":47046,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":485,"prepare.run_cpu_time_us":2642,"prepare.run_wall_time_us":2643,"replication_time_us":301740,"thread_start_us":107323,"threads_started":1}]]}
I20260709 12:19:51.177012 24244 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
W20260709 12:19:51.180459 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 75239.9us
I20260709 12:19:51.200335 29819 ts_tablet_manager.cc:933] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:51.206709 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:51.207576 24100 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:51.194664 24241 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:51.216506 24241 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:51.217301 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:51.218021 24095 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:51.260187 24095 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:51.264103 24244 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:19:51.292775 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45532.8us
I20260709 12:19:51.293732 24214 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:51.294278 29796 tablet_copy_client.cc:806] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:51.301970 29796 tablet_copy_client.cc:670] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:51.298353 24241 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:51.273820 23994 catalog_manager.cc:5697] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index -1 to 6, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New cstate: current_term: 9 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:51.310288 24100 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:19:51.317342 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:51.315909 24214 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:51.318002 24175 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:19:51.318378 24175 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:51.328564 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:51.329407 24168 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:51.329792 24168 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:51.331943 24167 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Committing config change with OpId 9.6: config changed from index -1 to 6, NON_VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } } }
I20260709 12:19:51.328253 24175 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:51.337563 24175 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:19:51.310920 29771 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:51.344179 29771 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:51.345237 29771 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:51.348753 29762 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:19:51.349383 29762 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:51.358004 29796 tablet_copy_client.cc:538] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:51.370066 24168 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:51.371300 29706 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:51.372051 29796 tablet_bootstrap.cc:492] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:51.377547 24168 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:51.350414 29762 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:51.397131 24175 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:19:51.419386 24168 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:51.429188 29819 tablet_copy_client.cc:323] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: tablet copy: Beginning tablet copy session from remote peer at address 127.22.93.195:37157
I20260709 12:19:51.433606 29775 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:33922 (request call id 752) took 1317 ms. Trace:
I20260709 12:19:51.476120 29775 rpcz_store.cc:276] 0709 12:19:50.113602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:50.113761 (+   159us) service_pool.cc:224] Handling call
0709 12:19:50.363639 (+249878us) ts_tablet_manager.cc:934] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
0709 12:19:51.010224 (+646585us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:51.224436 (+214212us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:51.224606 (+   170us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:51.389576 (+164970us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:51.402919 (+ 13343us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:51.424970 (+ 22051us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:51.430800 (+  5830us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":89134,"tablet-copy.queue_time_us":158126,"thread_start_us":159702,"threads_started":2}
I20260709 12:19:51.477823 29775 tablet_copy_client.cc:806] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
I20260709 12:19:51.480598 29775 tablet_copy_client.cc:670] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:51.513586 24259 tablet_copy_service.cc:140] P fa8cfbff90bf4881a56772b05008aadb: Received BeginTabletCopySession request for tablet 9e016416bdc742068f5568ff2bebabd1 from peer c090031f610346ed82285cd847bca6d6 ({username='slave'} at 127.0.0.1:59766)
I20260709 12:19:51.514406 24259 tablet_copy_service.cc:161] P fa8cfbff90bf4881a56772b05008aadb: Beginning new tablet copy session on tablet 9e016416bdc742068f5568ff2bebabd1 from peer c090031f610346ed82285cd847bca6d6 at {username='slave'} at 127.0.0.1:59766: session id = c090031f610346ed82285cd847bca6d6-9e016416bdc742068f5568ff2bebabd1
W20260709 12:19:51.565341 29823 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:19:51.584564 24259 tablet_copy_source_session.cc:215] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:19:51.616482 29819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e016416bdc742068f5568ff2bebabd1. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:19:51.654579 29824 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.130s	user 0.000s	sys 0.002s
I20260709 12:19:51.722324 29775 tablet_copy_client.cc:538] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:51.783593 24170 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:51.786011 29762 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:51.822662 29775 tablet_bootstrap.cc:492] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:51.857591 24095 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:51.860304 29762 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:19:51.881224 24100 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:51.882897 29762 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:51.882912 29740 tablet_bootstrap.cc:492] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:51.887581 29740 tablet_bootstrap.cc:492] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:51.888466 29740 ts_tablet_manager.cc:1403] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.766s	user 0.087s	sys 0.024s
W20260709 12:19:51.960976 24215 consensus_peers.cc:597] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb -> Peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Couldn't send request to peer c090031f610346ed82285cd847bca6d6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:19:51.973068 29831 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:19:51.970013 23996 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 15 to 16, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 16 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:52.018949 23996 catalog_manager.cc:5697] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 11 to 12, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:19:52.021055 24170 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:19:52.023994 29748 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:52.060135 29819 tablet_copy_client.cc:806] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 0 data blocks...
W20260709 12:19:52.086303 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 43506.3us
I20260709 12:19:52.105495 29740 raft_consensus.cc:359] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:52.134949 29819 tablet_copy_client.cc:670] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: tablet copy: Starting download of 1 WAL segments...
I20260709 12:19:52.137220 29740 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:52.143798 29740 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:52.157179 29819 tablet_copy_client.cc:538] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:19:52.158417 29740 ts_tablet_manager.cc:1434] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.270s	user 0.004s	sys 0.011s
I20260709 12:19:52.160715 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-5bc5bc9605e64854a78054b02b3da6dd received from {username='slave'} at 127.0.0.1:59766
I20260709 12:19:52.161252 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-5bc5bc9605e64854a78054b02b3da6dd on tablet 5bc5bc9605e64854a78054b02b3da6dd with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:52.245465 29796 tablet_bootstrap.cc:492] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:52.246711 29796 tablet_bootstrap.cc:492] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:52.247412 24246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40964
I20260709 12:19:52.247784 29796 ts_tablet_manager.cc:1403] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.876s	user 0.044s	sys 0.022s
I20260709 12:19:52.248169 24246 raft_consensus.cc:606] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Received request to transfer leadership
I20260709 12:19:52.262643 24246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40964
I20260709 12:19:52.263717 24246 raft_consensus.cc:606] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Received request to transfer leadership
W20260709 12:19:52.265658 23985 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 290d272848834ed2813ddb5e16609dba already in progress [suppressed 9 similar messages]
I20260709 12:19:52.288434 29796 raft_consensus.cc:359] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:52.289652 29796 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:52.314328 29775 tablet_bootstrap.cc:492] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:52.315757 29819 tablet_bootstrap.cc:492] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Bootstrap starting.
I20260709 12:19:52.317075 29775 tablet_bootstrap.cc:492] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:52.326373 29796 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:52.320333 29775 ts_tablet_manager.cc:1403] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.498s	user 0.055s	sys 0.015s
I20260709 12:19:52.331570 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:19:52.324692 23985 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 59105.6us
I20260709 12:19:52.329577 29796 ts_tablet_manager.cc:1434] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.081s	user 0.008s	sys 0.000s
I20260709 12:19:52.384567 24246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:40964
I20260709 12:19:52.385259 24246 raft_consensus.cc:606] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Received request to transfer leadership
I20260709 12:19:52.390290 24812 raft_consensus.cc:1217] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Deduplicated request from leader. Original: 11.7->[11.8-11.8]   Dedup: 11.8->[]
W20260709 12:19:52.394171 24047 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:19:52.394673 24047 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 290d272848834ed2813ddb5e16609dba already in progress
W20260709 12:19:52.395025 24047 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 290d272848834ed2813ddb5e16609dba already in progress
I20260709 12:19:52.397317 24246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:52.398000 24246 raft_consensus.cc:606] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:52.400817 24249 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:43126
I20260709 12:19:52.401458 24249 raft_consensus.cc:606] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:52.402700 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:52.405076 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:52.405995 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:52.412704 24185 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-290d272848834ed2813ddb5e16609dba received from {username='slave'} at 127.0.0.1:44066
I20260709 12:19:52.436167 24812 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 15 LEARNER]: Advancing to term 16
I20260709 12:19:52.436391 24185 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-290d272848834ed2813ddb5e16609dba on tablet 290d272848834ed2813ddb5e16609dba with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:52.410056 29775 raft_consensus.cc:359] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:52.446100 29775 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:52.464881 29750 raft_consensus.cc:993] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:52.465806 29771 raft_consensus.cc:1081] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:52.468307 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59344
I20260709 12:19:52.468916 24168 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:52.469280 24168 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:52.469461 29775 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:52.491966 29775 ts_tablet_manager.cc:1434] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.153s	user 0.002s	sys 0.007s
I20260709 12:19:52.494315 24185 tablet_copy_service.cc:342] P 5d0f174a97494d0cbf08ae81ec4c807a: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-44755249cf394d0aa1ea6b45f82eb521 received from {username='slave'} at 127.0.0.1:44066
I20260709 12:19:52.494841 24185 tablet_copy_service.cc:434] P 5d0f174a97494d0cbf08ae81ec4c807a: ending tablet copy session c090031f610346ed82285cd847bca6d6-44755249cf394d0aa1ea6b45f82eb521 on tablet 44755249cf394d0aa1ea6b45f82eb521 with peer c090031f610346ed82285cd847bca6d6
I20260709 12:19:52.497987 24168 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:52.506829 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:52.507586 24093 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:52.518816 24093 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:19:52.524237 24168 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:52.525382 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:52.529934 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:52.530938 29789 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:19:52.531512 29789 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:52.532475 29789 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:52.528348 24246 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:52.539580 24246 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:52.542867 24246 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:52.544384 24246 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:52.547798 29750 raft_consensus.cc:993] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:52.548378 29750 raft_consensus.cc:1081] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Signalling peer 729aa4b1ccec48b588c14e67652c61e1 to start an election
I20260709 12:19:52.553058 24093 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "290d272848834ed2813ddb5e16609dba"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
 from {username='slave'} at 127.0.0.1:37614
I20260709 12:19:52.553758 24093 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:52.554271 24093 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:52.581064 24246 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:19:52.576121 24093 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:52.596407 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:52.597297 24168 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:52.599090 24093 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:52.602937 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:52.603648 24246 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:52.603965 24246 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:52.605001 24246 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:52.606573 24246 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:52.615188 24168 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
I20260709 12:19:52.631377 24246 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
I20260709 12:19:52.645242 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:52.646521 29656 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:19:52.649163 24811 raft_consensus.cc:1217] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 12:19:52.649590 29656 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 17 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:52.659200 29656 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
W20260709 12:19:52.725172 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 62938.1us
W20260709 12:19:52.805269 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 49073.4us
I20260709 12:19:52.813715 23996 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 14 to 15, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 15 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:52.860110 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 87030.7us
I20260709 12:19:52.913957 23994 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 16 to 17, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 17 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:19:52.930949 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 176323us
W20260709 12:19:53.041005 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 223890us
I20260709 12:19:53.055930 29859 raft_consensus.cc:1064] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:53.056200 29819 tablet_bootstrap.cc:492] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:19:53.057410 29819 tablet_bootstrap.cc:492] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Bootstrap complete.
I20260709 12:19:53.058281 29819 ts_tablet_manager.cc:1403] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Time spent bootstrapping tablet: real 0.743s	user 0.037s	sys 0.019s
I20260709 12:19:53.059203 29859 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 6, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:53.105116 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 123901us
W20260709 12:19:53.087730 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 74772us
W20260709 12:19:53.109086 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 89278.3us
I20260709 12:19:53.147629 29862 raft_consensus.cc:993] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:53.148304 29862 raft_consensus.cc:1081] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
W20260709 12:19:53.288201 29733 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:19:53.318598 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 224465us
I20260709 12:19:53.337778 24806 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 16 LEARNER]: Advancing to term 17
W20260709 12:19:53.384322 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 206887us
I20260709 12:19:53.385278 24806 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 17 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:19:53.454449 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 49567.7us
W20260709 12:19:53.460536 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60018.3us
W20260709 12:19:53.479645 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 106366us
W20260709 12:19:53.583050 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 102540us
W20260709 12:19:53.590914 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 135618us
I20260709 12:19:53.461539 29819 raft_consensus.cc:359] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:53.607177 29819 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Initialized, Role: LEARNER
I20260709 12:19:53.632336 29819 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:53.736723 24244 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:53.738736 24096 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:19:53.743172 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 75261.6us
W20260709 12:19:53.728231 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 143609us
I20260709 12:19:53.749308 24167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59344
I20260709 12:19:53.749946 24167 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:53.750394 24167 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.751665 24812 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:53.753615 24806 raft_consensus.cc:1217] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.5->[9.6-9.6]   Dedup: 9.6->[]
I20260709 12:19:53.745680 29819 ts_tablet_manager.cc:1434] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Time spent starting tablet: real 0.687s	user 0.014s	sys 0.016s
I20260709 12:19:53.774889 29859 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:53.784274 24169 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:19:53.817453 29874 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:19:53.815683 29819 ts_tablet_manager.cc:1467] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Tablet startup took 757ms
I20260709 12:19:53.811324 24167 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:53.849997 24168 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 13. Current term is 14. Ops: []
W20260709 12:19:53.812553 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44214.9us
I20260709 12:19:53.814858 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 305) took 1089 ms. Trace:
I20260709 12:19:53.608305 29855 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.153s
I20260709 12:19:53.858803 29890 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:53.854080 23996 rpcz_store.cc:276] 0709 12:19:52.725794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.725950 (+   156us) service_pool.cc:224] Handling call
0709 12:19:52.749748 (+ 23798us) spinlock_profiling.cc:243] Waited 4.45 ms on lock 0x7b5400270010. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c024570b2 00007f4c0b3d0759 00007f4c0b368a76 00007f4c0b339d58 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc
0709 12:19:53.814780 (+1065032us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:52.984799 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:52.985652 (+   853us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:52.985701 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:19:52.985729 (+    28us) tablet.cc:662] Decoding operations
0709 12:19:53.047255 (+ 61526us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:53.059079 (+ 11824us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:53.059133 (+    54us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:53.059413 (+   280us) tablet.cc:701] Row locks acquired
0709 12:19:53.059435 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:19:53.059640 (+   205us) write_op.cc:270] Start()
0709 12:19:53.059766 (+   126us) write_op.cc:276] Timestamp: P: 1783599593059582 usec, L: 0
0709 12:19:53.059791 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:19:53.115750 (+ 55959us) log.cc:844] Serialized 541 byte log entry
0709 12:19:53.460895 (+345145us) op_driver.cc:464] REPLICATION: finished
0709 12:19:53.739293 (+278398us) write_op.cc:301] APPLY: starting
0709 12:19:53.739419 (+   126us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:53.753701 (+ 14282us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:53.766747 (+ 13046us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:53.788610 (+ 21863us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:53.788807 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:53.788852 (+    45us) write_op.cc:312] APPLY: finished
0709 12:19:53.789075 (+   223us) log.cc:844] Serialized 25 byte log entry
0709 12:19:53.789290 (+   215us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:53.789383 (+    93us) write_op.cc:454] Released schema lock
0709 12:19:53.789434 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:53.789876 (+   442us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:53.789906 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5265,"reported_tablets":1,"spinlock_wait_cycles":10243328,"child_traces":[["op",{"apply.queue_time_us":259912,"apply.run_cpu_time_us":4317,"apply.run_wall_time_us":50625,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":162151,"prepare.run_cpu_time_us":4398,"prepare.run_wall_time_us":154083,"replication_time_us":400904,"thread_start_us":285974,"threads_started":2}]]}
W20260709 12:19:53.826297 29819 ts_tablet_manager.cc:1469] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Trace:
0709 12:19:51.029567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:51.029771 (+   204us) service_pool.cc:224] Handling call
0709 12:19:51.200833 (+171062us) ts_tablet_manager.cc:934] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Initiating tablet copy from peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
0709 12:19:51.603045 (+402212us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:19:51.837395 (+234350us) tablet_metadata.cc:665] Metadata flushed
0709 12:19:51.837544 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:19:51.929753 (+ 92209us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:19:51.965496 (+ 35743us) tablet_replica.cc:206] Creating consensus instance
0709 12:19:52.017837 (+ 52341us) ts_tablet_manager.cc:989] Replica registered.
0709 12:19:52.019219 (+  1382us) inbound_call.cc:177] Queueing success response
0709 12:19:52.315249 (+296030us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:19:53.058611 (+743362us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:19:53.143889 (+ 85278us) tablet_replica.cc:261] Starting instrumentation
0709 12:19:53.144884 (+   995us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":33561,"mutex_wait_us":163378,"raft.queue_time_us":8412,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":146,"tablet-copy.queue_time_us":169860,"tablet-download-pool.queue_time_us":9387,"tablet-download-pool.run_cpu_time_us":1319,"tablet-download-pool.run_wall_time_us":4600,"thread_start_us":294690,"threads_started":2}
W20260709 12:19:53.877537 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 278086us
I20260709 12:19:53.887504 24095 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:53.889475 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:53.890553 24175 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:19:53.891788 24167 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:53.894302 24100 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:53.894707 23994 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 274) took 1089 ms. Trace:
I20260709 12:19:53.895149 23994 rpcz_store.cc:276] 0709 12:19:52.805833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:52.815671 (+  9838us) service_pool.cc:224] Handling call
0709 12:19:53.894632 (+1078961us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:53.230262 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:53.377121 (+146859us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:53.379716 (+  2595us) write_op.cc:435] Acquired schema lock
0709 12:19:53.387306 (+  7590us) tablet.cc:662] Decoding operations
0709 12:19:53.387747 (+   441us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:53.387801 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:53.387830 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:53.388034 (+   204us) tablet.cc:701] Row locks acquired
0709 12:19:53.388047 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:19:53.388215 (+   168us) write_op.cc:270] Start()
0709 12:19:53.388349 (+   134us) write_op.cc:276] Timestamp: P: 1783599593388161 usec, L: 0
0709 12:19:53.388368 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:19:53.389133 (+   765us) log.cc:844] Serialized 599 byte log entry
0709 12:19:53.609739 (+220606us) op_driver.cc:464] REPLICATION: finished
0709 12:19:53.790292 (+180553us) write_op.cc:301] APPLY: starting
0709 12:19:53.790376 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:53.821304 (+ 30928us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:53.822321 (+  1017us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:53.835572 (+ 13251us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:53.835821 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:53.835891 (+    70us) write_op.cc:312] APPLY: finished
0709 12:19:53.836202 (+   311us) log.cc:844] Serialized 25 byte log entry
0709 12:19:53.836655 (+   453us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:53.856979 (+ 20324us) write_op.cc:454] Released schema lock
0709 12:19:53.857033 (+    54us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":180336,"apply.run_cpu_time_us":4157,"apply.run_wall_time_us":67516,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4182,"num_ops":1,"prepare.queue_time_us":278828,"prepare.run_cpu_time_us":3773,"prepare.run_wall_time_us":173135,"replication_time_us":221179,"thread_start_us":261284,"threads_started":1}]]}
I20260709 12:19:53.907431 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:53.921689 29810 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:53.923478 29810 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:53.924676 24100 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:19:53.925947 29810 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:53.936416 29891 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:53.937314 29810 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:53.938254 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:53.944141 24140 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:53.945144 29858 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:19:53.945677 29858 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:53.941097 29851 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:19:53.946650 29858 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:53.948064 29851 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:53.948553 29851 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:53.949775 29851 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 6, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:53.956501 29851 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:53.970949 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67533.3us
I20260709 12:19:53.974910 24249 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:19:53.976032 24259 tablet_copy_service.cc:342] P fa8cfbff90bf4881a56772b05008aadb: Request end of tablet copy session c090031f610346ed82285cd847bca6d6-9e016416bdc742068f5568ff2bebabd1 received from {username='slave'} at 127.0.0.1:59766
I20260709 12:19:53.976770 24259 tablet_copy_service.cc:434] P fa8cfbff90bf4881a56772b05008aadb: ending tablet copy session c090031f610346ed82285cd847bca6d6-9e016416bdc742068f5568ff2bebabd1 on tablet 9e016416bdc742068f5568ff2bebabd1 with peer c090031f610346ed82285cd847bca6d6
W20260709 12:19:53.974926 24781 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.22.93.254:36285, user_credentials={real_user=slave}} blocked reactor thread for 43693.4us
I20260709 12:19:53.992856 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: true dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:54.005774 29869 raft_consensus.cc:1064] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:54.007895 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:54.170428 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 174731us
I20260709 12:19:54.010470 29869 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:54.179028 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 183344us
W20260709 12:19:54.176002 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 137600us
W20260709 12:19:54.182706 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 139095us
I20260709 12:19:54.181734 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:54.224291 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50998.1us
I20260709 12:19:54.199779 29862 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:54.307904 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 58067.7us
W20260709 12:19:54.339999 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 151033us
I20260709 12:19:54.318554 29844 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
W20260709 12:19:54.355036 29895 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.345s	user 0.000s	sys 0.004s
W20260709 12:19:54.355736 29897 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:19:54.366817 24244 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
W20260709 12:19:54.322248 29898 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.318s	user 0.002s	sys 0.000s
W20260709 12:19:54.490301 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 181022us
W20260709 12:19:54.561353 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 400677us
I20260709 12:19:54.582886 29903 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:54.661016 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 98241.1us
I20260709 12:19:54.662871 24096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:54.667179 24096 raft_consensus.cc:606] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:54.713114 29909 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:19:54.713511 29899 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:19:54.714008 29909 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:54.728154 29787 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:54.703667 29903 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:54.702517 29869 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
W20260709 12:19:54.761819 24780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.026s	sys 0.099s
W20260709 12:19:54.762419 24780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.026s	sys 0.099s
I20260709 12:19:55.049119 29910 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.050001 29910 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.052740 29910 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.101670 29917 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.102391 29917 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.104269 29917 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:54.771126 29903 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:55.176656 24064 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.008s	sys 0.004s
W20260709 12:19:55.177208 24064 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.008s	sys 0.004s
I20260709 12:19:55.179184 29901 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:55.179908 29901 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.186113 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 3218) took 1194 ms. Trace:
I20260709 12:19:55.180298 29879 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.191633 29879 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.194212 29879 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.186614 24244 rpcz_store.cc:276] 0709 12:19:53.992131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:53.992513 (+   382us) service_pool.cc:224] Handling call
0709 12:19:55.185892 (+1193379us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b5400059954. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:19:55.186008 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":808713472}
W20260709 12:19:55.206856 24140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.013s	sys 0.001s
W20260709 12:19:55.207469 24140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.014s	sys 0.001s
W20260709 12:19:55.207792 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 546892us
I20260709 12:19:55.202472 29901 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.202070 23994 catalog_manager.cc:5697] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 13 to 14, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 14 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:55.221895 29882 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.222759 29882 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:54.729050 29787 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.225312 29882 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.226647 29787 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:55.243461 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.013s	sys 0.003s
W20260709 12:19:55.244267 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.013s	sys 0.004s
W20260709 12:19:55.244810 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 548662us
I20260709 12:19:55.255996 29909 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.257014 29857 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.257992 29857 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.263378 29857 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.267378 29868 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:55.268322 29868 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.271596 29890 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.273043 29879 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.272418 29890 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.274477 29879 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.280639 29879 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.278273 29890 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.289525 29768 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.290395 29768 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.293411 29768 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.293661 29868 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.294059 29768 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:55.294330 29868 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.295409 29914 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.296200 29914 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.309737 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
W20260709 12:19:55.316542 24139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.021s	sys 0.016s
W20260709 12:19:55.317212 24139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.022s	sys 0.017s
I20260709 12:19:55.315266 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:55.319135 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:55.341149 29866 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.342005 29866 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.344774 29866 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.347416 29875 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.348240 29923 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.349063 29923 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.350829 29914 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.348058 29875 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.353508 29875 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.355549 29923 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:55.356856 24142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.017s	sys 0.017s
W20260709 12:19:55.357261 24142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.017s	sys 0.017s
I20260709 12:19:55.360283 29901 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.361181 29901 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.362210 29866 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.363055 29891 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.363822 29891 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.365319 29901 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.366763 29891 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:55.369429 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 659124us
I20260709 12:19:55.371712 29853 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:55.294656 29768 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.376976 29903 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.377912 29907 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.362833 29866 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.410065 24813 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 LEARNER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:55.413467 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:55.413990 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 184) took 1048 ms. Trace:
I20260709 12:19:55.427184 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:55.460223 23996 rpcz_store.cc:276] 0709 12:19:54.365988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:54.366241 (+   253us) service_pool.cc:224] Handling call
0709 12:19:55.166489 (+800248us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5400270010. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c024570b2 00007f4c0b3d0759 00007f4c0b368a76 00007f4c0b339d58 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc
0709 12:19:55.413885 (+247396us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":32921856}
I20260709 12:19:55.450486 29929 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.447992 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:55.460503 24169 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:55.462450 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.462438 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.463249 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:55.294901 29868 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.481307 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.481994 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.483567 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:55.483790 29868 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.484395 24096 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:19:55.481143 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.485906 29907 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.486541 29810 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.474716 24175 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:19:55.487516 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:55.487953 29762 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.488682 29907 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.490406 29851 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.490644 29906 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.491006 29851 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.491413 29906 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.493198 29851 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.493721 29851 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:55.494216 29906 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.494159 29851 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.487187 29929 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.495914 29862 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.496471 29862 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.488487 29762 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.415313 29861 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.487187 29810 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.504890 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:55.505707 24244 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:55.427233 29891 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.525419 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:55.535071 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.453902 29857 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.503436 29854 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:55.505151 29890 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.509375 29750 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.566022 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.458429 29903 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.511951 29889 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.537258 29907 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.541296 29879 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.581619 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.461915 29853 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.589419 24808 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:19:55.591614 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.559868 29771 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.602581 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:19:55.599026 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55939us
I20260709 12:19:55.547608 29857 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.608001 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.589216 29868 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.546674 29891 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.513626 29929 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.618618 29873 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.619963 29862 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.621261 29768 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.677688 29862 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.678459 29862 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.678730 29891 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.680994 29866 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.681361 29932 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:55.682075 29932 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.683532 29852 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.567456 29854 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.624325 29786 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.624744 29853 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.598343 29879 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.625492 29787 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:55.611904 29771 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.628064 29857 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.534257 29861 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:55.642863 29851 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.572901 29890 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.644344 29873 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:55.667303 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50123.3us
I20260709 12:19:55.667331 29868 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.622618 29762 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.621800 29926 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.691347 29854 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.693303 29903 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.593605 29889 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:55.764833 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.695328 29810 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.592882 29907 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.681059 29862 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.684283 29852 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.787822 29907 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:55.789641 29852 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.582561 29750 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.702418 29934 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:55.688853 29932 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.723003 29786 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.723217 29909 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:55.730513 29771 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.736703 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:55.720458 29853 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:55.756031 24241 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:55.754493 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:55.761093 29940 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:55.750784 29879 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:55.771085 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:55.783782 29861 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:55.784747 29926 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:55.796957 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:55.731564 29787 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:55.802891 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:55.804591 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:55.790277 24030 debug-util.cc:398] Leaking SignalData structure 0x7b0800338200 after lost signal to thread 22906
I20260709 12:19:55.807014 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:55.807291 29938 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:56.008848 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:19:56.011273 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 199562us
I20260709 12:19:55.913015 29939 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:19:56.014519 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 203972us
I20260709 12:19:56.018723 29940 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.021960 29926 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.024914 29787 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.034420 29750 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.017679 29853 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.111927 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.113843 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.027854 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.114677 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.025852 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.029274 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:56.032449 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.119766 24249 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:19:56.118901 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.030802 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.120226 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:56.121377 24030 debug-util.cc:398] Leaking SignalData structure 0x7b0800045740 after lost signal to thread 24033
W20260709 12:19:56.122974 24030 debug-util.cc:398] Leaking SignalData structure 0x7b080008ba00 after lost signal to thread 24125
I20260709 12:19:56.026353 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.024463 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:56.125643 24030 debug-util.cc:398] Leaking SignalData structure 0x7b080008b1a0 after lost signal to thread 24200
I20260709 12:19:56.044898 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:56.127851 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 98691.7us
I20260709 12:19:56.131343 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:19:56.038738 29946 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260709 12:19:56.126086 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 83889.7us
W20260709 12:19:56.125969 24030 debug-util.cc:398] Leaking SignalData structure 0x7b080008b080 after lost signal to thread 24201
I20260709 12:19:56.132680 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:56.138211 24030 debug-util.cc:398] Leaking SignalData structure 0x7b08003e49a0 after lost signal to thread 24274
W20260709 12:19:56.140013 24030 debug-util.cc:398] Leaking SignalData structure 0x7b0800338c00 after lost signal to thread 24839
I20260709 12:19:56.140666 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.143538 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.144306 24094 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:19:56.145917 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.146696 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.033669 29890 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.035215 29889 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.158440 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.144825 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:56.031931 29943 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:56.159941 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.162171 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.124300 29868 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.153026 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.167593 24242 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:19:56.159633 29723 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:56.172788 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.130869 29750 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:56.134796 29926 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:56.168411 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:56.176810 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.009900 29934 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.143355 29859 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:56.143883 29917 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:56.031101 29938 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.178377 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.162667 29871 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:56.179253 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.193377 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.170017 29944 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:56.174752 29723 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:56.031634 29939 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:56.176802 29889 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:56.204547 29861 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:19:56.178371 29873 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.185257 29750 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: NON_VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: true } }
I20260709 12:19:56.208690 29903 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:56.209192 29938 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.210172 29934 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.208738 29786 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.187131 29940 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.213110 29855 raft_consensus.cc:993] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:56.194789 29853 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:56.192028 29871 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:56.205083 29723 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:56.170135 29858 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:19:56.184937 29926 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:56.217023 29861 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:56.189774 29859 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.205927 29944 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.170840 29943 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.194126 29917 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.233515 29855 raft_consensus.cc:1081] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:19:56.228607 29871 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:56.241375 29943 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.244114 29917 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.231812 29926 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:56.220033 29889 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.234094 29861 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:56.250118 29853 raft_consensus.cc:1064] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:56.226346 29903 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.268529 29939 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.269304 29903 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:56.254834 29944 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:56.266790 29853 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 4, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.277099 29889 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.254541 29859 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:56.338760 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.341209 24092 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:56.342233 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.343535 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.343731 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.344206 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.347458 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.342278 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.350394 24094 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:56.372990 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.374224 24167 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:19:56.376020 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.377756 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.379312 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.380927 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.382396 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.384124 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.392104 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.393539 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.386876 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.396332 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.396823 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.397672 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.398728 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.402299 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.385308 24168 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:56.406639 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.407765 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.409070 24214 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:56.388841 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.389585 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.393610 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.412899 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:56.414672 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.387084 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.388731 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.409428 24094 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:19:56.432335 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.434296 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.436039 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.437378 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.387915 24095 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:19:56.440855 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.444401 24241 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:19:56.445523 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.446242 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.447640 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.448855 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:56.459069 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 271727us
I20260709 12:19:56.468571 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.470167 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.472638 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.472741 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:56.483064 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.495563 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.497051 29750 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:56.514801 29852 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:56.531710 29852 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:56.532269 29852 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:56.526291 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 78472.7us
I20260709 12:19:56.528735 24095 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:19:56.529426 29862 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:56.540421 23994 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 307) took 1638 ms. Trace:
I20260709 12:19:56.555328 29862 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:19:56.556986 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 116572us
W20260709 12:19:56.540547 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47051.6us
I20260709 12:19:56.575361 24246 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:56.555953 29943 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.582880 29862 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:56.598526 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 51251.1us
W20260709 12:19:56.603127 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72141.1us
I20260709 12:19:56.555351 23994 rpcz_store.cc:276] 0709 12:19:54.899715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:55.195650 (+295935us) service_pool.cc:224] Handling call
0709 12:19:56.537439 (+1341789us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:55.628511 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:55.629272 (+   761us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:55.629317 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:19:55.629338 (+    21us) tablet.cc:662] Decoding operations
0709 12:19:55.629750 (+   412us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:55.629820 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:55.629858 (+    38us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:55.630088 (+   230us) tablet.cc:701] Row locks acquired
0709 12:19:55.630104 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:19:55.630280 (+   176us) write_op.cc:270] Start()
0709 12:19:55.630435 (+   155us) write_op.cc:276] Timestamp: P: 1783599595630220 usec, L: 0
0709 12:19:55.630457 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:19:55.631341 (+   884us) log.cc:844] Serialized 541 byte log entry
0709 12:19:56.190950 (+559609us) op_driver.cc:464] REPLICATION: finished
0709 12:19:56.290585 (+ 99635us) write_op.cc:301] APPLY: starting
0709 12:19:56.290737 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:56.508762 (+218025us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:56.508974 (+   212us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:56.529177 (+ 20203us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:56.529518 (+   341us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:56.529580 (+    62us) write_op.cc:312] APPLY: finished
0709 12:19:56.530168 (+   588us) log.cc:844] Serialized 25 byte log entry
0709 12:19:56.530521 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:56.530722 (+   201us) write_op.cc:454] Released schema lock
0709 12:19:56.530805 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:56.531727 (+   922us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:56.531763 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":88644,"apply.run_cpu_time_us":7148,"apply.run_wall_time_us":241021,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":398622,"prepare.run_cpu_time_us":41517,"prepare.run_wall_time_us":147085,"raft.queue_time_us":377166,"raft.run_cpu_time_us":64236,"raft.run_wall_time_us":126744,"replication_time_us":545582,"thread_start_us":592322,"threads_started":4,"wal-append.queue_time_us":128450}]]}
I20260709 12:19:56.614054 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:56.614907 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 126852us
I20260709 12:19:56.621304 29939 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:56.634001 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.640467 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.641208 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.642388 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:56.643312 24809 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:19:56.643448 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.645047 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.634176 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.649209 29723 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:56.651861 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 63854.8us
I20260709 12:19:56.652756 29855 raft_consensus.cc:1064] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: attempting to promote NON_VOTER c090031f610346ed82285cd847bca6d6 to VOTER
I20260709 12:19:56.652969 24214 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:56.622364 29939 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:56.656107 29855 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 12, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.660310 29810 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:56.660794 29810 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:56.661198 29810 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:56.663655 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:19:56.683615 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 71460.6us
I20260709 12:19:56.687651 24780 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:56.688946 29850 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:56.690071 29850 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:56.691447 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 74592.8us
W20260709 12:19:56.694202 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 89856.7us
W20260709 12:19:56.707123 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 43648.4us
I20260709 12:19:56.693151 29861 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.729671 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.729460 29959 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:56.725963 29871 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.738435 24097 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:56.734820 29959 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:56.747764 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.753407 24093 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:56.750209 29959 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:56.757354 29871 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.743829 29852 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.758796 29926 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.766191 29723 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.767524 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:56.771780 29939 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:56.772080 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 69602.7us
W20260709 12:19:56.775173 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.775074 29939 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:19:56.772363 29852 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:56.780071 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:56.782251 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:56.789724 29958 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:19:56.767580 29861 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:56.797509 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47075.1us
I20260709 12:19:56.801236 29866 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:19:56.801584 29960 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:19:56.804194 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 51108.5us
I20260709 12:19:56.805260 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:56.806218 29723 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:19:56.808560 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:56.813745 24781 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.814033 29850 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.814551 29955 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:19:56.823922 29939 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:56.826790 29926 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.831770 24780 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:56.799479 29958 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:56.816239 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.835296 29866 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:56.837334 24141 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.838475 29927 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:56.838582 24781 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.839264 29927 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:56.839704 29866 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:56.840174 29866 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:56.839902 29927 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.840579 29866 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.842326 29927 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.808012 24066 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:56.845593 29723 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:56.846416 24066 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:56.844713 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.848699 29939 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:56.842873 29927 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:56.850493 29958 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:56.852921 29868 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:19:56.853372 29868 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:56.853786 29868 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:56.853624 29961 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:56.857679 29962 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:56.858373 29962 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.861379 29962 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:56.855414 29961 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.868526 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:56.869000 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:56.869526 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:56.872973 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.873226 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:56.873796 24168 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:56.874445 29962 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:56.875341 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:19:56.875178 29962 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.876034 29961 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.876135 24168 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:19:56.876745 24168 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.878122 29962 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.881337 29854 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:56.882097 29854 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.883428 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.884923 29854 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:56.885160 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.888345 29862 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:56.893707 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:56.899446 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 163433us
I20260709 12:19:56.899972 29871 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:56.900424 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.901400 29962 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:56.901633 29955 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:56.902917 24779 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.907307 29962 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:56.907884 29959 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.915627 24813 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:56.915982 29866 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.918520 29866 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:56.834216 29810 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.920532 29959 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:56.910974 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72487.8us
I20260709 12:19:56.922592 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:56.926501 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:19:56.901400 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 55109.1us
I20260709 12:19:56.930039 29927 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:56.931136 29810 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.937929 24168 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.908740 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:56.932243 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.952725 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:56.954456 24168 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:56.951462 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:56.964938 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:56.948335 29961 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:19:56.967656 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59025.6us
I20260709 12:19:56.967770 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:56.968420 24169 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:56.972723 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:56.976166 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:56.978606 29957 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:56.957190 29854 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:56.988859 29854 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:56.995322 24779 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:56.998311 29957 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:19:56.999150 29957 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:56.999733 29957 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:56.963969 29939 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:56.970297 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:57.008697 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.013959 24169 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:19:57.015887 29868 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.018401 29961 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.020969 29961 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:57.021056 29957 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:57.031209 29959 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:57.018795 29868 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:57.022359 23994 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:57.042547 24216 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.046259 29862 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:57.049616 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:57.052996 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 123417us
I20260709 12:19:57.056643 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:57.057605 24094 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:57.052500 29862 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:57.061678 29854 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:57.068183 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.073179 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.031934 29959 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.052181 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.097699 29959 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:19:57.099351 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 60620.2us
I20260709 12:19:57.100476 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.103139 24066 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:57.077267 29961 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.104265 29961 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.106787 29857 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:57.109215 29857 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:57.109575 29857 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.110908 29853 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:57.116117 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:57.118072 29940 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.121235 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:57.123090 29852 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.123471 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.123744 29852 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:57.125793 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.102626 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.127553 29852 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:57.210180 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.144840 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:57.204828 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 82752.5us
W20260709 12:19:57.211828 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 109307us
I20260709 12:19:57.213064 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.213979 29853 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.129041 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.129798 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.155541 29810 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:57.172238 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.106750 29961 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:57.201215 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.128480 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.133657 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:19:57.217881 24812 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:19:57.218880 24781 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:57.163790 24809 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 19.
W20260709 12:19:57.225322 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57656.4us
I20260709 12:19:57.215013 29853 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:57.229473 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.236155 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.241293 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:57.241793 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:57.243007 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 109435us
I20260709 12:19:57.130218 24806 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:57.243966 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.246121 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:57.247232 29956 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:57.251152 24171 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:57.252267 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:57.252923 24807 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 LEARNER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:19:57.253683 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.259415 24174 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:57.260228 24141 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.261710 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:57.262418 29940 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:57.263401 29858 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.264963 24141 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:19:57.269688 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56708.1us
I20260709 12:19:57.269932 29810 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.267194 29956 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:57.273036 29810 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:57.273250 29956 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.276721 29945 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:57.226378 29958 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:57.273027 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.270859 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:57.279855 24100 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:57.280190 24215 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.280423 29854 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.280712 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.281271 29854 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.281402 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:57.281641 29853 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.282220 24216 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.283156 29853 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:57.282262 29971 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:57.283771 29971 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:57.284158 29971 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:57.285252 24215 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.286521 29853 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:57.287331 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.288370 29909 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.288964 24094 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:19:57.289130 24171 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:57.289685 24093 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:57.290900 29961 consensus_queue.cc:1059] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:19:57.291293 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:57.288060 24141 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.280234 24100 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:57.310019 29971 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:57.313443 24215 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.317472 29940 consensus_queue.cc:1059] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:19:57.315515 29945 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:57.331106 29810 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.331856 29810 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.332472 29810 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.332911 24215 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.333999 29854 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:19:57.334414 29854 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.334806 29854 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.204792 29857 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:57.337101 29857 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:57.334702 29810 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:57.316534 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:57.342224 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.343230 29862 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:19:57.343870 29862 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:57.344252 29961 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:57.344910 29961 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.345359 24092 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:57.344940 29862 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:57.322950 24167 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:57.324708 24100 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.329087 29958 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:57.322425 29939 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:19:57.319518 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:57.314728 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 129204us
I20260709 12:19:57.358029 24780 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:57.359710 24100 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.360093 29961 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:57.361560 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.362525 29939 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:57.371970 29939 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:57.373184 29939 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.374658 29939 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:57.363060 29909 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.364190 29959 raft_consensus.cc:3055] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:57.375385 29959 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:57.372640 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.376467 29959 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.377290 29958 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:19:57.377889 29959 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:57.379652 24100 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:57.382653 29958 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:19:57.369160 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.386535 24216 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.392571 29961 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.397928 24809 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:57.399354 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:57.400004 24812 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.401516 29858 consensus_queue.cc:1059] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:57.402827 29926 raft_consensus.cc:3055] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:57.403286 29926 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:57.404350 29926 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.405496 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.412420 29852 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.412961 29926 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:57.413193 29971 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:57.414026 29962 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.413261 29852 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.414552 29962 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.416189 24216 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.417834 29962 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:57.419623 29958 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.419826 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:19:57.418126 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:57.418285 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 339913us
I20260709 12:19:57.421531 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.424810 29958 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:19:57.426205 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.427280 24066 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:57.428256 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.432740 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.437091 24807 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:19:57.438856 24812 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:19:57.440665 24215 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.432145 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.443172 24141 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:57.440512 29852 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:57.456940 29927 raft_consensus.cc:3055] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:57.457461 29927 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:57.457803 24215 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:57.459213 29909 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.460070 29909 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:19:57.460471 29909 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.460875 29909 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:57.463201 29810 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.464852 24215 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.467310 29862 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:19:57.467718 29862 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.468169 29862 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:57.458571 29927 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:57.478121 29927 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:57.491350 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 48261.4us
W20260709 12:19:57.492091 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 64893.6us
I20260709 12:19:57.492933 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:57.447407 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 118960us
I20260709 12:19:57.445935 29971 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:19:57.504794 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72778us
I20260709 12:19:57.517767 29854 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.519196 29861 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:19:57.520426 29854 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:57.520854 29977 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:57.522614 29789 raft_consensus.cc:3055] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:57.523046 29789 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:57.524022 29789 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:57.524556 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:19:57.525978 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.527097 29789 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.528605 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:57.529263 24809 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.505184 24810 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:57.538064 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.501474 29723 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:57.545177 29853 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:57.546241 29853 consensus_queue.cc:1243] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:19:57.499853 29945 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:57.552572 24167 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:57.559512 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:57.560005 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.562644 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:57.553037 23996 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 11 to 12, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 12 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:19:57.546808 29853 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:19:57.567405 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 74568.1us
I20260709 12:19:57.569021 24066 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:57.574518 29855 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.550961 29945 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:57.580229 29852 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:19:57.586831 29862 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.590396 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:57.591435 29972 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:57.591533 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:57.591920 29972 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:57.592381 29972 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:57.592970 29854 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.593649 29854 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.596707 29854 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:57.597297 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:57.568202 29971 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:19:57.568459 29853 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:57.598155 29723 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.566885 29861 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:19:57.599644 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:57.601595 29723 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.601598 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.603410 29909 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.604101 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.604903 24810 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:57.608601 29858 raft_consensus.cc:2955] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:57.611394 24215 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:57.612655 29810 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:57.613047 29810 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.613379 29862 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:57.613595 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:57.614270 24812 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:57.614655 29853 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.615523 24066 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:57.616395 29723 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:19:57.616840 29853 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:57.620803 29945 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.622560 29909 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:57.623787 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:57.624464 24810 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:57.636013 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:57.636157 24174 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:19:57.636831 24812 raft_consensus.cc:2468] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 18.
I20260709 12:19:57.638267 24215 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.613464 29810 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:57.656800 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:57.656836 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:57.659247 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:19:57.661720 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 87475.5us
I20260709 12:19:57.712034 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.711985 24806 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:19:57.647998 29909 raft_consensus.cc:2804] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:19:57.721096 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.724437 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.725500 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.724818 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.730096 24098 raft_consensus.cc:2393] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:19:57.730827 24243 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:57.731117 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:57.733333 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.734931 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.740319 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.743558 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:57.747484 24244 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:57.744247 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:57.751639 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.755637 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:57.729164 29789 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:57.760063 29789 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:57.661791 29972 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.765815 29972 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:57.766768 29980 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:19:57.729081 29909 raft_consensus.cc:697] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:57.728909 29926 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:57.771178 24101 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:57.771850 24093 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:57.762674 29789 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:57.795589 24092 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
W20260709 12:19:57.801129 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:57.808053 29982 log.cc:927] Time spent T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:19:57.818687 24810 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 20.
I20260709 12:19:57.835222 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:57.840838 24244 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:19:57.846071 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:19:57.852187 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:57.852000 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:57.771086 29926 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:57.883306 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.882539 24779 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:57.889964 24779 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:57.884917 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 74860.5us
I20260709 12:19:57.927392 24809 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:19:57.928297 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:57.933084 24806 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
W20260709 12:19:57.955009 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 214606us
I20260709 12:19:57.922677 29909 consensus_queue.cc:237] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:57.895848 29956 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:57.987389 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:57.988622 24812 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:57.989257 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.002038 24808 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:58.004424 24244 raft_consensus.cc:2393] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 12: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:58.008419 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.010165 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:58.010838 24249 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:58.018961 29945 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:58.019858 24809 raft_consensus.cc:1240] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:19:58.019716 29945 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:58.021862 29926 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:57.987726 29985 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:19:58.018953 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 129087us
I20260709 12:19:58.025249 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:58.027261 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:58.027886 24245 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:58.022789 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.022675 29985 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.038945 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:58.044395 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:58.016700 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:58.046818 24813 raft_consensus.cc:2955] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:58.059201 29857 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:57.986824 29959 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:19:58.062299 23994 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 272) took 1070 ms. Trace:
I20260709 12:19:58.038703 29985 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:19:58.072182 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48548.8us
W20260709 12:19:58.092337 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.093328 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.109123 29941 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:19:58.118067 24812 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 17 LEARNER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:19:58.115072 24101 raft_consensus.cc:1240] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:58.116681 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.119441 24249 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:19:58.066933 23994 rpcz_store.cc:276] 0709 12:19:56.991455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:56.991696 (+   241us) service_pool.cc:224] Handling call
0709 12:19:58.062220 (+1070524us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:57.377427 (+     0us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b54000024a8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b9379e1 00007f4c0b93664c 00007f4c08fc5adc 00007f4c08fb10a6 00007f4c08fb0d58 00007f4c08fb59f1 00007f4c08fb59a9 00007f4c08fb5939 00007f4c08fb5901 00007f4c08fb4b2d 0000000000388634
0709 12:19:57.377557 (+   130us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:57.378243 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:57.378295 (+    52us) write_op.cc:435] Acquired schema lock
0709 12:19:57.378312 (+    17us) tablet.cc:662] Decoding operations
0709 12:19:57.378737 (+   425us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:57.378843 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:57.378870 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:57.381872 (+  3002us) tablet.cc:701] Row locks acquired
0709 12:19:57.381929 (+    57us) write_op.cc:260] PREPARE: finished
0709 12:19:57.382119 (+   190us) write_op.cc:270] Start()
0709 12:19:57.382373 (+   254us) write_op.cc:276] Timestamp: P: 1783599597382037 usec, L: 0
0709 12:19:57.382391 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:19:57.383274 (+   883us) log.cc:844] Serialized 599 byte log entry
0709 12:19:57.619519 (+236245us) op_driver.cc:464] REPLICATION: finished
0709 12:19:57.758425 (+138906us) write_op.cc:301] APPLY: starting
0709 12:19:57.758595 (+   170us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:57.760442 (+  1847us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:57.760480 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:57.885301 (+124821us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:57.952352 (+ 67051us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:57.968899 (+ 16547us) write_op.cc:312] APPLY: finished
0709 12:19:57.982105 (+ 13206us) log.cc:844] Serialized 25 byte log entry
0709 12:19:57.992924 (+ 10819us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:58.003908 (+ 10984us) write_op.cc:454] Released schema lock
0709 12:19:58.005847 (+  1939us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:58.010232 (+  4385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:58.010277 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":14666,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":138513,"apply.run_cpu_time_us":5902,"apply.run_wall_time_us":251826,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":194525,"prepare.run_cpu_time_us":6758,"prepare.run_wall_time_us":142053,"replication_time_us":236902,"spinlock_wait_cycles":59220864,"thread_start_us":236090,"threads_started":2}]]}
I20260709 12:19:58.113317 24092 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:58.112478 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:19:57.990070 29871 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.123s
I20260709 12:19:58.066618 29945 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:58.124461 24244 raft_consensus.cc:1240] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:19:58.124557 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.126453 24779 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.129482 24066 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:58.130764 24246 raft_consensus.cc:2393] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 20: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:58.131848 24249 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:58.110206 29962 consensus_queue.cc:1059] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:19:58.143241 24066 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:58.147917 24779 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:58.151402 24173 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:58.151541 24779 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:58.121094 29857 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:19:58.164096 29956 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:58.164623 29854 consensus_queue.cc:1059] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:58.164975 29862 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:19:58.166354 29852 raft_consensus.cc:3055] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:58.166754 29852 raft_consensus.cc:740] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:58.165045 29961 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:19:58.167729 29852 consensus_queue.cc:260] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:58.169134 29852 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:58.171821 29853 consensus_meta.cc:287] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.554s	user 0.006s	sys 0.006s
W20260709 12:19:58.173540 29927 consensus_meta.cc:287] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.695s	user 0.012s	sys 0.001s
W20260709 12:19:58.174553 29858 consensus_meta.cc:287] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.005s
I20260709 12:19:58.146239 29850 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:58.176249 29810 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.177664 24242 raft_consensus.cc:1240] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:58.178601 29810 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:58.146570 29970 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:19:58.194854 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.195495 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:58.185246 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 228953us
I20260709 12:19:58.186122 24215 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:58.187750 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 44607.3us
I20260709 12:19:58.204000 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.188493 29962 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:19:58.189411 29938 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:19:58.189589 29857 raft_consensus.cc:3055] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:19:58.205289 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 51472.6us
I20260709 12:19:58.205582 24171 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:19:58.214005 24215 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:58.214749 24245 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:19:58.207989 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.215998 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:58.231134 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.231554 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:19:58.226821 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:58.202692 29850 raft_consensus.cc:697] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:58.247787 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:19:58.213258 29853 raft_consensus.cc:2804] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:19:58.248600 24248 raft_consensus.cc:1240] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:19:58.246043 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:58.212636 29857 raft_consensus.cc:740] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:58.261605 24245 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14. Ops: []
I20260709 12:19:58.262442 24241 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:19:58.234668 29958 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:58.264926 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:58.282215 24245 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: [14.7-14.7]
I20260709 12:19:58.283550 29988 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:19:58.286598 24243 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:58.287663 29850 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.288130 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.289317 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.230388 29972 consensus_queue.cc:1059] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:19:58.239471 29871 consensus_queue.cc:1059] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:19:58.263816 29994 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:58.300388 29994 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:58.300863 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:58.302670 29994 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:58.303042 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.303516 29959 raft_consensus.cc:3055] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:19:58.303944 29959 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:58.304949 29959 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.305368 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.306329 29959 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:19:58.307348 29857 consensus_queue.cc:260] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.308280 24245 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:58.308756 24250 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:19:58.309002 29857 raft_consensus.cc:3060] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:19:58.272254 29938 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:19:58.280737 29853 raft_consensus.cc:697] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 20 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:58.296506 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:19:58.312462 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:58.323081 29938 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:58.290400 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:58.326050 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:58.330525 29854 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:58.308315 29723 raft_consensus.cc:3055] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:19:58.317451 29958 raft_consensus.cc:697] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:19:58.348342 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:19:58.348919 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.349198 24780 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.350785 24780 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.351946 24780 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.324219 29938 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:58.358618 29994 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:19:58.359575 30002 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:58.371567 29958 consensus_queue.cc:237] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.339883 29985 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 13.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:19:58.339502 29945 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:19:58.379944 29909 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:58.353071 29962 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:58.364574 30006 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:19:58.365368 24242 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:58.365724 24173 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:19:58.365374 24093 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:58.367017 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:58.386973 29852 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:58.367156 24780 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.392131 24780 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:58.331733 24246 raft_consensus.cc:2955] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:58.393580 29961 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:58.393728 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.394351 29961 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:58.367689 29861 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:19:58.395084 30002 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:19:58.394872 30009 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:19:58.368418 29853 consensus_queue.cc:237] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.396448 30009 raft_consensus.cc:3055] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:58.396832 30009 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:58.397863 30009 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.399570 29985 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:19:58.360477 29970 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:58.340477 29723 raft_consensus.cc:740] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:58.332124 29999 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:19:58.408571 29723 consensus_queue.cc:260] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.409919 29723 raft_consensus.cc:3060] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:19:58.408702 24242 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.411682 29945 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:19:58.412096 29945 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:58.412977 29945 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:58.422327 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 214423us
I20260709 12:19:58.423754 24780 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:19:58.431465 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.436578 29970 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:19:58.437201 29970 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:58.438163 29970 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:58.441206 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 202075us
W20260709 12:19:58.450007 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 86986.7us
I20260709 12:19:58.451826 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.460291 29999 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:58.453612 30009 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:58.400012 29985 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:58.462929 29971 consensus_queue.cc:1059] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:19:58.463177 29985 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:58.464205 29971 raft_consensus.cc:3055] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:19:58.464620 29971 raft_consensus.cc:740] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:58.464788 29985 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:58.465523 29971 consensus_queue.cc:260] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.394897 29961 raft_consensus.cc:697] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:19:58.470512 24813 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:58.468473 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:58.476460 24067 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:19:58.481066 29986 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:58.480693 24812 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:58.466826 29971 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:58.489101 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 1 yes votes; 3 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.492311 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.500038 30003 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:19:58.508023 30015 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:19:58.492272 29938 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:19:58.509876 29938 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:19:58.510233 29938 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:58.508457 23994 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 11 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.511231 29938 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:58.549283 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 76603.8us
W20260709 12:19:58.566687 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 74501.4us
I20260709 12:19:58.564651 29858 raft_consensus.cc:3055] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:58.574046 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:58.552541 29945 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:19:58.577186 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 88441.3us
I20260709 12:19:58.573257 29858 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:19:58.636914 29999 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:19:58.669730 29858 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.638625 24092 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:19:58.671563 24092 raft_consensus.cc:606] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:19:58.580159 29927 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:19:58.674217 29927 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:19:58.675287 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.678483 24093 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
I20260709 12:19:58.680569 29858 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:58.683504 24807 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:58.620765 29976 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:58.538126 29850 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:19:58.570942 29977 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:19:58.650660 29938 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:19:58.624567 29961 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.695785 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:58.705382 23996 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 12 to 13, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 13 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:19:58.749274 23996 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 9 to 10, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 10 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.697527 24175 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:58.755483 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 61646us
I20260709 12:19:58.755008 23996 catalog_manager.cc:5697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 11 to 12, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 12 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:19:58.761463 24173 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:19:58.764640 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:58.790283 29994 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:19:58.835296 24096 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:19:58.778482 29862 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:19:58.780745 30022 consensus_queue.cc:1059] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.080s
I20260709 12:19:58.862411 24173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6831162b73f4c16a41519abb392404b"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:55734
I20260709 12:19:58.863266 24173 raft_consensus.cc:606] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
W20260709 12:19:58.872609 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 93779.9us
W20260709 12:19:58.882910 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 94237.4us
I20260709 12:19:58.887992 30022 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:58.888355 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:19:58.888682 30022 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.891000 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:19:58.892241 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:19:58.894153 24101 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:58.897629 30022 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:58.900365 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:19:58.901504 29854 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:19:58.882898 24096 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:58.920286 30013 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:19:58.921829 29999 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:58.922435 29999 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:58.948926 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:58.884850 29871 raft_consensus.cc:3055] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:19:58.991317 24807 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
W20260709 12:19:58.991866 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 46711.6us
I20260709 12:19:59.007404 29854 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:19:58.994791 29871 raft_consensus.cc:740] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:19:59.039362 24066 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:19:59.020746 29940 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:59.063164 30019 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:19:59.063551 29940 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:59.065778 30030 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:19:59.066332 29940 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:59.076334 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:59.071936 29850 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:19:59.098591 30037 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:59.099365 30037 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:59.105234 24810 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:59.107522 29723 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:19:59.088246 29850 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:19:59.111253 29850 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:19:59.116637 30031 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:19:59.143524 30032 log.cc:927] Time spent T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:19:59.144827 29999 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:59.150862 29871 consensus_queue.cc:260] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:59.192992 30035 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.193763 30035 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:59.163066 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:59.197211 24241 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:59.200425 30037 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:59.201484 29909 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.202080 29909 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:59.206974 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:59.207693 24241 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:59.193086 29995 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
I20260709 12:19:59.174738 29999 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.185474 24812 raft_consensus.cc:1275] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:19:59.211050 29999 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:59.213435 30035 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:59.222517 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:59.223670 24249 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 15: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:59.224455 24241 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:59.226657 29938 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:19:59.229250 24100 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:59.231433 24170 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:19:59.232700 24092 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
W20260709 12:19:59.236552 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 63289.7us
I20260709 12:19:59.239938 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:59.241412 24808 raft_consensus.cc:1275] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:19:59.244196 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:59.246382 24807 raft_consensus.cc:1275] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:19:59.253953 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:19:59.255008 24171 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:19:59.213943 29999 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:59.214778 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:59.216830 29909 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:19:59.219806 24250 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:59.266021 24171 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:19:59.290449 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:59.292387 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:19:59.281906 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:19:59.295089 24175 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:19:59.295463 24807 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:19:59.280722 24247 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:19:59.310319 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:59.311257 24100 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:19:59.323212 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:59.334268 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:19:59.314180 29971 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:19:59.391686 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:19:59.358820 24215 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:19:59.301762 29938 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:19:59.405633 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 46903.2us
I20260709 12:19:59.326897 29909 consensus_queue.cc:1048] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
I20260709 12:19:59.328944 30015 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:19:59.397037 29958 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.082s
W20260709 12:19:59.539239 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.423893 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 94154.8us
I20260709 12:19:59.456751 24246 raft_consensus.cc:2955] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 11 to 14, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:19:59.393769 29861 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:19:59.664705 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 201784us
I20260709 12:19:59.783311 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:19:59.475904 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 156384us
W20260709 12:19:59.640239 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 317063us
I20260709 12:19:59.402170 29971 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:59.784945 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:59.798384 30060 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:59.424746 30013 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:19:59.801916 30013 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:59.799966 30060 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:59.804267 30013 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:59.804981 30039 consensus_queue.cc:1048] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260709 12:19:59.806098 30060 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:59.806309 30058 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:59.806931 30037 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:19:59.807554 30037 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:19:59.808051 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:19:59.810091 30037 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:19:59.810811 29976 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:59.811421 30056 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:19:59.811875 30056 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.806973 30058 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:59.812395 30056 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:19:59.602151 29871 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:19:59.430781 29862 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:19:59.820142 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:19:59.819944 24168 raft_consensus.cc:2955] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 11 to 14, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:19:59.831571 24096 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.013s	sys 0.011s
W20260709 12:19:59.831997 24096 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.013s	sys 0.011s
I20260709 12:19:59.811308 29976 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.830681 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:19:59.789366 29861 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:19:59.834363 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 51184.9us
I20260709 12:19:59.789084 29971 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:19:59.459069 29993 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.493s
I20260709 12:19:59.840104 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:19:59.845829 24781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.051s
I20260709 12:19:59.484669 29850 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:19:59.875350 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:19:59.867431 24781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.007s	sys 0.051s
I20260709 12:19:59.872493 24247 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 14: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:19:59.833936 29862 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:19:59.459225 30040 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.499s
W20260709 12:19:59.892241 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52190.6us
I20260709 12:19:59.901362 30057 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:19:59.902093 30057 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:19:59.838682 29976 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:19:59.908046 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 64059us
I20260709 12:19:59.902768 29861 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:19:59.847721 29852 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:19:59.907413 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 59644.8us
I20260709 12:20:00.030639 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:00.015816 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 128913us
I20260709 12:19:59.898725 29862 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:19:59.851323 30002 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:00.017825 24101 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:00.056775 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:00.032019 29789 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:00.055990 29852 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.116140 29852 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:00.116113 29789 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:00.084390 30065 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 12:20:00.055990 24099 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:00.088349 29996 consensus_queue.cc:1048] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:00.094252 29940 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:00.125579 29940 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:00.127977 29940 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:00.099537 30028 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.128695 30028 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.128237 30066 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:20:00.103252 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 190253us
I20260709 12:19:59.916620 29998 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:00.110522 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54075.3us
I20260709 12:20:00.118702 29789 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:00.108247 24094 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
W20260709 12:20:00.124368 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 68533.2us
I20260709 12:20:00.140334 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:00.167734 24246 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:00.112629 29984 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.130910 30028 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:00.198975 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:00.199759 24171 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:00.179876 29962 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:19:59.454435 29723 raft_consensus.cc:2955] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 17 LEADER]: Committing config change with OpId 17.14: config changed from index 11 to 14, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:00.212282 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:00.220516 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:00.222270 24216 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:00.193864 29961 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.155133 30003 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:20:00.204818 29857 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.210434 30058 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:00.148756 30002 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.161250 29998 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:00.230890 29853 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:00.237805 29945 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:00.197955 29984 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:00.292882 30009 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.295233 30045 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:00.301828 29853 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:00.299656 29938 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.233887 29961 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.241834 29857 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.221522 29962 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.335438 24214 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:00.358489 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:00.353210 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:00.320680 29810 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:00.321255 29850 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:00.326093 30014 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:00.419670 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:00.421000 24096 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:00.347759 29853 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:00.392714 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 202438us
I20260709 12:20:00.433413 24100 raft_consensus.cc:2393] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 10: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:20:00.436282 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 305360us
I20260709 12:20:00.354971 24172 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:00.351526 29858 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:00.443571 24248 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:20:00.398555 30057 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:00.446755 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 111420us
I20260709 12:20:00.461560 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:00.463353 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:00.337177 30009 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.464432 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:20:00.465085 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:00.459988 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:00.462024 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:00.490047 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:00.492988 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:00.493808 24093 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 17.
I20260709 12:20:00.348255 30045 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.391753 29938 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.512724 24813 raft_consensus.cc:2468] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 20.
W20260709 12:20:00.502624 30046 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.417s	user 0.001s	sys 0.005s
I20260709 12:20:00.470822 29850 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:00.427259 29852 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.418141 29810 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.505420 29958 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:00.516269 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 124554us
I20260709 12:20:00.536470 24140 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:00.542166 29857 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:00.541500 24814 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:00.545066 29810 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:00.546792 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:00.547276 30092 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:00.547654 24815 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:20:00.547869 30092 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:00.433889 30014 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.464249 29858 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.580114 24141 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:00.584857 24807 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:00.592094 24247 raft_consensus.cc:2368] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 17. Current term is 18.
W20260709 12:20:00.594471 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 128918us
I20260709 12:20:00.615176 29862 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.617031 24243 raft_consensus.cc:2368] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:20:00.618377 29862 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:00.657896 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 77881.2us
I20260709 12:20:00.535408 29958 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:00.553768 30059 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
W20260709 12:20:00.675144 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 51746.8us
I20260709 12:20:00.702050 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:00.549890 29852 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:00.641911 30056 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.814s	user 0.013s	sys 0.000s
I20260709 12:20:00.761874 30086 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:00.762878 30086 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:00.713164 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:00.763509 30045 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:00.763971 30086 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:00.764271 30077 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:00.764974 30077 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.765853 30093 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:00.712947 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:00.554118 30092 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:00.762292 30056 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:00.571900 29938 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:00.555251 30082 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:00.717190 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:00.761322 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:00.882750 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 369967us
I20260709 12:20:00.883677 24245 raft_consensus.cc:2410] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:20:00.768664 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:00.769861 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 66154.5us
I20260709 12:20:00.573175 29998 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:00.863541 29961 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:00.864233 29984 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:00.865347 30014 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:00.699570 29958 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:00.866797 30094 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:00.867317 30093 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:00.869005 29723 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 12:20:00.531713 29850 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:00.869519 29976 consensus_meta.cc:287] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.846s	user 0.006s	sys 0.007s
I20260709 12:20:00.870132 30071 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:00.871160 30092 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:00.705596 30066 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.575s	user 0.014s	sys 0.000s
I20260709 12:20:00.891033 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4093) took 1644 ms. Trace:
W20260709 12:20:00.895058 24781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.015s	sys 0.000s
W20260709 12:20:01.032074 24781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.015s	sys 0.000s
I20260709 12:20:00.886827 24098 raft_consensus.cc:2955] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Committing config change with OpId 11.10: config changed from index 9 to 10, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:00.936084 24171 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:00.938076 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:00.949630 24093 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:01.002995 29862 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:00.932708 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 165256us
W20260709 12:20:01.009001 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 72697.3us
I20260709 12:20:01.020344 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.031226 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:01.055711 24167 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:01.057771 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:01.058596 24807 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:01.031889 24092 rpcz_store.cc:276] 0709 12:19:59.235332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.282046 (+ 46714us) service_pool.cc:224] Handling call
0709 12:19:59.282448 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:19:59.297160 (+ 14712us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:19:59.297210 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:19:59.309481 (+ 12271us) log.cc:844] Serialized 26 byte log entry
0709 12:19:59.536429 (+226948us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:19:59.536472 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:19:59.536560 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:00.879208 (+1342648us) raft_consensus.cc:1685] finished
0709 12:20:00.879246 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:00.879506 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14462,"raft.queue_time_us":18810,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":8671,"thread_start_us":136160,"threads_started":1,"wal-append.queue_time_us":577611}
W20260709 12:20:01.083096 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.107479 24096 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:20:01.120332 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:20:01.135857 24067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.009s	sys 0.019s
I20260709 12:20:01.020809 29984 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:01.139752 24067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.009s	sys 0.019s
W20260709 12:20:01.176463 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 970707us
I20260709 12:20:01.213418 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:20:01.127130 29971 consensus_meta.cc:287] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.233s	user 0.010s	sys 0.005s
I20260709 12:20:01.058486 30071 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.256170 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:01.258648 24092 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:01.057623 30025 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.247879 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:01.289196 24812 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:01.032246 29976 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.202193 29994 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:01.061456 30092 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.308765 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:01.253104 30071 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:01.250852 29871 consensus_meta.cc:287] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.414s	user 0.013s	sys 0.006s
I20260709 12:20:01.249195 30082 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.106050 29862 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:01.330440 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.015s	sys 0.009s
I20260709 12:20:01.068508 30094 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.226810 29984 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.234866 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:01.346663 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.016s	sys 0.009s
I20260709 12:20:01.253253 29971 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.376726 30074 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.377097 30087 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.275s	user 0.000s	sys 0.001s
I20260709 12:20:01.377616 30074 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.378153 30094 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:01.378496 30098 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.379043 30080 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.350s
I20260709 12:20:01.381245 30099 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:01.380918 30098 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.381930 30099 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.383601 30091 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:01.384217 30091 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.385528 30079 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:01.386161 30079 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.386855 29999 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:01.387245 30104 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:01.387533 29999 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.389889 24093 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:01.378190 29971 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:01.407943 29999 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.408551 29858 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.410445 30098 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.411388 30088 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.413343 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:01.414244 24808 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:01.412449 30088 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.422366 30016 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.344810 29909 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:01.427323 24169 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.004s	sys 0.018s
W20260709 12:20:01.437530 24169 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.004s	sys 0.018s
I20260709 12:20:01.439888 30061 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:01.388809 30077 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.311087 29994 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.387849 30104 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:01.444242 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 266438us
W20260709 12:20:01.447748 30086 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.683s	user 0.010s	sys 0.003s
I20260709 12:20:01.423424 30016 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:01.459683 30096 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260709 12:20:01.440691 30061 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.473742 24812 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:01.349330 30025 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.448576 30056 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:01.488149 24094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.006s	sys 0.009s
W20260709 12:20:01.490211 24094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.006s	sys 0.009s
I20260709 12:20:01.442569 29909 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.466799 30103 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:01.491752 29976 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.492365 30104 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.464407 30098 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:01.484607 24814 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.000s	sys 0.017s
W20260709 12:20:01.513679 24814 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.000s	sys 0.018s
W20260709 12:20:01.499845 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:01.390959 30082 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.461694 30086 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.496239 29986 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.493059 29971 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:01.517849 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64531.4us
I20260709 12:20:01.521584 24094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37604 (request call id 3199) took 1175 ms. Trace:
I20260709 12:20:01.522933 24814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 1261) took 1046 ms. Trace:
I20260709 12:20:01.501576 29993 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.529981 30092 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.502039 29852 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:01.541043 24098 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.507s	user 0.014s	sys 0.000s
I20260709 12:20:01.533592 30103 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.550359 30061 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:01.520295 30104 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.550637 30066 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40964 (request call id 86) took 3114 ms. Trace:
I20260709 12:20:01.537599 24094 rpcz_store.cc:276] 0709 12:20:00.346608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.411005 (+ 64397us) service_pool.cc:224] Handling call
0709 12:20:00.418062 (+  7057us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.418396 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:00.921642 (+503246us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.521068 (+599426us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.521134 (+    66us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:01.521197 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.521272 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.521497 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9827,"prepare.queue_time_us":97153,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":16605,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":106,"thread_start_us":1063623,"threads_started":2}
I20260709 12:20:01.550493 30103 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:01.551537 30093 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:01.607257 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 69758.4us
I20260709 12:20:01.621115 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:01.621165 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.622092 24094 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:20:01.551946 30104 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.635898 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.636986 24175 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:20:01.538862 29976 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:01.581841 29927 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:01.624220 29853 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.152s	user 0.012s	sys 0.005s
I20260709 12:20:01.551654 29970 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:01.648984 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:01.580047 29994 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:01.619565 30095 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:01.585041 30107 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.585004 30061 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.523813 30098 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.540690 30091 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.751901 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.809247 24175 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:01.810254 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.810552 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:01.755765 30105 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:01.619524 29972 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:01.757544 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.633996 29850 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.824206 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:01.551451 29852 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.775410 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:01.825959 24246 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:01.801692 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:01.585683 29971 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.529358 29986 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.825946 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:01.706506 29723 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:01.830319 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.845497 24175 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:01.828282 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:01.802649 24141 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.196:44187 timed out after 1.564s (SENT) [suppressed 1 similar messages]
I20260709 12:20:01.843467 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:01.846560 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.846763 24242 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:01.847815 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:01.848308 24092 consensus_meta.cc:287] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.553s	user 0.014s	sys 0.000s
I20260709 12:20:01.848793 24092 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 18.
I20260709 12:20:01.552340 29993 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.709884 29853 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.852502 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:01.854068 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:01.790125 29994 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:01.856009 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.705201 29927 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.704851 29976 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.875304 24097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4100) took 1960 ms. Trace:
I20260709 12:20:01.861426 24246 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:20:01.804172 29858 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.871570 24808 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:01.792169 30116 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:01.878516 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:01.829623 30022 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:01.882774 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.883490 24170 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:20:01.884315 24244 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:01.885520 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 68302.2us
I20260709 12:20:01.885536 30109 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:01.885839 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 83242.4us
I20260709 12:20:01.893584 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:01.913215 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:01.897527 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:01.877498 24097 rpcz_store.cc:276] 0709 12:19:59.917961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.059973 (+142012us) service_pool.cc:224] Handling call
0709 12:20:00.060341 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:00.196088 (+135747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:00.196120 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:00.207383 (+ 11263us) log.cc:844] Serialized 26 byte log entry
0709 12:20:00.407233 (+199850us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:00.407300 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.860472 (+1453172us) spinlock_profiling.cc:243] Waited 70.6 ms on lock 0x7b54001f59d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:01.860542 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:01.860594 (+    52us) raft_consensus.cc:1685] finished
0709 12:20:01.860605 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.875242 (+ 14637us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64654,"raft.queue_time_us":65550,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":8538,"spinlock_wait_cycles":162473216,"thread_start_us":181497,"threads_started":1,"wal-append.queue_time_us":280636,"wal-append.run_cpu_time_us":13568,"wal-append.run_wall_time_us":1076585}
I20260709 12:20:01.812436 30061 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.925027 23994 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 309) took 3636 ms. Trace:
I20260709 12:20:01.894052 30086 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:01.789812 30095 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.856832 29972 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.925506 23994 rpcz_store.cc:276] 0709 12:19:58.281173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.281312 (+   139us) service_pool.cc:224] Handling call
0709 12:19:58.348801 (+ 67489us) spinlock_profiling.cc:243] Waited 31 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:19:58.405044 (+ 56243us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b5400270010. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02457640 00007f4c0b32e846 00007f4c0b43890e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:20:01.917134 (+3512090us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:58.914171 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:58.914837 (+   666us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:58.914877 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:19:58.914895 (+    18us) tablet.cc:662] Decoding operations
0709 12:19:58.915292 (+   397us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:58.915367 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:58.915431 (+    64us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:19:58.915635 (+   204us) tablet.cc:701] Row locks acquired
0709 12:19:58.915648 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:19:58.915815 (+   167us) write_op.cc:270] Start()
0709 12:19:58.915926 (+   111us) write_op.cc:276] Timestamp: P: 1783599598915763 usec, L: 0
0709 12:19:58.915949 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:19:58.916816 (+   867us) log.cc:844] Serialized 536 byte log entry
0709 12:19:59.091472 (+174656us) op_driver.cc:464] REPLICATION: finished
0709 12:19:59.552062 (+460590us) write_op.cc:301] APPLY: starting
0709 12:19:59.552192 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:19:59.553566 (+  1374us) tablet.cc:1370] finished BulkCheckPresence
0709 12:19:59.553708 (+   142us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:19:59.554552 (+   844us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:19:59.554776 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:19:59.554831 (+    55us) write_op.cc:312] APPLY: finished
0709 12:19:59.618935 (+ 64104us) log.cc:844] Serialized 25 byte log entry
0709 12:19:59.620264 (+  1329us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:59.777745 (+157481us) write_op.cc:454] Released schema lock
0709 12:19:59.784541 (+  6796us) write_op.cc:341] FINISH: Updating metrics
0709 12:19:59.846804 (+ 62263us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:19:59.851275 (+  4471us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10784,"reported_tablets":2,"spinlock_wait_cycles":85885952,"child_traces":[["op",{"apply.queue_time_us":424720,"apply.run_cpu_time_us":15664,"apply.run_wall_time_us":295343,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":302161,"prepare.run_cpu_time_us":3066,"prepare.run_wall_time_us":39799,"replication_time_us":175278,"thread_start_us":442142,"threads_started":2}]]}
I20260709 12:20:01.861279 29723 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:01.935912 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48191.7us
I20260709 12:20:01.894694 29945 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:01.945729 24175 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:20:01.879366 29994 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.921677 30093 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.953742 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:01.953593 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:01.940689 29938 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.015s	sys 0.020s
I20260709 12:20:01.881784 29970 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:01.957448 30113 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260709 12:20:01.957994 30115 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:01.892899 30022 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:01.946373 30108 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260709 12:20:01.914193 29858 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.794307 30107 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:01.894892 30103 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:01.938002 30081 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:01.978737 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:01.966480 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 73805.4us
I20260709 12:20:01.979548 24808 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:20:01.971692 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:20:01.961539 29938 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.015s	sys 0.021s
I20260709 12:20:01.963860 29945 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.998270 29972 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.003379 29853 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:02.003720 29976 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.005052 29945 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.005728 29927 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:01.963953 30025 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:01.976939 30110 log.cc:927] Time spent T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 12:20:02.007680 29852 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:01.580183 30066 rpcz_store.cc:276] 0709 12:19:58.398175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.398329 (+   154us) service_pool.cc:224] Handling call
0709 12:19:58.413335 (+ 15006us) log.cc:844] Serialized 501 byte log entry
0709 12:19:59.063786 (+650451us) spinlock_profiling.cc:243] Waited 22 ms on lock 0x7b540015ad18. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c055377bc 00007f4c0553a2c0 00007f4c0553a248 00007f4c0553a1c8 00007f4c0553a183 00007f4c0553944c 00007f4c0b3e62f6 00007f4c0b3e0aa8 00007f4c05122b41 00007f4c05115f2a
0709 12:20:01.512871 (+2449085us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75206,"raft.queue_time_us":593,"raft.run_cpu_time_us":1204,"raft.run_wall_time_us":1204,"spinlock_wait_cycles":50703360,"thread_start_us":159184,"threads_started":1,"wal-append.queue_time_us":345276,"wal-append.run_cpu_time_us":4941,"wal-append.run_wall_time_us":1305542}
I20260709 12:20:01.889778 30116 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.976886 30104 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:01.966394 30082 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:02.001932 30114 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:20:02.042075 30070 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:01.881768 30105 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.042727 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:02.044817 29970 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.045111 29789 raft_consensus.cc:993] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: : Instructing follower fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:20:02.046959 30022 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.000663 29971 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:01.999454 30098 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:01.969702 30093 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:02.001657 30120 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:02.053077 29852 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:02.063339 29789 raft_consensus.cc:1081] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Signalling peer fa8cfbff90bf4881a56772b05008aadb to start an election
I20260709 12:20:01.923523 30109 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.023200 29723 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.067723 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:02.009945 30103 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:02.073098 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:02.073747 24170 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
W20260709 12:20:02.067219 29958 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.037s	user 0.010s	sys 0.006s
I20260709 12:20:02.061188 30070 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:02.058157 29945 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:01.983441 30115 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.078733 30070 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:02.079516 30079 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.079391 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:02.001341 30081 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.073704 29852 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:02.080786 29958 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:02.082294 29945 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.077045 30120 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:02.090456 29994 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.162797 30064 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:02.814561 30105 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.151204 29855 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:02.815202 30064 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.815740 29855 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:02.119027 24244 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
W20260709 12:20:02.774919 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 389796us
I20260709 12:20:02.818197 30064 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.624090 30130 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:02.272601 30098 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:02.148751 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50598 (request call id 1239) took 3260 ms. Trace:
I20260709 12:20:02.092497 30123 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:02.114071 24809 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 827) took 2093 ms. Trace:
I20260709 12:20:02.820401 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 3002) took 2623 ms. Trace:
I20260709 12:20:02.820251 30123 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:02.819289 30130 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.824808 30119 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:02.623834 29927 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:02.850107 30119 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.850433 29927 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.218499 29850 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:02.852221 29850 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.852733 30119 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.215726 30095 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:02.853389 30119 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:02.238528 30071 consensus_meta.cc:287] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.850s	user 0.009s	sys 0.006s
I20260709 12:20:02.838160 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:02.854135 30119 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.854403 30071 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.854795 29850 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.225131 30133 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:02.855578 24807 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:02.887439 29850 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:02.888131 29850 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.890331 29858 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.891388 30133 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.892235 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 3296) took 1861 ms. Trace:
I20260709 12:20:02.892686 24249 rpcz_store.cc:276] 0709 12:20:01.030655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.030841 (+   186us) service_pool.cc:224] Handling call
0709 12:20:02.891321 (+1860480us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:20:02.891579 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:02.891819 (+   240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:02.891850 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:02.891895 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:02.891931 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.891991 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.892127 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2807040}
W20260709 12:20:02.897068 24172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 2999) took 2703 ms (client timeout 1631 ms). Trace:
W20260709 12:20:02.897616 24172 rpcz_store.cc:269] 0709 12:20:00.193963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.194174 (+   211us) service_pool.cc:224] Handling call
0709 12:20:02.896816 (+2702642us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b54003b10d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:02.896946 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":326273408}
I20260709 12:20:02.229342 29996 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:02.899499 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:02.900091 29996 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:02.900913 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:02.902655 24172 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:20:02.225580 30116 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:02.121378 30102 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.781s	user 0.001s	sys 0.001s
I20260709 12:20:02.856151 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:02.224896 30128 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:02.854856 30123 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:02.856573 30119 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.857123 24248 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 15: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:02.857862 30071 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.858314 30130 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.819375 24101 rpcz_store.cc:276] 0709 12:19:58.927081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.927352 (+   271us) service_pool.cc:224] Handling call
0709 12:19:59.184591 (+257239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.123074 (+938483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.148293 (+2025219us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54002661d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:02.148608 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915601792}
I20260709 12:20:02.237982 30115 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.841957 24100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4108) took 1957 ms. Trace:
I20260709 12:20:02.405357 30079 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:02.842372 29940 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:02.222975 30112 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:02.151453 30103 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.114720 29961 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:02.819350 30098 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:01.529459 24814 rpcz_store.cc:276] 0709 12:20:00.468212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.511533 (+ 43321us) service_pool.cc:224] Handling call
0709 12:20:00.530540 (+ 19007us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.530804 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:00.794095 (+263291us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.514276 (+720181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.514358 (+    82us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:01.514427 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.514524 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:01.514711 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1093,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":5786,"thread_start_us":719709,"threads_started":1,"wal-append.queue_time_us":730166}
I20260709 12:20:02.215833 29971 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:02.147825 24247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 1165) took 1696 ms (client timeout 1548 ms). Trace:
I20260709 12:20:02.927309 23998 catalog_manager.cc:5697] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:02.215948 29723 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:02.820720 24809 rpcz_store.cc:276] 0709 12:20:00.020625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.020759 (+   134us) service_pool.cc:224] Handling call
0709 12:20:00.031411 (+ 10652us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:00.031672 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:00.301716 (+270044us) log.cc:844] Serialized 14 byte log entry
0709 12:20:02.113229 (+1811513us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b1800390460. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c051234bc 00007f4c0247148b 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b23a
0709 12:20:02.113531 (+   302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:02.113602 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:02.113686 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.113782 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.113958 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":402211,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":2934,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":12992,"spinlock_wait_cycles":5474176,"thread_start_us":432867,"threads_started":2,"wal-append.queue_time_us":631618,"wal-append.run_cpu_time_us":2958,"wal-append.run_wall_time_us":1370017}
I20260709 12:20:02.461838 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:02.818339 29855 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.163266 30107 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:02.930512 30039 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:02.990376 30002 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.864347 30120 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.984416 30100 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:02.832284 24780 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.005s	sys 0.020s
I20260709 12:20:02.833739 30081 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.870709 30074 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.870851 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 3303) took 1082 ms. Trace:
W20260709 12:20:02.833163 24176 consensus_meta.cc:287] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.003s	user 0.023s	sys 0.031s
I20260709 12:20:02.150681 29988 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:02.871820 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:02.872191 30014 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:02.813998 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:02.882225 30070 consensus_meta.cc:287] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.791s	user 0.012s	sys 0.003s
I20260709 12:20:02.882444 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2017) took 1259 ms. Trace:
I20260709 12:20:02.820922 24169 rpcz_store.cc:276] 0709 12:20:00.197281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.197398 (+   117us) service_pool.cc:224] Handling call
0709 12:20:00.212476 (+ 15078us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:00.314325 (+101849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:00.314377 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:00.331883 (+ 17506us) log.cc:844] Serialized 26 byte log entry
0709 12:20:00.779479 (+447596us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:01.438179 (+658700us) log.cc:844] Serialized 14 byte log entry
0709 12:20:01.438586 (+   407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.819778 (+1381192us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b54003e99d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:02.819847 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.819900 (+    53us) raft_consensus.cc:1685] finished
0709 12:20:02.820076 (+   176us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.820274 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":560228,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":161709,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":19004,"spinlock_wait_cycles":232977792,"thread_start_us":962834,"threads_started":2,"wal-append.queue_time_us":640042,"wal-append.run_cpu_time_us":4588,"wal-append.run_wall_time_us":1566275}
I20260709 12:20:02.858278 29958 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:02.885249 30118 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 1.109s	user 0.017s	sys 0.003s
I20260709 12:20:02.920446 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:02.932232 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:02.915037 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:02.975636 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:02.939675 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:02.978719 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:02.972656 24100 rpcz_store.cc:276] 0709 12:20:00.884630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.884857 (+   227us) service_pool.cc:224] Handling call
0709 12:20:01.019919 (+135062us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.379117 (+359198us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.379153 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.379200 (+    47us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:01.379237 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.841600 (+1462363us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b54001f45d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:02.841676 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.841874 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":825382144}
I20260709 12:20:02.951457 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:02.931850 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:02.922715 24807 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 18.
I20260709 12:20:02.902702 29996 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:02.993568 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 108799us
I20260709 12:20:02.930421 30009 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:02.925313 30035 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:02.863322 29927 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.864550 29852 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:03.469244 24249 raft_consensus.cc:2368] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:20:03.516188 24098 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:03.497231 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:03.517182 24176 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:03.465993 24250 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 5.
I20260709 12:20:03.520223 24092 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
W20260709 12:20:02.995493 24247 rpcz_store.cc:269] 0709 12:20:00.451406 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.451560 (+   154us) service_pool.cc:224] Handling call
0709 12:20:02.147342 (+1695782us) spinlock_profiling.cc:243] Waited 76.2 ms on lock 0x7b540008d9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:02.147617 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":175326080}
I20260709 12:20:03.467069 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:20:03.523671 24814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 838) took 1652 ms (client timeout 2166 ms). Trace:
W20260709 12:20:03.524184 24814 rpcz_store.cc:269] 0709 12:20:01.871377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.466605 (+1595228us) service_pool.cc:224] Handling call
0709 12:20:03.523589 (+ 56984us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.516901 24174 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:03.070148 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:03.526392 24174 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 3019) took 1321 ms (client timeout 1649 ms). Trace:
W20260709 12:20:03.526907 24174 rpcz_store.cc:269] 0709 12:20:02.204915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.831359 (+626444us) service_pool.cc:224] Handling call
0709 12:20:03.526319 (+694960us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.517920 24243 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 17.
I20260709 12:20:03.516348 24242 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:03.518911 24168 rpcz_store.cc:276] 0709 12:20:01.622911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.623092 (+   181us) service_pool.cc:224] Handling call
0709 12:20:01.623419 (+   327us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.891255 (+267836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.891290 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.891334 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:01.891368 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:02.874973 (+983605us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54002ae9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:02.882198 (+  7225us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:02.882345 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":615403904}
I20260709 12:20:03.518045 24244 rpcz_store.cc:276] 0709 12:20:01.787991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.825678 (+ 37687us) service_pool.cc:224] Handling call
0709 12:20:02.869061 (+1043383us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b5400059e54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:02.870773 (+  1712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121843968}
I20260709 12:20:02.986474 29850 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:03.540853 24808 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 847) took 1444 ms (client timeout 1726 ms). Trace:
W20260709 12:20:03.546429 24809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 846) took 1468 ms (client timeout 1774 ms). Trace:
I20260709 12:20:03.541762 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:03.547047 24809 rpcz_store.cc:269] 0709 12:20:02.060482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.038043 (+977561us) service_pool.cc:224] Handling call
0709 12:20:03.526621 (+488578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.541422 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:03.541023 24176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 3008) took 1754 ms (client timeout 1615 ms). Trace:
I20260709 12:20:03.517598 24094 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
W20260709 12:20:03.549988 24176 rpcz_store.cc:269] 0709 12:20:01.763557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.763764 (+   207us) service_pool.cc:224] Handling call
0709 12:20:03.517909 (+1754145us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.566614 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:03.340158 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 354743us
W20260709 12:20:03.546833 24808 rpcz_store.cc:269] 0709 12:20:02.075388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.076583 (+  1195us) service_pool.cc:224] Handling call
0709 12:20:03.520139 (+1443556us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.937482 23995 catalog_manager.cc:5697] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: config changed from index 6 to 7, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 9 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:03.567551 24247 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:20:03.539526 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:02.989073 29940 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:03.575160 29940 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:03.575343 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.576215 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.576305 30039 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:03.577180 24243 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:03.523716 29855 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:03.579692 30039 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:03.579551 29855 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:03.580267 30098 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:03.576239 24249 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:20:03.581410 24249 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6831162b73f4c16a41519abb392404b"
dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:40978
I20260709 12:20:03.582878 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:03.583103 30081 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:03.583847 24814 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 840) took 1704 ms (client timeout 2203 ms). Trace:
I20260709 12:20:03.583789 30081 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:03.584384 24814 rpcz_store.cc:269] 0709 12:20:01.879575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.567858 (+1688283us) service_pool.cc:224] Handling call
0709 12:20:03.583770 (+ 15912us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.586057 24814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 843) took 1658 ms. Trace:
I20260709 12:20:03.586202 30081 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:03.587133 29855 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:03.569684 30100 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:03.589058 24815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 1271) took 1632 ms. Trace:
I20260709 12:20:03.586818 24173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 3016) took 1532 ms. Trace:
I20260709 12:20:02.907171 29984 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:03.591117 24249 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:03.586444 24814 rpcz_store.cc:276] 0709 12:20:01.927563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.585152 (+1657589us) service_pool.cc:224] Handling call
0709 12:20:03.585510 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.585728 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.585755 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.585799 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:03.585838 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.585895 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.585994 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:02.903060 29858 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:02.917744 30133 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:02.983727 30130 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:03.590282 24173 rpcz_store.cc:276] 0709 12:20:02.054321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.929391 (+875070us) service_pool.cc:224] Handling call
0709 12:20:02.929888 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.584298 (+654410us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.584334 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.584378 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:03.584416 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.586579 (+  2163us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b540015c554. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:03.586627 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.586751 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1504401280}
I20260709 12:20:03.591801 24249 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:03.589488 24815 rpcz_store.cc:276] 0709 12:20:01.957204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.588078 (+1630874us) service_pool.cc:224] Handling call
0709 12:20:03.588470 (+   392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.588701 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.588731 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.588777 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:03.588826 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.588888 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.588990 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.662470 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:03.667971 24809 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
W20260709 12:20:03.668788 24809 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 844) took 1700 ms (client timeout 2232 ms). Trace:
W20260709 12:20:03.669358 24809 rpcz_store.cc:269] 0709 12:20:01.968072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.567915 (+1599843us) service_pool.cc:224] Handling call
0709 12:20:03.668697 (+100782us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.005405 30071 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.593s
I20260709 12:20:02.986768 30079 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:03.596239 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.683522 24242 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:20:03.677253 24808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 1273) took 1593 ms. Trace:
I20260709 12:20:03.698159 24808 rpcz_store.cc:276] 0709 12:20:02.083780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.592120 (+1508340us) service_pool.cc:224] Handling call
0709 12:20:03.676610 (+ 84490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:03.676842 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:03.676869 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:03.676914 (+    45us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:03.676947 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.677010 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.677166 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:03.055501 29723 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:03.345784 29971 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:03.723610 24810 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 1257) took 3266 ms. Trace:
I20260709 12:20:03.724097 24810 rpcz_store.cc:276] 0709 12:20:00.457596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.491027 (+ 33431us) service_pool.cc:224] Handling call
0709 12:20:00.509058 (+ 18031us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:00.516689 (+  7631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:00.516726 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:01.404246 (+887520us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b18002ac580. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a
0709 12:20:01.404705 (+   459us) spinlock_profiling.cc:243] Waited 4.71 ms on lock 0x7b2c000471f8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2
0709 12:20:01.405339 (+   634us) log.cc:844] Serialized 26 byte log entry
0709 12:20:01.517346 (+112007us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:01.517384 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:01.517453 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:02.884524 (+1367071us) spinlock_profiling.cc:243] Waited 4.77 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:20:03.723310 (+838786us) raft_consensus.cc:1685] finished
0709 12:20:03.723337 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:03.723503 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7136,"raft.queue_time_us":9799,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":15087,"spinlock_wait_cycles":29848576,"thread_start_us":111598,"threads_started":1,"wal-append.queue_time_us":211375}
I20260709 12:20:03.676031 30130 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:03.540686 30014 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:03.540441 29988 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:03.748039 24780 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.639s	user 0.006s	sys 0.031s
W20260709 12:20:03.748670 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 1.63983e+06us
I20260709 12:20:03.539203 30035 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:03.539683 30070 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:03.746920 24170 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:20:02.999351 29961 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:03.714354 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 83617.2us
I20260709 12:20:03.541165 30138 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:03.670905 29858 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:03.801499 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:03.823553 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.825395 24812 raft_consensus.cc:2368] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11.
I20260709 12:20:03.836989 24244 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:20:03.846462 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.847287 24243 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:20:03.849756 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:03.853546 24778 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.034s	sys 0.027s
W20260709 12:20:03.854061 24778 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.855s	user 0.035s	sys 0.027s
W20260709 12:20:03.854264 24141 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.019s	sys 0.073s
W20260709 12:20:03.854630 24141 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.019s	sys 0.073s
W20260709 12:20:03.854923 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 871727us
I20260709 12:20:03.801198 30100 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:03.037683 30112 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:03.000465 30128 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:03.859548 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 58146.5us
I20260709 12:20:03.859862 30147 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:03.859951 24175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 3219) took 2019 ms (client timeout 1755 ms). Trace:
I20260709 12:20:03.654747 30028 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:03.868113 24249 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:03.869716 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:03.873085 24175 rpcz_store.cc:269] 0709 12:20:01.840199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.847517 (+  7318us) service_pool.cc:224] Handling call
0709 12:20:03.859733 (+2012216us) spinlock_profiling.cc:243] Waited 97.2 ms on lock 0x7b54003e94d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:03.859866 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223509888}
I20260709 12:20:03.879639 24243 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:20:03.877473 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:03.881522 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:03.882012 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.882563 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:03.882292 24175 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:20:03.880309 24808 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:03.886574 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:03.882707 24242 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 17.
I20260709 12:20:03.888835 30028 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:03.890197 29723 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:03.890467 30079 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:03.942704 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:03.897400 24249 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:03.898083 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:03.899071 30147 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:03.900280 29858 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:03.833895 30138 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:03.960937 30138 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:03.856462 29850 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:03.961601 29850 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:03.962026 29850 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:03.963876 29988 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:03.964735 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:03.965022 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5bc5bc9605e64854a78054b02b3da6dd with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:20:03.903389 30112 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:03.905416 30128 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:03.907047 30130 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:03.966176 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:03.875763 29962 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:03.970283 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:03.919919 30099 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:03.922474 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2012) took 3667 ms. Trace:
I20260709 12:20:03.925654 29909 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:03.926108 30098 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:03.911183 29927 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:03.927161 24807 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 1265) took 2787 ms (client timeout 3312 ms). Trace:
I20260709 12:20:03.929908 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.983086 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.984198 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:03.932320 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:03.933425 24812 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 848) took 1825 ms (client timeout 1564 ms). Trace:
I20260709 12:20:03.985924 24246 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 15: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:03.934523 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.937179 29961 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:03.955991 29855 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:03.946543 24810 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
W20260709 12:20:03.946882 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 60495.7us
I20260709 12:20:03.907480 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:03.953640 24140 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:03.971154 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:40978 (request call id 3313) took 1013 ms. Trace:
I20260709 12:20:03.994935 24249 rpcz_store.cc:276] 0709 12:20:02.933183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.581253 (+648070us) service_pool.cc:224] Handling call
0709 12:20:03.946175 (+364922us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":245}
I20260709 12:20:03.975847 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:03.887214 30120 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:03.978066 24171 rpcz_store.cc:276] 0709 12:20:00.254716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.433327 (+178611us) service_pool.cc:224] Handling call
0709 12:20:00.490104 (+ 56777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.034976 (+544872us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.922104 (+2887128us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b540019b754. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:03.922374 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024779136}
I20260709 12:20:03.979692 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:03.984320 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.021294 24244 raft_consensus.cc:2368] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 17. Current term is 18.
I20260709 12:20:03.931459 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.022161 24243 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:03.985237 24098 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:03.986855 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:03.987893 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:03.982156 24807 rpcz_store.cc:269] 0709 12:20:01.140861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.212917 (+ 72056us) service_pool.cc:224] Handling call
0709 12:20:03.926887 (+2713970us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54004d62d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:03.927063 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3715785088}
I20260709 12:20:04.026715 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.026952 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:03.985751 24812 rpcz_store.cc:269] 0709 12:20:02.108355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.461395 (+353040us) service_pool.cc:224] Handling call
0709 12:20:03.933089 (+1471694us) spinlock_profiling.cc:243] Waited 828 ms on lock 0x7b54005e0e54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:03.933279 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1904072576}
I20260709 12:20:03.874545 30116 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:03.995889 24099 raft_consensus.cc:1813] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Handling vote request from an unknown peer 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:04.006793 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.016604 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.024442 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:04.031407 24808 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:04.031366 24092 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
W20260709 12:20:04.016949 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 63418.5us
I20260709 12:20:04.031355 24099 raft_consensus.cc:2410] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:20:04.032245 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.032692 24140 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:04.027840 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:04.034006 30079 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:04.034444 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:04.034157 30120 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.034500 30079 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.035187 30079 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.035305 24250 raft_consensus.cc:2393] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 15: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:04.036417 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.036701 30120 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:04.036916 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.037509 29961 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:04.039651 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.040361 30028 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.040930 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.042191 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.023167 29927 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.043643 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:04.044595 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:04.044806 29940 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:04.045413 24814 raft_consensus.cc:2368] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:20:04.045584 29927 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.044596 30139 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:04.022955 30099 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:04.046262 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.046960 24814 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 6.
I20260709 12:20:04.042306 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.047725 24812 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:04.048616 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.049700 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.050038 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2019) took 2415 ms. Trace:
I20260709 12:20:04.037575 24810 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:20:04.050899 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.052011 30143 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:04.048696 30016 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.050405 24167 rpcz_store.cc:276] 0709 12:20:01.634611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.645968 (+ 11357us) service_pool.cc:224] Handling call
0709 12:20:01.646521 (+   553us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:01.913837 (+267316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:01.913876 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:01.913925 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:01.913956 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.049771 (+2135815us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54003b1d54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:04.049823 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.049958 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":614118272}
I20260709 12:20:04.052841 30143 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:04.051923 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:04.043200 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.053850 30120 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:04.054687 30120 raft_consensus.cc:697] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:04.057649 24214 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.058239 30112 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:04.058813 30112 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.059396 30128 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:04.061153 30079 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.062520 29723 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:04.063211 29723 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.063628 29971 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:04.064944 30079 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.065407 30147 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.061190 30112 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:04.065412 29723 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.066975 30128 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:04.055655 30120 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.068150 30128 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.033444 24780 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:04.073421 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.071717 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:04.074194 24812 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
W20260709 12:20:04.078621 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 45273.3us
I20260709 12:20:03.990602 30062 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
W20260709 12:20:04.080193 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55839.5us
I20260709 12:20:03.980222 30074 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:04.055212 24807 raft_consensus.cc:2955] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Committing config change with OpId 17.14: config changed from index 11 to 14, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:04.079811 24780 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:04.081110 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48548.6us
I20260709 12:20:04.107877 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:04.051956 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.108902 24810 raft_consensus.cc:2393] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:04.052230 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.092250 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.093961 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.100412 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.110050 24098 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:04.110356 24814 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
W20260709 12:20:04.101094 24248 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 3295) took 3000 ms (client timeout 1675 ms). Trace:
I20260709 12:20:04.112358 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:04.103758 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:04.114467 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:04.115350 24097 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.111851 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:03.993117 29855 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:04.124902 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.125927 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.120478 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.126792 24093 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
W20260709 12:20:04.110918 24248 rpcz_store.cc:269] 0709 12:20:01.030206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.030855 (+   649us) service_pool.cc:224] Handling call
0709 12:20:04.030267 (+2999412us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54003ab954. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:04.030411 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4142494464}
I20260709 12:20:04.128703 24141 leader_election.cc:400] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:20:04.129140 24141 leader_election.cc:403] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:04.114346 24067 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:04.134091 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.134150 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:04.135411 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.135967 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.127976 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.137802 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:04.139205 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.139883 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.066835 30070 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:04.140818 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.140964 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.141690 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.142666 24249 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 15: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:04.143565 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.175595 24095 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:20:04.176574 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.146129 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.111097 30099 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:04.146903 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.188277 24173 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:04.147672 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:04.104622 29962 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:04.190913 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.104049 30074 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:04.119886 30016 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:04.141593 30132 consensus_queue.cc:1059] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:20:04.155893 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:04.200296 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 62591.4us
I20260709 12:20:04.143788 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:04.072145 30088 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:04.163743 24097 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
W20260709 12:20:04.201172 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57468.2us
I20260709 12:20:04.201722 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.202487 24097 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:20:04.203794 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.204671 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.205300 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.205435 24092 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:04.206017 24097 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:20:04.142241 30077 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:04.205417 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.208263 30099 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:04.208644 30099 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:04.208690 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:04.209064 30099 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:04.209606 24100 raft_consensus.cc:2376] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14. Re-sending same reply.
I20260709 12:20:04.212258 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.167299 30014 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:04.168004 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.215267 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.216868 30107 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:04.217487 30107 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.217938 30107 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.168854 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.126365 29984 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:04.220108 29984 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:04.220661 29984 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:04.220330 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:04.222703 29927 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:04.223266 29927 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:04.224206 29927 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.099726 29723 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.111593 30079 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:04.227222 30079 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:04.227699 30079 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:03.992059 30098 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.232959 30098 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:04.186472 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.233786 24248 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:04.189702 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.149766 30057 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:20:04.235407 30057 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:04.235957 30057 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:04.119586 29858 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:04.150483 29986 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:04.195852 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.241339 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:04.242358 24241 raft_consensus.cc:2368] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:20:04.196709 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.243436 24173 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:20:04.138392 29855 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:04.197552 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.234855 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.158452 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:04.138185 30139 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:04.248394 24098 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.248466 30139 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.250976 30139 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:04.206673 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.169561 29940 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.111439 29961 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:03.927949 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:04.437196 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.439303 24168 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:20:04.255859 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.321166 23998 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 9 to 10, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 10 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:04.436743 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.376731 30093 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:04.289783 30035 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:04.330034 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.403318 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:04.322278 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:04.445227 24172 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:04.388873 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 280) took 5818 ms. Trace:
I20260709 12:20:04.258900 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.320709 23995 catalog_manager.cc:5697] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 17 to 18, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 18 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:04.348363 29945 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.449193 23995 catalog_manager.cc:5697] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 19 to 20, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 20 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:04.351212 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.453023 24101 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:04.391213 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.356665 29993 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.260004 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.372357 30143 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.458120 29940 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:20:04.327688 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.394932 30109 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.461874 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.332576 30061 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.468148 24244 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:20:04.459275 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.445255 24094 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:04.265098 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44883.1us
I20260709 12:20:04.479799 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.512682 30132 raft_consensus.cc:3055] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:04.474216 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.473268 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:04.482590 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.483755 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.516248 24097 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:20:04.517252 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.517890 24097 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:20:04.518798 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.520673 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.522123 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.483862 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.484658 24176 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:04.258299 29723 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:04.527006 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.529009 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:20:04.486951 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 362962us
W20260709 12:20:04.320662 24214 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.500s (SENT)
W20260709 12:20:04.545676 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 225055us
I20260709 12:20:04.266031 30099 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.459033 30143 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:04.476976 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:04.495532 24813 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33926 (request call id 922) took 4033 ms (client timeout 1743 ms). Trace:
I20260709 12:20:04.500351 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.191378 29962 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:04.522929 29850 consensus_meta.cc:287] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.560s	user 0.010s	sys 0.000s
I20260709 12:20:04.126633 30116 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.198128 30074 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:04.503607 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.578435 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.505401 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:04.507280 30077 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:04.523269 29988 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:04.511386 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.264308 30079 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.485896 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.530186 24094 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:20:04.531750 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.451184 23995 catalog_manager.cc:5697] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 11 to 12, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:04.446528 23996 rpcz_store.cc:276] 0709 12:19:58.570288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:58.575112 (+  4824us) service_pool.cc:224] Handling call
0709 12:20:04.388688 (+5813576us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:19:58.917350 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:19:58.917915 (+   565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:19:58.917949 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:19:58.917966 (+    17us) tablet.cc:662] Decoding operations
0709 12:19:58.918534 (+   568us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:19:58.918583 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 12:19:58.918608 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:19:58.918931 (+   323us) tablet.cc:701] Row locks acquired
0709 12:19:58.918948 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:19:58.947152 (+ 28204us) write_op.cc:270] Start()
0709 12:19:58.991733 (+ 44581us) write_op.cc:276] Timestamp: P: 1783599598931779 usec, L: 0
0709 12:19:58.994311 (+  2578us) op_driver.cc:348] REPLICATION: starting
0709 12:19:59.079813 (+ 85502us) log.cc:844] Serialized 1312 byte log entry
0709 12:19:59.488940 (+409127us) op_driver.cc:464] REPLICATION: finished
0709 12:19:59.910745 (+421805us) write_op.cc:301] APPLY: starting
0709 12:20:00.091321 (+180576us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:00.094853 (+  3532us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:00.095036 (+   183us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:00.097498 (+  2462us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:00.097782 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:20:00.097854 (+    72us) write_op.cc:312] APPLY: finished
0709 12:20:00.098184 (+   330us) log.cc:844] Serialized 41 byte log entry
0709 12:20:00.098433 (+   249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:00.098562 (+   129us) write_op.cc:454] Released schema lock
0709 12:20:00.098604 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:00.179897 (+ 81293us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:00.191450 (+ 11553us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1819888,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":409664,"apply.run_cpu_time_us":13526,"apply.run_wall_time_us":193767,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":135454,"prepare.run_cpu_time_us":4095,"prepare.run_wall_time_us":171257,"replication_time_us":494412,"thread_start_us":359285,"threads_started":1}]]}
I20260709 12:20:04.551148 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:04.556600 24813 rpcz_store.cc:269] 0709 12:20:00.462339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.462999 (+   660us) service_pool.cc:224] Handling call
0709 12:20:04.495279 (+4032280us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b54005d7fd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:04.495432 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111677312}
I20260709 12:20:04.198807 30016 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:04.554388 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.564738 30057 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.565537 29962 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:04.566921 29945 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:04.535549 29861 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.040s	sys 0.094s
I20260709 12:20:04.625401 30116 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:04.625792 24779 connection.cc:256] RPC call timeout handler was delayed by -1.9334276649999538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.196s for a response
W20260709 12:20:04.626279 24779 connection.cc:256] RPC call timeout handler was delayed by -1.9172276649999276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1978s for a response
I20260709 12:20:04.614182 29927 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:04.627195 29927 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:04.627586 29927 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:04.627933 24779 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:04.628338 30080 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.628994 30080 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.575634 24172 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:20:04.488060 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.632771 24249 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 14: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:04.563480 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:04.601832 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47689.8us
W20260709 12:20:04.585577 24170 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59356 (request call id 3018) took 2458 ms (client timeout 2043 ms). Trace:
I20260709 12:20:04.633881 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:04.553265 29940 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:04.586383 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.643610 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.642298 24247 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
W20260709 12:20:04.644620 24247 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 3322) took 1664 ms (client timeout 2190 ms). Trace:
W20260709 12:20:04.645164 24247 rpcz_store.cc:269] 0709 12:20:02.980426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:03.570755 (+590329us) service_pool.cc:224] Handling call
0709 12:20:04.586178 (+1015423us) spinlock_profiling.cc:243] Waited 1.22 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:20:04.644536 (+ 58358us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2812672}
I20260709 12:20:04.607713 24098 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:04.513249 30132 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:04.610744 24214 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.609870 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.650709 24174 raft_consensus.cc:1240] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 5. Current term is 6. Ops: []
I20260709 12:20:04.611773 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.612519 24169 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 13: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:04.585322 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.652416 24176 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:20:04.614931 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.623730 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.653448 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.653865 24094 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:04.654121 24176 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:04.654608 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.654827 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.655033 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.624920 30058 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:04.661402 30058 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.663762 30058 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:04.667604 30080 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:04.669994 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.609845 30016 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:04.584182 29988 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:04.633567 24170 rpcz_store.cc:269] 0709 12:20:02.127492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:02.855833 (+728341us) service_pool.cc:224] Handling call
0709 12:20:04.585342 (+1729509us) spinlock_profiling.cc:243] Waited 761 ms on lock 0x7b540037ad54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:04.585491 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1751391616}
I20260709 12:20:04.672727 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.673357 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.673482 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:04.674288 24170 raft_consensus.cc:3055] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:04.674750 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.675381 24806 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 1268) took 3263 ms. Trace:
I20260709 12:20:04.676282 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.638551 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:04.636740 30120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.011s	sys 0.035s
I20260709 12:20:04.704928 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.706517 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.707515 24813 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:04.708680 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:04.709414 24813 raft_consensus.cc:2376] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14. Re-sending same reply.
I20260709 12:20:04.710548 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.631323 30014 consensus_queue.cc:1059] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:20:04.642743 29940 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:04.656275 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.651530 24175 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:20:04.768114 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.769516 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.770336 24780 leader_election.cc:400] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 17. Current term is 18.
I20260709 12:20:04.697085 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.675896 24806 rpcz_store.cc:276] 0709 12:20:01.412056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:01.412922 (+   866us) service_pool.cc:224] Handling call
0709 12:20:02.882218 (+1469296us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b5800003c98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a554fc0 00007f4c0a53f929 00007f4c0a53f3d2 00007f4c03ab6bd4
0709 12:20:02.882479 (+   261us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:02.882968 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:02.883021 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:02.883710 (+   689us) log.cc:844] Serialized 26 byte log entry
0709 12:20:03.346906 (+463196us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:03.346959 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:03.347094 (+   135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:04.661661 (+1314567us) spinlock_profiling.cc:243] Waited 83.2 ms on lock 0x7b2400313f58. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023149c4 00007f4c02312acb 00007f4c024cddc9 00007f4c024cda55 00007f4c024ccfb0 00007f4c05143488 00007f4c05143be8 00007f4c0511b398 00007f4c0511676a 00007f4c05115bb6
0709 12:20:04.675075 (+ 13414us) raft_consensus.cc:1685] finished
0709 12:20:04.675111 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:04.675295 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84320,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":9616,"spinlock_wait_cycles":194836736,"thread_start_us":462680,"threads_started":1,"wal-append.queue_time_us":681836}
I20260709 12:20:04.674718 24170 raft_consensus.cc:740] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:04.704881 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 94238.2us
W20260709 12:20:04.705184 24807 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.032s	sys 0.030s
I20260709 12:20:04.714605 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.715067 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:04.714522 24096 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.006s	sys 0.027s
I20260709 12:20:04.717849 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.774231 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.771798 24170 consensus_queue.cc:260] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.774583 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.625403 29945 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:04.714452 30120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.011s	sys 0.036s
I20260709 12:20:04.718245 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.781677 24169 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:20:04.636782 30105 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:04.581881 29850 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.720333 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:04.694185 30133 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.013s	sys 0.014s
I20260709 12:20:04.723340 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.657109 30077 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.640690 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.793597 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.655309 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.764273 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:04.794198 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 153602us
I20260709 12:20:04.649883 30093 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:04.766232 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.770249 24175 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:04.660660 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:04.771595 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:04.795204 24168 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:04.771595 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.795464 24092 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:04.795737 24216 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.775463 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:04.772382 24807 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.032s	sys 0.030s
I20260709 12:20:04.773265 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.797174 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:04.776165 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.799232 24167 raft_consensus.cc:2393] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 14: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:04.775249 24170 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:04.773589 24096 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.007s	sys 0.027s
I20260709 12:20:04.764845 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:04.778170 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.773378 24780 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:04.694975 29988 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:04.779526 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.803022 24815 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:04.773627 24214 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.719403 30035 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:04.794377 24171 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:20:04.717940 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:04.809101 24093 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:20:04.795547 24095 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:04.775310 24814 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:04.811074 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.781003 29945 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:04.812866 24214 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.798146 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.778568 29940 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:04.818193 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.814450 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:04.796244 30133 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.014s	sys 0.014s
W20260709 12:20:04.809861 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 45153us
W20260709 12:20:04.817561 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44250.7us
I20260709 12:20:04.818903 24814 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:20:04.819952 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:04.824285 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.825026 24249 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:04.823410 24140 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:04.827945 24214 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.828600 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.829304 24214 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:04.833405 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.835412 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:04.799532 30062 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:04.812528 30109 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:04.843796 24140 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:04.820976 30120 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:04.846673 30128 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:04.860417 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
W20260709 12:20:04.834627 29855 consensus_meta.cc:287] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.588s	user 0.013s	sys 0.000s
I20260709 12:20:04.821341 29909 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:04.850347 24092 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:04.825250 30045 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:04.790843 30105 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.824309 29961 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:04.821862 30035 raft_consensus.cc:697] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:04.838661 30136 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:04.856541 30109 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:04.855664 30093 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:04.853987 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:04.860059 30120 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:04.864856 30061 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:04.866915 29909 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:04.869796 30045 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:04.872813 30128 raft_consensus.cc:697] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:04.899416 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 244655us
W20260709 12:20:04.881701 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 233872us
I20260709 12:20:04.917415 24141 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.883294 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:04.885852 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:04.880626 24780 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.923782 24809 raft_consensus.cc:2410] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:04.867209 29855 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.925951 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:04.890858 30107 consensus_meta.cc:287] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.672s	user 0.012s	sys 0.003s
W20260709 12:20:04.920547 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 283168us
I20260709 12:20:04.894345 29909 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:04.986759 24781 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:04.896343 30079 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:04.884917 30109 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:04.900519 30045 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:04.931695 30128 consensus_queue.cc:237] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.882175 30139 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:04.929121 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.886190 29993 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:04.927356 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:05.015604 24095 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
W20260709 12:20:05.016745 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 89859.6us
W20260709 12:20:04.922760 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 52059us
I20260709 12:20:04.929538 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:04.883205 30093 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:04.902906 30057 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.881767 30136 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:04.889423 30099 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:05.001786 29984 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.781s	user 0.012s	sys 0.001s
I20260709 12:20:05.008438 30035 consensus_queue.cc:237] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:04.997473 30107 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.007177 30080 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:04.997649 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:05.026002 30133 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:05.049628 29961 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:05.049790 30133 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:05.050355 30133 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.050385 29961 raft_consensus.cc:697] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:05.051302 24243 raft_consensus.cc:2368] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14.
I20260709 12:20:05.052744 24175 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:05.052822 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 60944.8us
I20260709 12:20:05.051574 29961 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:04.919489 29862 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:04.926910 29861 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:05.029282 29962 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.012773 24099 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:05.058393 29962 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:05.059196 24812 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:05.059643 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4115) took 1002 ms. Trace:
I20260709 12:20:05.060068 24099 rpcz_store.cc:276] 0709 12:20:04.057431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.090097 (+ 32666us) service_pool.cc:224] Handling call
0709 12:20:04.090602 (+   505us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.058479 (+967877us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.059388 (+   909us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b540028b754. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:05.059576 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2120171904}
I20260709 12:20:05.031579 29850 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:05.013447 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 84410.5us
I20260709 12:20:05.063638 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:05.017901 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:05.064715 29861 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.066069 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:04.927349 30091 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:05.067412 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:05.068540 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:05.032940 24169 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:05.069205 24248 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:05.069376 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:05.070365 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:04.963904 30070 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:04.889703 30120 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.085680 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:05.086477 24169 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 16.
W20260709 12:20:05.017982 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 88554.7us
I20260709 12:20:05.018566 29723 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:05.020488 24214 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:04.933820 30015 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:05.037135 24097 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:05.080009 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:05.101936 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:05.130273 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:05.039361 30164 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260709 12:20:05.084081 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:05.012180 30139 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:05.088127 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:05.043167 24811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 1259) took 4576 ms. Trace:
W20260709 12:20:05.033833 30155 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260709 12:20:05.039944 30163 log.cc:927] Time spent T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:20:05.092782 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:05.080487 24099 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:05.133864 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:05.188367 24167 raft_consensus.cc:2368] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14.
I20260709 12:20:05.188690 24250 raft_consensus.cc:2393] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 14: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:05.066917 30091 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:05.088618 29993 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:05.128310 30074 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.528s	user 0.012s	sys 0.001s
I20260709 12:20:05.032161 30093 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:05.128916 30015 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:05.158258 29940 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.032579 29855 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:05.128238 29862 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:05.032856 30136 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:05.172859 24243 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59766 (request call id 1187) took 1212 ms. Trace:
W20260709 12:20:05.177801 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 89789.8us
W20260709 12:20:05.177836 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 75997.8us
I20260709 12:20:05.174185 24170 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:20:05.040541 30105 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:05.022704 30079 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:05.133719 30088 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:05.079943 30070 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:05.130299 29927 consensus_meta.cc:287] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.502s	user 0.007s	sys 0.006s
I20260709 12:20:05.087282 29723 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:05.249464 29723 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.047847 30080 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:05.049059 30107 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:05.177664 24811 rpcz_store.cc:276] 0709 12:20:00.467478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:00.468052 (+   574us) service_pool.cc:224] Handling call
0709 12:20:04.497889 (+4029837us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.571654 (+ 73765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.571700 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.577447 (+  5747us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.879266 (+301819us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:04.879313 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.879389 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.041845 (+162456us) raft_consensus.cc:1685] finished
0709 12:20:05.041868 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.042830 (+   962us) spinlock_profiling.cc:243] Waited 4.03 s on lock 0x7b54005d7fd0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:05.043063 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73124,"raft.queue_time_us":87471,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":32558,"spinlock_wait_cycles":9266906880,"thread_start_us":220341,"threads_started":1,"wal-append.queue_time_us":407843}
I20260709 12:20:05.159029 29995 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:05.184463 30139 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:05.186482 30095 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:05.033488 29984 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.202448 30091 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:05.217943 29945 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.232331 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:05.293149 24247 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.224308 24243 rpcz_store.cc:276] 0709 12:20:03.960312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.444061 (+483749us) service_pool.cc:224] Handling call
0709 12:20:04.483708 (+ 39647us) spinlock_profiling.cc:243] Waited 38.9 ms on lock 0x7b58000f3f98. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5930ab 00007f4c0a593131 00007f4c0a5410a0 00007f4c0a540984 00007f4c03abb6d4 00007f4c03abb662
0709 12:20:05.172614 (+688906us) spinlock_profiling.cc:243] Waited 527 ms on lock 0x7b54003589d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:05.172779 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1301392128}
I20260709 12:20:05.165138 29988 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.243764 24241 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:20:05.246495 24096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4128) took 1089 ms. Trace:
I20260709 12:20:05.218236 30015 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:05.249454 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 323555us
I20260709 12:20:05.255609 30070 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:05.256664 29995 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:05.330051 29995 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:05.255959 29927 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.335889 29927 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:05.260987 30105 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:05.339465 30105 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:05.339723 29988 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:05.340094 30105 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.342036 24176 raft_consensus.cc:2393] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 16: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:05.265180 30132 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.231356 29993 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:05.344203 29993 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:05.344581 30132 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:05.345364 29993 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.235648 30079 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:05.347127 24173 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 15: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:05.347332 30079 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:05.255962 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 238147us
I20260709 12:20:05.349244 24066 leader_election.cc:400] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:20:05.349552 24066 leader_election.cc:403] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:05.350310 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:05.215924 30074 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.352753 30074 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:05.284072 30095 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:05.353493 30095 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:05.247349 29855 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:05.223539 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 332164us
I20260709 12:20:05.291467 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:20:05.356873 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 65524.3us
I20260709 12:20:05.358346 24781 leader_election.cc:400] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14.
I20260709 12:20:05.358633 24781 leader_election.cc:403] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:05.257563 30080 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:05.359557 29984 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:05.266607 30109 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.361433 29855 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:20:05.361984 30109 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:05.362176 30009 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:05.363488 29962 consensus_queue.cc:1059] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:05.365178 30143 raft_consensus.cc:3055] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:20:05.365549 30143 raft_consensus.cc:740] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:05.366483 30143 consensus_queue.cc:260] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.368067 24171 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:05.368784 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:05.369674 24168 raft_consensus.cc:2393] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:05.303606 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:05.362272 29855 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:05.300904 24096 rpcz_store.cc:276] 0709 12:20:04.156862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.157046 (+   184us) service_pool.cc:224] Handling call
0709 12:20:04.157457 (+   411us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:04.173025 (+ 15568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:04.173065 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:04.192385 (+ 19320us) log.cc:844] Serialized 26 byte log entry
0709 12:20:04.800483 (+608098us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:04.800546 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:04.800657 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:05.246143 (+445486us) raft_consensus.cc:1685] finished
0709 12:20:05.246176 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.246390 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":310369,"raft.queue_time_us":15774,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":12703,"thread_start_us":603624,"threads_started":1,"wal-append.queue_time_us":631575}
I20260709 12:20:05.374796 29855 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:05.375355 29855 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.317401 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:05.252162 30088 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.320109 24172 raft_consensus.cc:2393] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 13: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:05.379351 24169 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:05.379637 30088 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:05.380553 30016 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.665s	user 0.013s	sys 0.000s
I20260709 12:20:05.381075 30016 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.383248 24098 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:05.387064 29940 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:05.391737 24101 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:05.321537 29945 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:05.235951 29862 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:05.476874 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:05.477630 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.479204 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:05.479206 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 128969us
I20260709 12:20:05.481180 24066 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:05.481554 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:05.455909 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 145327us
I20260709 12:20:05.485142 24101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4139) took 1323 ms. Trace:
I20260709 12:20:05.485697 24101 rpcz_store.cc:276] 0709 12:20:04.161951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.829861 (+667910us) service_pool.cc:224] Handling call
0709 12:20:05.391471 (+561610us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.392280 (+   809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.484869 (+ 92589us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b540011c450. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:05.485051 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277750656}
I20260709 12:20:05.487128 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:20:05.488950 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 130765us
I20260709 12:20:05.490907 24780 leader_election.cc:400] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14.
I20260709 12:20:05.491487 24780 leader_election.cc:403] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:05.278317 29723 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.362690 30109 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.484170 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:05.390357 30120 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.511444 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:05.362749 30009 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:05.522104 29723 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:05.510411 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:05.523216 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:20:05.516566 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 496185us
I20260709 12:20:05.523726 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:05.525236 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:05.525964 24098 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.546360 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:05.501013 30144 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.506208 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:05.559319 24141 connection.cc:256] RPC call timeout handler was delayed by -1.5322476579999602s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
W20260709 12:20:05.560053 24141 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187): Timed out: RequestConsensusVote RPC to 127.22.93.196:44187 timed out after 1.564s (SENT)
I20260709 12:20:05.540771 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:05.560760 24097 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:20:05.571672 24141 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:05.572103 24097 raft_consensus.cc:606] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Received request to transfer leadership to TS 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:05.520972 29961 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.566717 24098 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:05.563476 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:05.533209 30143 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:05.530857 30074 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:05.531044 30009 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:05.570284 29723 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:05.586838 29723 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:05.587284 29723 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:05.535084 29988 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:05.521188 30109 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.584661 24247 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:05.582672 30074 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:05.591495 29853 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:05.592934 30064 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:05.583752 29945 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:05.600365 30178 consensus_queue.cc:1059] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:05.595233 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:20:05.583699 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.594442 24093 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4141) took 1429 ms. Trace:
I20260709 12:20:05.635216 24093 rpcz_store.cc:276] 0709 12:20:04.164769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.862880 (+698111us) service_pool.cc:224] Handling call
0709 12:20:04.875954 (+ 13074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:04.876164 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:05.289557 (+413393us) log.cc:844] Serialized 14 byte log entry
0709 12:20:05.593859 (+304302us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:05.593923 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:05.593990 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.594122 (+   132us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.594350 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65409,"prepare.queue_time_us":659043,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":54,"raft.queue_time_us":33532,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":141,"thread_start_us":662691,"threads_started":2}
I20260709 12:20:05.572223 30016 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:05.638095 30028 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:05.615605 29723 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.638499 30028 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:05.638959 30028 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.643497 30177 raft_consensus.cc:993] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: : Instructing follower 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:20:05.613188 29871 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:05.657163 29871 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:05.657684 29871 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.628859 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:05.593066 29988 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:05.598605 30062 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:05.644259 24141 connection.cc:256] RPC call timeout handler was delayed by -1.1168438400000014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
I20260709 12:20:05.731652 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:05.734405 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:05.666190 24098 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 15: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:05.618948 30074 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:05.611618 30101 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:05.597178 30088 consensus_queue.cc:1059] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:20:05.623808 30107 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:05.601910 30045 consensus_meta.cc:287] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.543s	user 0.010s	sys 0.007s
I20260709 12:20:05.736264 29723 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:05.746063 24093 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0"
dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
mode: GRACEFUL
new_leader_uuid: "fa8cfbff90bf4881a56772b05008aadb"
 from {username='slave'} at 127.0.0.1:48090
I20260709 12:20:05.766501 24093 raft_consensus.cc:606] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Received request to transfer leadership to TS fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:05.757408 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 244381us
I20260709 12:20:05.767293 24093 raft_consensus.cc:614] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:20:05.770853 24175 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:05.772028 24176 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:05.773798 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 267664us
W20260709 12:20:05.776852 29861 consensus_meta.cc:287] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.712s	user 0.015s	sys 0.000s
I20260709 12:20:05.777397 29861 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:05.780901 30091 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.730693 29988 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:05.756443 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 123370us
I20260709 12:20:05.632295 30064 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.804105 29995 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.785337 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4142) took 1620 ms. Trace:
I20260709 12:20:05.805387 24092 rpcz_store.cc:276] 0709 12:20:04.165072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.867925 (+702853us) service_pool.cc:224] Handling call
0709 12:20:04.868285 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:04.868521 (+   236us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:20:05.306110 (+437589us) log.cc:844] Serialized 14 byte log entry
0709 12:20:05.784834 (+478724us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:05.784913 (+    79us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:05.784990 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:05.785093 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:05.785251 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11180,"prepare.queue_time_us":614985,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"thread_start_us":875873,"threads_started":2}
I20260709 12:20:05.764721 30101 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.747071 30062 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:05.801373 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 274635us
I20260709 12:20:05.752372 30116 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:05.804859 30064 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:05.809733 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:05.774652 29993 consensus_queue.cc:1059] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:20:05.746832 29945 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:05.785266 29857 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:05.872936 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:05.855515 24140 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:05.646468 24215 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:05.874502 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:05.875262 24812 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 17.
I20260709 12:20:05.843770 30101 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:05.868552 29723 consensus_queue.cc:1059] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:05.792984 30178 raft_consensus.cc:1081] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Signalling peer 5d0f174a97494d0cbf08ae81ec4c807a to start an election
I20260709 12:20:05.877117 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:05.877605 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:05.881920 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:05.878830 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:05.849642 30164 log.cc:927] Time spent T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
W20260709 12:20:05.853513 30133 consensus_meta.cc:287] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.799s	user 0.019s	sys 0.001s
I20260709 12:20:05.844678 30062 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:05.868040 29909 consensus_meta.cc:287] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.867s	user 0.013s	sys 0.008s
I20260709 12:20:05.887921 29984 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:05.889072 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:05.893663 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:05.897969 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:05.898528 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:20:05.899282 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:05.900272 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:05.918615 24813 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 7.
I20260709 12:20:05.901536 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:05.790961 30165 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.093s
I20260709 12:20:05.787846 30045 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:05.867193 29945 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:05.906446 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 260095us
I20260709 12:20:05.846887 30028 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.883622 30173 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:05.913646 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 256055us
I20260709 12:20:05.920507 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:20:05.946164 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:05.922763 24810 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
W20260709 12:20:05.923529 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 44816.3us
I20260709 12:20:05.949426 24810 pending_rounds.cc:85] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: Aborting all ops after (but not including) 9
I20260709 12:20:05.949776 24810 pending_rounds.cc:107] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:20:05.925290 29909 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.950443 24140 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:05.952083 29909 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:05.924221 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 147276us
I20260709 12:20:05.954362 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:05.926321 24215 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:05.955009 24243 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:05.955505 24245 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:05.911010 30128 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:05.956699 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:05.958017 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:05.959214 29927 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:05.959605 24246 raft_consensus.cc:1240] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:05.960139 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:05.959638 29927 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:05.905786 30184 raft_consensus.cc:3055] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:05.950088 24810 raft_consensus.cc:2889] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:05.960988 29927 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:05.925648 30133 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:05.960952 30080 consensus_meta.cc:287] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.602s	user 0.010s	sys 0.009s
I20260709 12:20:05.930124 29945 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:05.962471 30180 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:20:05.962925 30202 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:20:05.968032 30189 log.cc:927] Time spent T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:20:05.968874 30045 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:05.970088 24248 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:05.971369 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:05.971837 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:05.972149 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:05.972667 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:06.044827 24242 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:05.972893 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:05.975683 30144 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14.
I20260709 12:20:06.014593 30128 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:06.049726 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:05.915963 30091 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:05.980165 30028 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:05.960896 24249 raft_consensus.cc:2393] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 17: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:20:05.944397 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 349229us
I20260709 12:20:06.015998 30184 raft_consensus.cc:740] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:20:05.995697 30132 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.650s	user 0.015s	sys 0.007s
I20260709 12:20:05.960897 29988 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:05.921674 29984 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:06.000090 29961 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14.
I20260709 12:20:06.003364 30120 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:06.002918 30009 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:06.007162 30095 consensus_meta.cc:287] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.653s	user 0.006s	sys 0.007s
I20260709 12:20:06.007601 29853 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:06.009280 30203 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:06.009513 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 83311.6us
W20260709 12:20:06.010253 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 62978.1us
I20260709 12:20:05.961254 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:06.038727 30080 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:06.016892 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 131545us
I20260709 12:20:05.937884 30173 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:05.945803 29940 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:06.000249 30093 consensus_meta.cc:287] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.777s	user 0.006s	sys 0.016s
W20260709 12:20:06.015326 30136 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.745s	user 0.001s	sys 0.010s
W20260709 12:20:06.041290 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64999.5us
I20260709 12:20:06.106278 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:06.053117 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:06.053994 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:06.054795 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:06.109052 24247 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:20:06.107965 24248 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:20:06.111109 24808 raft_consensus.cc:2393] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 11: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:20:06.098443 30105 consensus_meta.cc:287] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.758s	user 0.019s	sys 0.002s
W20260709 12:20:06.065667 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 52902.7us
W20260709 12:20:06.062352 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 109965us
I20260709 12:20:06.076051 24806 raft_consensus.cc:2410] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:20:06.019325 30193 consensus_queue.cc:1059] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:20:06.078696 24243 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:06.097788 30173 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:06.061785 30015 consensus_meta.cc:287] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.691s	user 0.000s	sys 0.021s
W20260709 12:20:06.007266 24100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37604 (request call id 3220) took 1841 ms (client timeout 1878 ms). Trace:
W20260709 12:20:06.122663 24100 rpcz_store.cc:269] 0709 12:20:04.165494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.482225 (+316731us) service_pool.cc:224] Handling call
0709 12:20:06.006917 (+1524692us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540037ee54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:06.007160 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3407080192}
W20260709 12:20:06.060328 30079 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.712s	user 0.010s	sys 0.004s
I20260709 12:20:06.084265 24215 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:06.080605 30095 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.087040 29988 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:06.084147 24250 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:20:06.088589 30133 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:06.130604 30197 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:06.076042 30206 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:20:06.096789 24815 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:06.134723 30206 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:06.135540 30206 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:06.136785 30206 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.144315 29861 raft_consensus.cc:3055] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:06.144877 29861 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:06.145424 29855 consensus_meta.cc:287] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.770s	user 0.010s	sys 0.010s
I20260709 12:20:06.150735 30009 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:06.152133 30070 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.828s	user 0.014s	sys 0.010s
I20260709 12:20:06.145869 29861 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.154052 29861 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:06.131333 30079 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.158360 30079 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.159077 30206 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:06.075045 29984 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:06.145913 29855 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.073033 30109 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:06.163159 30181 raft_consensus.cc:3055] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:06.163625 30181 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:06.164674 30181 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.166005 30181 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:06.114343 24246 raft_consensus.cc:1240] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:06.169332 29871 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.511s	user 0.006s	sys 0.006s
I20260709 12:20:06.169862 29871 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.095893 24241 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:06.115319 24243 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:06.172837 30177 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:06.173887 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:06.175227 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:06.117446 24214 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:06.176469 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59213us
I20260709 12:20:06.173396 29855 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:06.121126 24780 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:06.179970 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:06.180620 29993 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:06.181212 29993 raft_consensus.cc:697] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:06.184181 30062 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:06.184680 30062 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:20:06.178663 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 57672.1us
I20260709 12:20:06.185863 24780 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:06.185724 30062 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.103245 30136 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.117846 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:06.182318 29993 consensus_queue.cc:237] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.173269 30177 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:06.095964 24807 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:06.152598 30070 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.103724 30093 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.126505 24215 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:06.174022 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:06.079186 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:06.117523 30105 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.186967 30062 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:06.187165 30130 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:06.213160 30130 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:06.213569 30130 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.189101 24100 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:06.190128 24249 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:06.194265 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:20:06.192575 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 74810.5us
I20260709 12:20:06.217362 24175 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:06.172099 29871 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:06.218343 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:20:06.206051 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 126896us
I20260709 12:20:06.202625 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:06.211238 24093 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:06.126376 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:06.194265 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:06.197067 24094 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:06.198132 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:06.203610 24167 raft_consensus.cc:1240] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:06.206430 24140 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:20:06.209200 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 82781.4us
I20260709 12:20:06.314262 24242 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:06.316113 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:06.316345 24248 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:06.318039 24247 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:06.318536 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 100672us
I20260709 12:20:06.319808 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:06.215212 29855 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:06.324236 24215 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:06.326059 24215 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:06.327360 24066 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:06.329900 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 176361us
I20260709 12:20:06.354089 24175 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:06.123984 30015 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.202273 30070 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:06.369544 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.207938 29927 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.349507 24066 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:06.606372 30091 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
W20260709 12:20:06.323336 30035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.007s	sys 0.007s
W20260709 12:20:06.646416 30035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.093s	user 0.007s	sys 0.026s
W20260709 12:20:06.553404 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.647331 24095 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:06.345171 24247 raft_consensus.cc:2468] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
I20260709 12:20:06.196578 30208 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:06.645897 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.510401 30045 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:06.315898 30143 consensus_meta.cc:287] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.731s	user 0.012s	sys 0.003s
I20260709 12:20:06.314755 29940 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:06.452837 30213 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.140s	user 0.000s	sys 0.002s
I20260709 12:20:06.322729 30009 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:06.336217 29988 raft_consensus.cc:2764] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:20:06.335593 29855 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:06.526732 30194 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:06.444568 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:06.669296 24100 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:06.667616 30175 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:06.672470 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 1194) took 1445 ms. Trace:
I20260709 12:20:06.189157 30074 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.597380 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:06.712677 24176 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:06.709542 24245 rpcz_store.cc:276] 0709 12:20:05.227401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.227544 (+   143us) service_pool.cc:224] Handling call
0709 12:20:05.233509 (+  5965us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:05.955918 (+722409us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:06.672107 (+716189us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54000b63d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:06.672388 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1659911936}
I20260709 12:20:06.688071 30015 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.689199 30064 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:06.637117 30101 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:06.672995 30215 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:20:06.208290 30105 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.692759 24175 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:06.208788 30203 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:20:06.645787 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 296399us
I20260709 12:20:06.410281 30197 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:06.199818 30080 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:06.323035 30207 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:06.198359 30107 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:06.635627 30079 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:06.410890 30132 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:06.197556 30177 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:06.457989 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 132002us
I20260709 12:20:06.188156 30201 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:06.445941 30165 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:06.204656 30093 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:06.335450 30144 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:06.650560 24174 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:06.410614 30198 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:06.588320 29862 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:06.710881 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 389794us
I20260709 12:20:06.314563 29962 consensus_queue.cc:1059] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.389s
I20260709 12:20:06.721498 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:06.894598 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:06.895576 24171 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:06.895857 30208 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:06.896339 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:06.722419 29945 consensus_meta.cc:287] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.677s	user 0.012s	sys 0.000s
I20260709 12:20:06.701700 29855 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:06.717871 30139 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 1.432s	user 0.020s	sys 0.011s
I20260709 12:20:06.730535 24814 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 6.
I20260709 12:20:06.196651 30128 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.707773 30194 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:20:06.853539 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 71885.4us
W20260709 12:20:06.864916 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 137631us
W20260709 12:20:06.905757 24779 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 2.198s (SENT) [suppressed 58 similar messages]
I20260709 12:20:06.870582 24215 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:06.697886 29940 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:06.707283 30009 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.728778 30143 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:06.731104 30185 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:06.883656 30080 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:06.724694 30064 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.877542 30201 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:06.900135 30093 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:06.724973 30101 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.724882 30203 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:06.892045 30165 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.924896 30202 raft_consensus.cc:3055] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:06.904676 30139 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.925525 30064 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.926864 30165 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.896989 30144 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.927438 30139 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:06.927516 24806 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 1291) took 2158 ms (client timeout 1509 ms). Trace:
I20260709 12:20:06.925572 30202 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:20:06.928511 24806 rpcz_store.cc:269] 0709 12:20:04.768596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:04.771329 (+  2733us) service_pool.cc:224] Handling call
0709 12:20:06.927269 (+2155940us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001a7cd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:06.927427 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2936172928}
I20260709 12:20:06.876549 30132 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.929186 30202 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.930357 30202 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:06.926926 24807 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33918 (request call id 1297) took 1054 ms. Trace:
I20260709 12:20:06.930929 30132 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.910065 29862 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:20:06.916662 29962 raft_consensus.cc:3055] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:06.918066 30194 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.932009 29962 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:06.932407 30194 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:06.932624 30009 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.933350 29962 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.934739 30074 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.916110 30201 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:06.922531 30095 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:06.915345 30080 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.935856 29927 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:06.938644 30080 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.939759 24814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 864) took 1063 ms. Trace:
I20260709 12:20:06.940160 24814 rpcz_store.cc:276] 0709 12:20:05.876220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.888716 (+ 12496us) service_pool.cc:224] Handling call
0709 12:20:06.939568 (+1050852us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b54004d5dd4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:06.939689 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1790691712}
I20260709 12:20:06.923802 30136 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:06.914320 30185 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.923842 30101 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:06.924837 30211 log.cc:927] Time spent T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 12:20:06.902762 29945 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.914634 30143 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.943740 30185 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:06.945292 29945 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:06.910444 30177 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:06.945773 30184 consensus_queue.cc:260] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.929231 30144 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:06.936621 29940 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.936123 30203 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:06.950879 30062 consensus_meta.cc:287] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.739s	user 0.005s	sys 0.005s
I20260709 12:20:06.945331 30143 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:06.948393 30184 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:06.955317 29995 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:06.994387 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.857975 24176 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 17.
I20260709 12:20:06.727274 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.001713 24170 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:07.003836 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 276454us
I20260709 12:20:07.012502 24066 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.017433 24066 leader_election.cc:400] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:20:06.908552 24215 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:07.006923 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 110518us
I20260709 12:20:07.021059 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:07.021890 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 113274us
I20260709 12:20:07.024118 24066 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.022372 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:07.039719 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:06.931362 24807 rpcz_store.cc:276] 0709 12:20:05.872353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.872543 (+   190us) service_pool.cc:224] Handling call
0709 12:20:06.926716 (+1054173us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54006ffed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:06.926843 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474327936}
I20260709 12:20:07.048870 29927 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:07.064086 30199 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:07.065908 30199 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:07.067211 24140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.012s	sys 0.002s
W20260709 12:20:07.067955 24140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.012s	sys 0.002s
W20260709 12:20:07.070194 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 864034us
I20260709 12:20:07.071434 29927 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:07.074085 29927 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.084692 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2047) took 1788 ms. Trace:
I20260709 12:20:07.085414 24167 rpcz_store.cc:276] 0709 12:20:05.296367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.296487 (+   120us) service_pool.cc:224] Handling call
0709 12:20:05.296817 (+   330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.323619 (+1026802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.083847 (+760228us) spinlock_profiling.cc:243] Waited 906 ms on lock 0x7b54002af8d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:07.084318 (+   471us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2084842368}
W20260709 12:20:07.088055 30130 consensus_meta.cc:287] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.874s	user 0.008s	sys 0.009s
I20260709 12:20:07.077406 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4156) took 2091 ms. Trace:
I20260709 12:20:07.077298 29945 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:07.088877 30173 consensus_meta.cc:287] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.960s	user 0.012s	sys 0.000s
I20260709 12:20:07.089586 29945 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:06.901328 30222 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:07.090514 24170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2045) took 1795 ms. Trace:
I20260709 12:20:07.091063 24170 rpcz_store.cc:276] 0709 12:20:05.295680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.295839 (+   159us) service_pool.cc:224] Handling call
0709 12:20:05.296181 (+   342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:07.002749 (+1706568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.090150 (+ 87401us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54003b1d54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:07.090440 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3920382208}
I20260709 12:20:07.091536 30222 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.077749 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.096524 30074 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:07.077659 30199 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.089650 30173 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:07.076473 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 52664.4us
W20260709 12:20:07.114475 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:07.115489 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:07.116261 29984 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.956s	user 0.010s	sys 0.005s
I20260709 12:20:07.116966 29984 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.088948 24095 rpcz_store.cc:276] 0709 12:20:04.986000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.100114 (+114114us) service_pool.cc:224] Handling call
0709 12:20:05.100574 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.647779 (+1547205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.076680 (+428901us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54002d69d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:07.077126 (+   446us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3556756352}
I20260709 12:20:07.093717 29962 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:07.137135 29862 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:20:07.139886 30128 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:07.143836 30198 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:07.145115 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 1201) took 1170 ms. Trace:
I20260709 12:20:07.145766 24248 rpcz_store.cc:276] 0709 12:20:05.974361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.115475 (+141114us) service_pool.cc:224] Handling call
0709 12:20:06.316139 (+200664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.316872 (+   733us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.144383 (+827511us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b5400061b50. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:07.144742 (+   359us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":460773760}
I20260709 12:20:07.160392 30095 consensus_queue.cc:1059] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:20:07.132472 30222 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:07.162755 30095 raft_consensus.cc:3055] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:07.126605 30130 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.176296 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:07.151274 30074 consensus_queue.cc:1059] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:20:07.179589 29940 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:07.180011 29984 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:07.180150 29940 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:07.180552 30074 raft_consensus.cc:3055] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:07.180899 29940 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.173713 30095 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:07.181097 30074 raft_consensus.cc:740] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:07.182507 30095 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.182804 30074 consensus_queue.cc:260] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.184960 30095 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:07.185560 30074 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:07.188655 30173 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:07.192415 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.192595 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:07.196995 30173 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:07.198167 30173 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:07.199043 29945 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:07.199692 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.200843 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 3347) took 1230 ms. Trace:
I20260709 12:20:07.198530 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.201309 24249 rpcz_store.cc:276] 0709 12:20:05.970290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:06.076630 (+106340us) service_pool.cc:224] Handling call
0709 12:20:06.076942 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:06.232447 (+155505us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:07.200071 (+967624us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540008cad4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:07.200538 (+   467us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":259843328}
I20260709 12:20:07.202092 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.208287 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.229303 23995 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 273) took 8034 ms. Trace:
I20260709 12:20:07.190788 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.237190 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:07.237988 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:07.238201 24093 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:07.239346 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:07.240479 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:07.243415 30206 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.939s	user 0.005s	sys 0.009s
W20260709 12:20:07.247393 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 74920.1us
I20260709 12:20:07.247766 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:07.249004 24095 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:07.205952 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.204756 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:07.203135 24215 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:07.235772 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:07.203971 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:07.272949 23998 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 188) took 8068 ms. Trace:
I20260709 12:20:07.210616 30185 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:07.276327 29861 consensus_meta.cc:287] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.122s	user 0.027s	sys 0.001s
I20260709 12:20:07.277469 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:07.265352 30199 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.278621 24101 raft_consensus.cc:2393] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:07.279011 30199 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:07.279939 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.283209 24097 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:07.250617 23995 rpcz_store.cc:276] 0709 12:19:59.194955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.195144 (+   189us) service_pool.cc:224] Handling call
0709 12:19:59.782227 (+587083us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:20:07.228965 (+7446738us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:04.781604 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:04.879887 (+ 98283us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:04.880931 (+  1044us) write_op.cc:435] Acquired schema lock
0709 12:20:04.884409 (+  3478us) tablet.cc:662] Decoding operations
0709 12:20:05.002896 (+118487us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:05.011870 (+  8974us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:05.016720 (+  4850us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:20:05.029723 (+ 13003us) tablet.cc:701] Row locks acquired
0709 12:20:05.029745 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:20:05.029915 (+   170us) write_op.cc:270] Start()
0709 12:20:05.030059 (+   144us) write_op.cc:276] Timestamp: P: 1783599605029860 usec, L: 0
0709 12:20:05.030083 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:20:05.030829 (+   746us) log.cc:844] Serialized 1749 byte log entry
0709 12:20:06.013268 (+982439us) op_driver.cc:464] REPLICATION: finished
0709 12:20:06.131798 (+118530us) write_op.cc:301] APPLY: starting
0709 12:20:06.174330 (+ 42532us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:06.208468 (+ 34138us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:06.208608 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:06.321747 (+113139us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:06.323045 (+  1298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:20:06.411644 (+ 88599us) write_op.cc:312] APPLY: finished
0709 12:20:06.523894 (+112250us) log.cc:844] Serialized 49 byte log entry
0709 12:20:06.672861 (+148967us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:06.682239 (+  9378us) write_op.cc:454] Released schema lock
0709 12:20:06.695836 (+ 13597us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:06.728261 (+ 32425us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:06.784595 (+ 56334us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":749233,"reported_tablets":5,"spinlock_wait_cycles":288353152,"child_traces":[["op",{"apply.queue_time_us":98811,"apply.run_cpu_time_us":9457,"apply.run_wall_time_us":593316,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20855,"num_ops":4,"prepare.queue_time_us":59415,"prepare.run_cpu_time_us":7655,"prepare.run_wall_time_us":309513,"replication_time_us":983012,"thread_start_us":31839,"threads_started":1}]]}
I20260709 12:20:07.286919 24245 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:20:07.277199 24171 raft_consensus.cc:2468] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:20:07.294896 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:07.296705 29861 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:07.297901 30028 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:07.299319 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:07.300364 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 109862us
I20260709 12:20:07.301007 30093 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:07.299229 30130 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:07.303809 30206 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:07.311123 24099 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 8: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:07.201646 30173 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.273528 23998 rpcz_store.cc:276] 0709 12:19:59.165254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:19:59.165502 (+   248us) service_pool.cc:224] Handling call
0709 12:19:59.453292 (+287790us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:20:07.233042 (+7779750us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:04.515178 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:04.515908 (+   730us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:04.515957 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:20:04.515972 (+    15us) tablet.cc:662] Decoding operations
0709 12:20:04.516433 (+   461us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:04.516499 (+    66us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:04.516544 (+    45us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:20:04.516891 (+   347us) tablet.cc:701] Row locks acquired
0709 12:20:04.516904 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:20:04.517078 (+   174us) write_op.cc:270] Start()
0709 12:20:04.517210 (+   132us) write_op.cc:276] Timestamp: P: 1783599604517020 usec, L: 0
0709 12:20:04.517225 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:20:04.518034 (+   809us) log.cc:844] Serialized 978 byte log entry
0709 12:20:05.773393 (+1255359us) op_driver.cc:464] REPLICATION: finished
0709 12:20:06.142277 (+368884us) spinlock_profiling.cc:243] Waited 8.77 ms on lock 0x7b180023e6c0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:20:06.142449 (+   172us) write_op.cc:301] APPLY: starting
0709 12:20:06.950200 (+807751us) spinlock_profiling.cc:243] Waited 72.9 ms on lock 0x7b60000805c8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c08ee5161 00007f4c0905114b 00007f4c09053774 00007f4c08fc86db 00007f4c08ec5b93 00007f4c08ec7de8 00007f4c08fc6e34 00007f4c08fb297c 00007f4c08fb6d61 00007f4c08fb6d19 00007f4c08fb6ca9
0709 12:20:06.950307 (+   107us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:06.954758 (+  4451us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:06.954781 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:06.956624 (+  1843us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:06.956830 (+   206us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:20:06.956917 (+    87us) write_op.cc:312] APPLY: finished
0709 12:20:06.957193 (+   276us) log.cc:844] Serialized 33 byte log entry
0709 12:20:06.958112 (+   919us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:06.958214 (+   102us) write_op.cc:454] Released schema lock
0709 12:20:06.958261 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:06.958741 (+   480us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:06.958791 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4399272,"reported_tablets":2,"spinlock_wait_cycles":297222400,"child_traces":[["op",{"apply.queue_time_us":273553,"apply.run_cpu_time_us":14030,"apply.run_wall_time_us":816285,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12491,"mutex_wait_us":1706,"num_ops":2,"prepare.queue_time_us":57307,"prepare.run_cpu_time_us":63678,"prepare.run_wall_time_us":177869,"raft.queue_time_us":567530,"raft.run_cpu_time_us":24496,"raft.run_wall_time_us":211782,"replication_time_us":1255941,"spinlock_wait_cycles":187802752,"thread_start_us":624906,"threads_started":4,"wal-append.queue_time_us":267404}]]}
W20260709 12:20:07.322227 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:07.329290 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 61513.2us
I20260709 12:20:07.330418 24141 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:07.331275 29993 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:07.334652 29993 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:07.336105 30035 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:07.338008 30045 consensus_queue.cc:1059] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:07.339234 30185 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.347110 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:07.349795 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:07.353662 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 188036us
I20260709 12:20:07.361277 30199 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:07.353540 24780 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:07.376813 24093 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:07.330169 24245 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:07.369457 24781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.001s	sys 0.013s
I20260709 12:20:07.379810 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:20:07.383612 24781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.970s	user 0.002s	sys 0.014s
I20260709 12:20:07.386622 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.392992 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.387434 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.366447 29993 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:07.394631 24097 raft_consensus.cc:2468] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:07.376482 30093 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:07.409816 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 79173.6us
W20260709 12:20:07.411341 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 58048.6us
I20260709 12:20:07.371327 30224 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:07.421571 24099 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:07.422185 30079 raft_consensus.cc:2804] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:20:07.426834 29855 consensus_meta.cc:287] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.518s	user 0.013s	sys 0.010s
I20260709 12:20:07.429694 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.430474 30194 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:07.433429 30185 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:07.433465 24171 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:07.428481 30045 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:07.442595 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:07.441376 24067 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 2.043s (SENT)
I20260709 12:20:07.432093 30093 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:07.437407 30194 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:07.448055 24175 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:07.448836 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:07.449580 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:07.438779 30173 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:07.443332 30079 raft_consensus.cc:697] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:07.451911 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.440348 30045 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:07.471186 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 101332us
I20260709 12:20:07.452690 30194 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:07.480116 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.484453 24066 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.440992 29855 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.491880 30203 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:07.495625 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 56697.6us
I20260709 12:20:07.442067 30224 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.503854 30224 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:07.507407 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:07.507648 24242 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:20:07.494678 30203 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:07.487571 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.526257 24170 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:07.527282 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 86287.4us
I20260709 12:20:07.527486 24099 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
I20260709 12:20:07.518265 24215 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:07.478358 30199 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:07.533025 24092 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:07.541298 30093 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:07.542265 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.481900 30045 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:07.545835 30182 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:07.545948 30173 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.546774 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:07.547869 24174 raft_consensus.cc:2393] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:07.549108 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.549908 30173 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:07.555166 24101 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:07.553009 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:07.553453 24244 consensus_meta.cc:287] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.545s	user 0.022s	sys 0.001s
I20260709 12:20:07.551086 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:07.568049 24171 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 13: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:07.572860 24244 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
W20260709 12:20:07.584990 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 186895us
W20260709 12:20:07.585218 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 106364us
I20260709 12:20:07.585388 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:07.587229 30201 consensus_meta.cc:287] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.632s	user 0.001s	sys 0.019s
I20260709 12:20:07.587846 30201 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.590391 30201 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:07.581677 29861 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:07.591763 29861 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.594900 24175 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:07.596470 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:07.597254 24168 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:20:07.598222 29995 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:07.598706 29995 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:07.598937 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 125117us
I20260709 12:20:07.600945 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.542774 30079 consensus_queue.cc:237] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.560221 29927 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:20:07.608258 30173 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:07.608731 30173 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:07.609082 24169 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:07.610172 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.609884 30173 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.610460 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.572847 30074 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:07.611407 24173 raft_consensus.cc:2393] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:07.611526 30173 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:07.611770 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.612598 24169 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 15: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:07.612483 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:07.613277 24173 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:07.564591 30035 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:07.614497 24169 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:07.615401 30136 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.616019 30136 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.617112 24169 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:07.618554 30136 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:07.619189 30184 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.621517 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:07.622380 30184 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:07.623168 30202 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:07.623647 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:07.624053 24809 raft_consensus.cc:1275] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:07.623883 30202 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.624883 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:07.626543 30202 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:07.599129 29995 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.602720 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.614485 24173 raft_consensus.cc:1240] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:07.610914 24172 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:07.663337 24176 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:07.674088 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:07.681190 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:07.684355 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 143305us
W20260709 12:20:07.686465 24779 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.562633 29993 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:07.689850 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 126908us
I20260709 12:20:07.689208 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.705570 24176 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:07.692327 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:07.673390 29940 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.693571 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:07.694169 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.683059 30184 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:07.692363 24807 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:07.697870 29861 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:07.611436 30074 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:07.709132 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 106505us
I20260709 12:20:07.716125 24248 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:07.723548 24815 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:07.723943 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:07.725503 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.731341 30201 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:20:07.732641 30230 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.336s	user 0.004s	sys 0.000s
I20260709 12:20:07.736724 29853 raft_consensus.cc:3055] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:20:07.737250 29853 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 6 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:07.739593 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:07.742777 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:07.746129 29962 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.747486 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.748256 29861 raft_consensus.cc:476] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Not starting pre-election -- already a leader
W20260709 12:20:07.748747 30228 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.356s	user 0.000s	sys 0.008s
I20260709 12:20:07.750213 30206 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:07.750670 30206 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:07.738381 29853 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.751828 30206 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.755084 24246 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:07.755438 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:07.756101 24241 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:07.668190 24168 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540"
dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
 from {username='slave'} at 127.0.0.1:59356
I20260709 12:20:07.756757 24168 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:20:07.757151 24168 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:07.757282 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:07.759205 30199 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:07.759729 24097 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:07.761024 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:07.761291 24808 raft_consensus.cc:1240] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:07.763793 29855 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:07.763829 24244 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 3343) took 1794 ms (client timeout 1563 ms). Trace:
I20260709 12:20:07.742816 30074 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:07.752346 29853 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:07.766144 24244 rpcz_store.cc:269] 0709 12:20:05.969151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:05.971572 (+  2421us) service_pool.cc:224] Handling call
0709 12:20:07.763529 (+1791957us) spinlock_profiling.cc:243] Waited 829 ms on lock 0x7b540035a2d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:07.763713 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1906523520}
I20260709 12:20:07.723614 24814 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
W20260709 12:20:07.769076 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:07.727484 24170 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:07.772099 24167 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16. Ops: []
W20260709 12:20:07.775271 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44310.6us
I20260709 12:20:07.775418 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:07.776160 24807 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:07.776201 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:07.777437 30225 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:07.778012 30225 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 17 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:07.782661 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.791026 24173 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:07.790410 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:07.779232 30225 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.800005 30045 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:07.746768 29962 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.807230 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:07.808481 24814 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:07.828131 24176 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:20:07.831692 24241 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:07.833551 24244 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 17: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:07.834438 24242 raft_consensus.cc:1240] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:07.838744 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:07.837380 30093 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:07.839917 30093 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.840438 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.842007 24175 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:07.842403 30093 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:07.841713 29995 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.843798 30136 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.844453 30136 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:07.844852 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.848158 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:07.857342 30202 consensus_queue.cc:1059] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:07.843746 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:07.809542 29993 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:07.873934 24175 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:07.874809 24172 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:07.875218 24173 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:07.876587 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.880004 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:07.888628 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 58804.4us
I20260709 12:20:07.891618 24174 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:07.891700 24172 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 17: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:07.895098 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.896054 24094 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:07.904819 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 111763us
I20260709 12:20:07.905321 30247 raft_consensus.cc:3055] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:07.906037 30247 raft_consensus.cc:740] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:07.907595 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:07.910477 24101 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:07.859736 30206 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:07.908706 24780 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:07.807591 29861 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:20:07.959698 30079 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:07.959864 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:07.960973 30224 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:07.960759 30079 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.961670 30224 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:07.962566 24141 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:07.931268 30249 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:07.931778 24170 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:07.932174 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:08.020007 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 114098us
I20260709 12:20:07.937327 29909 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:07.938561 30130 consensus_queue.cc:1059] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:07.946830 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:07.948525 30136 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:07.949697 30243 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:20:07.983566 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:07.982515 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:07.983598 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:07.980518 24250 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:08.034044 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.967340 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.971278 29995 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:07.985363 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:07.963335 30221 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:07.977675 29962 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:07.985301 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:07.988710 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:07.991822 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.053715 24246 raft_consensus.cc:1813] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Handling vote request from an unknown peer 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:08.053505 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:07.963529 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:07.963084 30093 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:07.973109 30079 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:07.963085 24175 raft_consensus.cc:1275] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:20:08.060194 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:07.986599 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:07.964280 30224 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:07.968291 29984 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:08.068879 30182 consensus_queue.cc:1059] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:08.068989 29984 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.070374 30182 raft_consensus.cc:3055] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:08.070835 30182 raft_consensus.cc:740] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:08.072062 29984 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:07.992549 24167 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:07.978523 29940 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:08.073704 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:08.074203 24808 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:08.075119 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:08.075304 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:08.075582 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 113109us
I20260709 12:20:08.076308 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:08.076583 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:08.077046 24167 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:08.077323 24242 raft_consensus.cc:2368] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:20:08.077489 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:08.077944 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:08.078236 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:08.075141 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.018149 24807 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:20:07.987869 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:08.080747 24814 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 18.
I20260709 12:20:07.935141 30107 consensus_queue.cc:1048] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 12:20:08.024811 24168 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:08.030375 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 190982us
I20260709 12:20:08.084051 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:08.021872 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 99385.7us
I20260709 12:20:08.085183 24247 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:08.085543 24809 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:08.069043 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:07.930092 24176 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:20:08.032315 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.038188 24248 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:20:08.050815 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:08.028563 24100 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:08.043191 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:08.054562 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:08.090390 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44031.6us
I20260709 12:20:08.048229 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:07.993193 30199 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.058240 24246 raft_consensus.cc:2410] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:20:08.058382 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:08.060842 24216 leader_election.cc:336] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Timed out: RequestConsensusVote RPC to 127.22.93.194:36209 timed out after 1.672s (SENT)
I20260709 12:20:08.063714 24175 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:08.064833 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:08.099262 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:08.066227 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:08.059437 30194 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.543s	user 0.013s	sys 0.000s
I20260709 12:20:08.067318 30247 consensus_queue.cc:260] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.059901 30173 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.023151 29909 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:08.091519 24096 raft_consensus.cc:1813] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:08.113776 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:08.058800 29927 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:08.128980 24241 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:20:08.094290 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:08.090937 24174 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:08.064961 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:08.067231 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.103402 24173 raft_consensus.cc:2393] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:08.101574 24167 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:08.107360 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:08.131626 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.059273 30093 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:08.109200 24168 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:08.100658 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:08.071956 30182 consensus_queue.cc:260] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:08.094092 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:08.143043 24807 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:20:08.116667 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.073802 30201 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:08.151644 30201 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:08.152032 30201 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:08.134429 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 49266.7us
I20260709 12:20:08.155704 24215 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:08.106772 24098 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 15: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.126803 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:08.131541 24814 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:08.160486 30201 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.161741 24808 raft_consensus.cc:1813] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:08.162289 24808 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:08.170332 24814 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 18.
I20260709 12:20:08.138162 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.173900 24096 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 12: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.173890 24097 raft_consensus.cc:2393] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 11: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.187995 24169 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:20:08.188938 30257 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:08.143326 24781 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:08.190263 30257 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:08.190737 30257 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.189884 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:08.186290 24101 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:20:08.197000 24246 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16. Ops: []
W20260709 12:20:08.186643 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 86110.2us
I20260709 12:20:08.204809 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:08.132823 30221 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:20:08.211234 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 98160.6us
I20260709 12:20:08.208541 24245 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:20:08.192672 24248 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
W20260709 12:20:08.213702 24779 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.569s (SENT)
I20260709 12:20:08.214344 24779 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:08.216336 30251 raft_consensus.cc:2804] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:08.219282 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:08.142133 30093 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:08.103490 29855 consensus_queue.cc:1059] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.093s
W20260709 12:20:08.227728 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 52416.4us
I20260709 12:20:08.127907 29962 consensus_queue.cc:1059] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 12:20:08.106349 30199 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:08.212474 24781 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:08.235512 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:08.236877 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:08.243234 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:08.240021 24250 raft_consensus.cc:1240] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:08.128592 30194 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.139858 30173 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:08.141609 30107 consensus_queue.cc:1059] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:20:08.250077 24245 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:08.251730 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47099.4us
W20260709 12:20:08.253340 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.256027 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:08.251005 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 95418.9us
I20260709 12:20:08.247373 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:08.262147 24814 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:08.262370 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:20:08.262961 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 185580us
I20260709 12:20:08.237452 30130 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:08.268162 24172 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:20:08.241266 30221 raft_consensus.cc:697] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:08.276762 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 221425us
I20260709 12:20:08.271802 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:08.271935 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:08.272586 24215 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:08.281333 24815 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:08.281713 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.285261 24810 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:08.263461 29861 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:20:08.288216 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.266304 30182 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:08.266732 30136 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:08.271600 30247 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:20:08.315346 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 55670us
I20260709 12:20:08.276350 30249 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:20:08.320892 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 108548us
I20260709 12:20:08.280853 29855 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:08.278259 29927 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:08.322067 24215 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:08.322077 24781 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:08.327813 24810 raft_consensus.cc:1240] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 17 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:08.325727 30261 raft_consensus.cc:3055] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:08.324345 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:08.329073 30261 raft_consensus.cc:740] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:20:08.329946 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 116388us
I20260709 12:20:08.330387 30261 consensus_queue.cc:260] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:08.331074 24779 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.614s (SENT)
I20260709 12:20:08.332058 30261 raft_consensus.cc:3060] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:08.332178 24779 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:08.264732 30184 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
W20260709 12:20:08.336447 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 137929us
W20260709 12:20:08.336575 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 50055.3us
I20260709 12:20:08.285882 30251 raft_consensus.cc:697] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:20:08.341325 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.311425 29861 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:08.345366 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 105888us
I20260709 12:20:08.349169 24808 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:08.351764 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.354485 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:08.358238 24814 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:20:08.303774 29984 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 12:20:08.363162 24779 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.667s (SENT)
I20260709 12:20:08.323474 29855 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:08.339991 29962 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:08.386054 24779 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:08.366600 24215 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.367415 24813 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:08.365887 30249 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:08.398546 24808 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:08.364619 30225 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:08.371218 30258 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:08.353104 30130 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:08.381790 29855 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.413427 29855 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:08.417009 30202 raft_consensus.cc:3055] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:08.417510 30202 raft_consensus.cc:740] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:08.418497 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:08.383503 29984 raft_consensus.cc:3055] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:08.352454 30035 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:08.424782 24099 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:08.384217 24247 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 18.
I20260709 12:20:08.349969 30250 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:08.392779 24249 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:08.396816 24811 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:08.350788 29861 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.408903 24140 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:08.409742 30251 consensus_queue.cc:237] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.366032 29862 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:08.411674 30249 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.420033 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:08.420648 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.421300 24094 consensus_meta.cc:287] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.501s	user 0.011s	sys 0.000s
I20260709 12:20:08.435632 24094 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
W20260709 12:20:08.426410 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 110175us
I20260709 12:20:08.427153 24814 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:20:08.432178 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 68454.7us
W20260709 12:20:08.433585 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 75867.7us
I20260709 12:20:08.440227 24781 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:08.442296 24093 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:08.451460 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:08.403400 30258 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:08.454007 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.454782 30093 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.455318 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.455600 30224 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:08.456082 24244 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:08.457086 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.457295 30093 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:08.447261 30035 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.426923 29984 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:08.463773 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.464006 29984 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.366513 29940 consensus_queue.cc:1059] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:20:08.469471 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:08.482784 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:08.483644 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 74893.6us
I20260709 12:20:08.465827 30184 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:08.488180 24244 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 12: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.489603 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:08.491146 24098 raft_consensus.cc:1240] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:08.491482 24810 raft_consensus.cc:3055] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:08.491837 24810 raft_consensus.cc:740] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:08.494856 24811 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:20:08.475843 30130 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:08.503657 30130 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:08.504191 30130 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:08.419911 29909 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.507624 29909 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:08.511472 30203 consensus_queue.cc:1175] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c090031f610346ed82285cd847bca6d6" responder_term: 15 status { last_received { term: 15 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 15 index: 13 } }
I20260709 12:20:08.511870 30260 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:08.512341 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.513180 24098 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.515594 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.506714 30035 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:08.516546 24100 raft_consensus.cc:2393] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.491114 30184 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:08.516812 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.517537 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.502137 29984 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:08.519228 24100 raft_consensus.cc:1240] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: []
I20260709 12:20:08.520430 30248 raft_consensus.cc:3055] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:08.520925 30248 raft_consensus.cc:740] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:08.521896 30248 consensus_queue.cc:260] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.524052 30225 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:08.465895 30258 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:08.517678 30184 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.527793 30184 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:08.418497 30202 consensus_queue.cc:260] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.531607 30194 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:08.531929 29855 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:08.517597 30201 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:08.502864 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.537216 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:08.538401 29853 consensus_meta.cc:287] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.771s	user 0.014s	sys 0.000s
W20260709 12:20:08.515175 30107 consensus_queue.cc:1175] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "729aa4b1ccec48b588c14e67652c61e1" responder_term: 16 status { last_received { term: 15 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:08.539942 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:08.499877 24140 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:08.541293 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:08.580092 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.495102 24810 consensus_queue.cc:260] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.581691 24810 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:08.594975 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:08.515173 30259 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:20:08.492660 30267 consensus_queue.cc:1059] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
W20260709 12:20:08.544322 30206 consensus_meta.cc:287] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.516s	user 0.013s	sys 0.000s
I20260709 12:20:08.436766 30221 consensus_queue.cc:237] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:08.607805 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.609922 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.611202 24098 raft_consensus.cc:2393] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.543715 30199 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:08.613910 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 114175us
I20260709 12:20:08.566947 29855 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:08.598647 30248 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:08.603881 29940 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.625962 24140 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:08.627270 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:08.628556 30255 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:20:08.635386 29855 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:08.636968 29855 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:08.603945 29909 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:08.642190 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.644569 24243 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:20:08.617223 30093 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:08.649286 24098 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 14: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.641222 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:08.650063 24242 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 7.
I20260709 12:20:08.624595 30201 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.639886 29909 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:08.674042 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.665349 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:08.665700 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.666168 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.666597 24100 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:08.652878 29993 consensus_meta.cc:287] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.774s	user 0.011s	sys 0.004s
I20260709 12:20:08.668371 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:08.672158 29861 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:08.692183 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.662725 29984 raft_consensus.cc:2804] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:08.705389 24098 raft_consensus.cc:2393] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 11: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.701682 24093 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 17.
I20260709 12:20:08.709857 24101 raft_consensus.cc:1240] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:08.712874 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 96267.3us
I20260709 12:20:08.712993 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.616423 30250 raft_consensus.cc:697] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:08.716516 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 90708.4us
I20260709 12:20:08.716653 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.709128 29862 raft_consensus.cc:697] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:08.724555 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.726119 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:08.727809 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.727926 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.728271 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:20:08.728560 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.762046 24250 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:08.763247 24096 raft_consensus.cc:2368] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14.
I20260709 12:20:08.732313 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:08.764089 24244 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:08.733845 24098 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:08.649065 29940 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.735013 30250 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.737937 24246 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:08.734637 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.649425 30224 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260709 12:20:08.758754 24780 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:08.752604 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.767892 24241 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:08.738880 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:08.774137 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:08.775616 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 286737us
W20260709 12:20:08.779735 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 313570us
W20260709 12:20:08.791239 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 52488.9us
I20260709 12:20:08.791399 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:08.753234 29984 raft_consensus.cc:697] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:08.807771 24810 raft_consensus.cc:2410] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 18 because replica has last-logged OpId of term: 17 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 15.
W20260709 12:20:08.793408 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 75928us
I20260709 12:20:08.707669 30201 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.809394 24140 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:08.813265 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:08.815845 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.817765 24096 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 14: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:20:08.821321 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 62730us
I20260709 12:20:08.746255 30107 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:20:08.826036 24241 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:08.828924 24244 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
I20260709 12:20:08.829684 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.809744 29853 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:08.833643 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:08.833189 24098 raft_consensus.cc:2393] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:20:08.840731 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.841502 29861 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:08.837615 30272 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260709 12:20:08.822021 30093 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:08.833789 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:08.843684 30272 raft_consensus.cc:3055] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:20:08.846372 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.845314 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.852768 30197 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:08.855759 29909 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:08.825803 30194 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:08.875291 30194 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.878304 30194 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:08.885854 23998 catalog_manager.cc:5697] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.857643 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.889168 24098 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:20:08.858443 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49174.1us
I20260709 12:20:08.858067 30074 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:08.865028 30271 consensus_queue.cc:1059] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:20:08.867048 30201 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:08.850479 30272 raft_consensus.cc:740] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:08.836835 30173 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:08.869619 30263 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:08.848161 29927 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:08.873878 29940 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:08.888896 23998 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 10 to 11, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 11 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:08.905359 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 546993us
I20260709 12:20:08.907924 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.928864 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:08.902577 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 74891us
I20260709 12:20:08.910708 24140 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:08.911551 24100 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 17.
I20260709 12:20:08.913681 24245 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
W20260709 12:20:08.906811 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59236.4us
W20260709 12:20:08.915685 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.904937 30074 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:08.930070 24094 raft_consensus.cc:2393] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 13: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:08.914227 30267 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:08.931419 24101 raft_consensus.cc:2368] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 13. Current term is 14.
I20260709 12:20:08.936627 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:08.938547 24807 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:08.937253 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:20:08.941911 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:08.943421 24175 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:08.948647 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: true dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.949386 24094 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:08.930531 30263 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:08.937645 29927 raft_consensus.cc:697] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:08.951141 29984 consensus_queue.cc:237] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.952142 29927 consensus_queue.cc:237] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.952587 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:08.953287 24242 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:08.955065 30093 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:08.955488 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:08.956359 24169 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 13: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:08.956261 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:08.957167 24173 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 8: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:08.957293 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:08.958490 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:08.958755 30276 raft_consensus.cc:3055] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:08.959262 30276 raft_consensus.cc:740] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:08.959975 30074 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:08.960618 30247 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.637s	user 0.014s	sys 0.000s
I20260709 12:20:08.960242 30276 consensus_queue.cc:260] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:08.961431 30074 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:08.961710 30276 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:08.940567 30257 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.749s	user 0.011s	sys 0.004s
I20260709 12:20:08.850674 29862 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:08.963496 30257 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:08.964334 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.963667 23998 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: config changed from index 11 to 14, term changed from 17 to 18, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to <none>, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New cstate: current_term: 18 committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:08.964990 24101 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:20:08.965905 30257 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:08.966113 24092 raft_consensus.cc:1240] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:08.965602 23998 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:08.966323 30267 raft_consensus.cc:697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:08.967222 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:08.959276 24779 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.732s (SENT)
I20260709 12:20:08.955569 30093 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:08.965907 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.979576 24098 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:20:08.968299 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.979467 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:08.980849 24176 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:20:08.945050 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:08.983915 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.984498 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:08.968938 24169 raft_consensus.cc:2376] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11. Re-sending same reply.
W20260709 12:20:08.985618 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 55389.9us
I20260709 12:20:08.986974 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.988189 24101 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 10.
I20260709 12:20:08.982156 24175 raft_consensus.cc:2376] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16. Re-sending same reply.
I20260709 12:20:08.989246 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.983942 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:08.995122 24098 raft_consensus.cc:3055] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:08.995621 24098 raft_consensus.cc:740] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:08.999869 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:09.005919 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:09.000195 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:09.006819 24175 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.007993 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:09.000797 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:09.000504 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:09.006142 24170 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:08.979377 30261 consensus_meta.cc:287] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.635s	user 0.013s	sys 0.002s
I20260709 12:20:08.955101 30173 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:09.000705 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 68328.9us
I20260709 12:20:09.014146 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:09.014290 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:09.021888 24242 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:20:09.025857 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:09.028280 24167 raft_consensus.cc:1240] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:09.029552 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:09.032174 24099 raft_consensus.cc:2393] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 11: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:09.031988 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:08.984233 30093 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:08.999373 30271 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:09.023934 30258 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.045161 24098 consensus_queue.cc:260] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.099247 30079 raft_consensus.cc:3055] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:09.099429 29855 consensus_queue.cc:1059] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:09.045419 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:09.048243 24099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:09.037493 24100 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:09.041600 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 50330.1us
I20260709 12:20:09.052456 24096 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:09.103793 30271 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:09.104956 30271 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.105862 30185 consensus_queue.cc:1048] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:09.106243 30202 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.099852 30079 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:09.107422 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:09.107718 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.108175 24242 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 5.
I20260709 12:20:09.107903 30079 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.108717 30250 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.109094 30079 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.109301 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:09.109552 24176 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:09.110064 24247 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:09.111438 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.036041 24097 raft_consensus.cc:2393] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 7: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:09.024710 24173 raft_consensus.cc:2376] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17. Re-sending same reply.
I20260709 12:20:09.100411 29855 consensus_queue.cc:1243] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Peer 5d0f174a97494d0cbf08ae81ec4c807a log is divergent from this leader: its last log entry 16.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:20:09.073065 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 113850us
I20260709 12:20:09.081265 24808 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:20:09.095408 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.061317 24175 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:20:09.091967 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:09.072662 24811 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14. Ops: []
W20260709 12:20:09.097515 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.127199 24170 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:09.074858 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:09.128739 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:09.131618 24176 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:09.130937 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:09.133037 24169 raft_consensus.cc:2393] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 16: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:09.135746 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.120770 24094 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 18.
W20260709 12:20:09.141105 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.147019 24780 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:09.147454 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:09.148558 24097 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 12: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
W20260709 12:20:09.150141 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 75399.7us
I20260709 12:20:09.153057 24170 raft_consensus.cc:1240] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: []
W20260709 12:20:09.154157 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.074204 30130 consensus_meta.cc:287] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.569s	user 0.011s	sys 0.002s
I20260709 12:20:09.168036 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:09.169458 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:09.163318 24172 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:09.121148 30197 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:09.174643 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:09.175634 24093 raft_consensus.cc:2368] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 17. Current term is 18.
W20260709 12:20:09.179932 24779 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.816s (SENT)
I20260709 12:20:09.180588 24779 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.070200 30258 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:09.121510 29940 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:09.157307 30250 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.189411 24094 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:09.192561 24097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:09.161367 30206 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:09.162736 30184 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:09.200443 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64792.2us
I20260709 12:20:09.175315 29993 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.175446 30130 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.212150 24093 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:09.239056 24096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:20:09.248042 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45717.2us
I20260709 12:20:09.248930 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:09.179442 30261 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:09.240192 24101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:09.204742 24141 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.185158 29862 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.255940 24101 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 12: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:09.256027 24092 raft_consensus.cc:1240] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:09.246766 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 43883.4us
I20260709 12:20:08.950868 30263 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.203991 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:09.219098 30136 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:20:09.241827 29855 consensus_queue.cc:1059] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:20:09.227437 30266 raft_consensus.cc:3055] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:09.268249 30266 raft_consensus.cc:740] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:09.268432 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:09.270345 24098 raft_consensus.cc:3060] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:09.272078 24242 raft_consensus.cc:1240] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:09.273252 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:09.273936 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 121479us
W20260709 12:20:09.274883 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.167596 30246 consensus_queue.cc:1059] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:20:09.285297 24808 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
W20260709 12:20:09.288398 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 83783.9us
I20260709 12:20:09.290026 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:09.299234 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 135285us
I20260709 12:20:09.203613 30201 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.302920 24247 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:09.225790 30173 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:09.052368 30267 consensus_queue.cc:237] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:09.314021 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.256070 30258 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:20:09.274632 30206 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:09.278469 30261 raft_consensus.cc:697] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:09.315703 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:09.298637 30257 raft_consensus.cc:3055] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:09.331418 24099 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:20:09.211124 30284 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.187s
I20260709 12:20:09.240355 30184 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.201460 29940 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:09.345896 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 97074.1us
I20260709 12:20:09.263998 29984 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:20:09.347602 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:09.349115 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 167082us
I20260709 12:20:09.352303 24098 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 8. (term mismatch)
I20260709 12:20:09.353660 24098 pending_rounds.cc:85] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: Aborting all ops after (but not including) 7
I20260709 12:20:09.359715 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.357496 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:09.339754 29962 consensus_meta.cc:287] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.937s	user 0.012s	sys 0.003s
I20260709 12:20:09.277211 29862 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.320844 30250 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:09.368456 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.370028 24100 raft_consensus.cc:2393] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 16: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:09.320375 30288 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:09.379019 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.339327 30257 raft_consensus.cc:740] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:09.331346 30074 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 12:20:09.388338 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 104005us
I20260709 12:20:09.239789 30197 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:09.390599 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 100766us
I20260709 12:20:09.354429 24098 pending_rounds.cc:107] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 12:20:09.269289 30266 consensus_queue.cc:260] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.394104 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.372967 30246 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:09.432247 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 99472.3us
I20260709 12:20:09.431056 24140 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:09.434580 24141 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:09.431526 24098 raft_consensus.cc:2889] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:09.382779 30250 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:09.437446 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.437530 24245 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:09.439743 30130 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:09.373261 30249 consensus_queue.cc:1059] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 12:20:09.441049 30249 raft_consensus.cc:3055] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:09.441428 30249 raft_consensus.cc:740] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 9 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:09.444731 30128 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:09.445231 30128 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.445636 30128 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.442365 30249 consensus_queue.cc:260] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.451120 30250 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.452008 30249 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:09.365842 29853 consensus_queue.cc:1059] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:20:09.457196 29853 raft_consensus.cc:3055] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:09.457594 29853 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:09.461625 29940 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:09.231374 30272 consensus_queue.cc:260] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.477567 24808 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:09.479583 24249 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
W20260709 12:20:09.479559 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48622.7us
I20260709 12:20:09.388680 29962 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:09.390138 30185 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:09.458408 30173 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:09.483369 24216 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.484603 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:09.377032 30093 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.425765 30288 raft_consensus.cc:697] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:09.496058 24066 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:09.498873 24815 raft_consensus.cc:1240] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:09.481249 30260 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:09.509893 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.486953 30079 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:20:09.511523 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 77037.2us
I20260709 12:20:09.484387 30266 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:09.458555 29853 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:09.515486 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.486790 30173 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:09.516148 24172 raft_consensus.cc:1240] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:09.489705 30221 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:09.522064 30185 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:09.522756 30185 raft_consensus.cc:697] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:09.486641 30206 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.523545 30288 consensus_queue.cc:237] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.523844 30185 consensus_queue.cc:237] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.527262 29862 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:09.528548 30287 raft_consensus.cc:3055] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:09.529147 30287 raft_consensus.cc:740] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:09.485141 29993 consensus_queue.cc:1059] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
W20260709 12:20:09.519842 24779 leader_election.cc:336] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.885s (SENT)
I20260709 12:20:09.498112 30295 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:09.538884 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.553522 30294 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:09.520161 30276 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:09.489773 29909 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
W20260709 12:20:09.554698 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 119182us
W20260709 12:20:09.557842 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 67759.1us
I20260709 12:20:09.538149 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:09.507561 29940 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:20:09.507894 30224 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:20:09.488070 30261 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.516096 30260 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:09.561023 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 67619.5us
I20260709 12:20:09.549551 30079 raft_consensus.cc:697] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:09.550436 24141 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:09.560160 24216 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:09.579787 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60009.8us
I20260709 12:20:09.566581 29853 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:09.561365 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.530377 30287 consensus_queue.cc:260] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.499059 30257 consensus_queue.cc:260] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.582051 24214 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:09.588984 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.588855 30258 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:09.578083 30296 log.cc:927] Time spent T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.149s	user 0.002s	sys 0.000s
W20260709 12:20:09.571322 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 64343.7us
W20260709 12:20:09.592566 24779 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.888s (SENT)
I20260709 12:20:09.576706 29927 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:09.562310 30271 consensus_queue.cc:1059] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:20:09.555985 30295 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.576318 30184 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:09.596354 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.608304 30128 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.610853 30128 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:09.595273 30246 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:09.612730 30260 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:09.619333 30079 consensus_queue.cc:237] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.622172 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
W20260709 12:20:09.598284 30289 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.231s	user 0.000s	sys 0.002s
I20260709 12:20:09.592954 30274 raft_consensus.cc:2764] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:20:09.631239 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:09.632894 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.641010 30271 raft_consensus.cc:3055] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:09.641542 30271 raft_consensus.cc:740] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:09.643132 29940 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:09.643361 30304 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:09.647033 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 77883.9us
I20260709 12:20:09.650966 24141 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:09.654862 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.648147 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:09.655845 24099 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:09.657888 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.659428 24173 raft_consensus.cc:1240] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:09.659253 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:09.602769 30257 raft_consensus.cc:3060] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:09.660600 24095 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.663908 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:09.648567 30287 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:09.669059 24141 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:09.670830 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 78308.8us
W20260709 12:20:09.671887 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 75617.5us
I20260709 12:20:09.672713 24216 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:09.655691 29940 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:09.684325 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.665802 30260 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:09.659363 30246 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:09.681677 24100 raft_consensus.cc:2955] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, c090031f610346ed82285cd847bca6d6 (127.22.93.196) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:09.642558 30271 consensus_queue.cc:260] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.666167 29984 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.664297 30250 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.675002 30093 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:09.707592 24779 leader_election.cc:336] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.938s (SENT)
I20260709 12:20:09.708818 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:09.686934 30107 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:09.711517 24780 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:09.712944 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:09.697584 30260 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:09.717514 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.718712 24174 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.701766 30297 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:09.707157 29909 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:09.736189 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:09.737010 24169 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:20:09.739486 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:09.718298 30261 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:09.740228 24170 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:09.743259 30306 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:09.743774 30307 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:20:09.744527 29909 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:09.744961 29940 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.745584 29909 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.741061 30305 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:20:09.748597 30295 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:09.743772 30306 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:09.750865 30306 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:09.753259 30276 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:09.753357 24815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 1312) took 1389 ms. Trace:
I20260709 12:20:09.753816 30276 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:09.754364 30276 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:09.705503 30074 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260709 12:20:09.729413 24171 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:09.728004 24168 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:09.721616 30251 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:20:09.753860 24815 rpcz_store.cc:276] 0709 12:20:08.364016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.364189 (+   173us) service_pool.cc:224] Handling call
0709 12:20:08.380793 (+ 16604us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:09.499487 (+1118694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.753040 (+253553us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54007d9954. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:09.753256 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2570728832}
I20260709 12:20:09.722182 30260 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:09.763094 24099 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:20:09.768160 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.769563 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.779615 24170 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
W20260709 12:20:09.781245 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 153845us
W20260709 12:20:09.783427 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 122496us
I20260709 12:20:09.723134 30130 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:09.791173 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 94092.1us
I20260709 12:20:09.793011 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.736809 30297 raft_consensus.cc:697] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:09.800992 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:09.805949 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.718158 30128 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:20:09.761618 30271 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.770743 30251 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.754462 30246 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.813987 24066 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:09.821079 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 123251us
I20260709 12:20:09.791752 30130 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:09.838703 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:09.822342 30251 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:20:09.852641 24779 leader_election.cc:336] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 2.011s (SENT)
I20260709 12:20:09.808967 30307 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:20:09.858791 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:09.859649 24815 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:09.861186 24174 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:09.834277 30130 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:09.880082 30297 consensus_queue.cc:237] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:09.887157 30261 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:09.888088 30250 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:09.887877 30261 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:09.890420 30261 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:09.864504 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:09.836541 30079 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:09.875777 30318 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260709 12:20:09.879401 30301 log.cc:927] Time spent T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260709 12:20:09.879809 30314 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:09.887235 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:09.898859 24095 raft_consensus.cc:2468] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:09.902344 24779 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:09.904487 24808 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 10. Current term is 11. Ops: []
I20260709 12:20:09.869938 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:09.930658 24815 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 8.
W20260709 12:20:09.937539 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 98957.5us
I20260709 12:20:09.946242 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:09.852304 30305 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:20:09.951758 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 183909us
I20260709 12:20:09.952163 24809 raft_consensus.cc:1275] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:20:09.948510 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 78668.3us
I20260709 12:20:09.956514 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:09.957577 24172 raft_consensus.cc:2393] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:09.953866 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:09.959663 24174 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:09.965061 24808 raft_consensus.cc:1275] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:20:09.965600 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 128276us
I20260709 12:20:09.967351 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:09.968920 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:09.944659 30079 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:09.965760 24140 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:09.972129 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:09.934123 30288 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
W20260709 12:20:09.979642 24778 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:09.956758 30261 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:09.957082 30093 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:09.981488 24779 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 2.198s (SENT)
I20260709 12:20:09.985283 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:09.964967 30258 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:09.973858 30249 consensus_meta.cc:287] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.521s	user 0.013s	sys 0.001s
I20260709 12:20:09.989246 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:09.996516 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:09.997418 24172 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:09.961200 30201 consensus_queue.cc:1059] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:20:10.002871 24066 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:10.002725 24141 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:09.982496 30250 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:10.010291 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:10.013542 30258 raft_consensus.cc:2804] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:20:10.019097 30286 log.cc:927] Time spent T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
W20260709 12:20:10.032114 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70770.4us
I20260709 12:20:10.007814 30305 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:20:10.033998 30206 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.010s	sys 0.000s
I20260709 12:20:10.037361 24066 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:10.046923 30305 raft_consensus.cc:697] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:10.012964 30093 consensus_queue.cc:1059] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:20:10.049190 30317 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.051494 30321 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 12:20:10.059602 30316 log.cc:927] Time spent T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:20:10.027704 30314 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:10.032387 30294 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:20:10.005986 30306 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:10.047500 30206 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.011s	sys 0.000s
I20260709 12:20:10.037547 30173 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.037995 30079 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.079196 30268 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:10.052467 30305 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.082448 30276 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.156087 24098 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:10.157435 30276 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.060356 30317 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:10.162420 30293 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.730s	user 0.002s	sys 0.004s
I20260709 12:20:10.084257 30314 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:10.084407 30328 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:20:10.012413 30250 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.164011 30314 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.165890 30250 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:10.088135 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.090092 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.168646 30261 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:10.171500 24095 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:10.172763 30317 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:10.175328 30292 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.742s	user 0.000s	sys 0.003s
I20260709 12:20:10.177335 30093 consensus_queue.cc:1243] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer c090031f610346ed82285cd847bca6d6 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:10.178078 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.178318 30093 raft_consensus.cc:3055] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:10.178876 30093 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:10.180140 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.087842 24174 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:10.103933 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 66659.4us
I20260709 12:20:10.131083 24100 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:10.184675 30294 raft_consensus.cc:697] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:10.091415 30266 consensus_meta.cc:287] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.571s	user 0.007s	sys 0.007s
I20260709 12:20:10.133180 30272 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:10.099929 30302 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.505s	user 0.003s	sys 0.000s
I20260709 12:20:10.139854 30201 raft_consensus.cc:3055] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:10.187819 30201 raft_consensus.cc:740] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:10.188827 30201 consensus_queue.cc:260] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.190071 30201 raft_consensus.cc:3060] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:10.140565 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 129089us
I20260709 12:20:10.190662 30294 consensus_queue.cc:237] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.192992 30225 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.193523 30225 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.195158 24242 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:10.195385 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:10.198247 24248 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:10.199375 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.147572 30288 consensus_queue.cc:1048] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:10.148092 30221 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.201622 30221 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.204453 30221 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:10.205863 30224 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:10.206282 30224 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:10.150456 30268 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:10.208164 30268 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.209054 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 3290) took 1264 ms. Trace:
I20260709 12:20:10.209496 24167 rpcz_store.cc:276] 0709 12:20:08.944689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.044844 (+100155us) service_pool.cc:224] Handling call
0709 12:20:09.093332 (+ 48488us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:09.095837 (+  2505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:09.095873 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:09.097110 (+  1237us) log.cc:844] Serialized 26 byte log entry
0709 12:20:09.310587 (+213477us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:09.361519 (+ 50932us) log.cc:844] Serialized 14 byte log entry
0709 12:20:09.361815 (+   296us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:09.361895 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:10.077325 (+715430us) spinlock_profiling.cc:243] Waited 29.1 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:20:10.161827 (+ 84502us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b2400267de8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023149c4 00007f4c02312acb 00007f4c024cddc9 00007f4c024cda55 00007f4c024cd09d 00007f4c050ff10e 00007f4c0511688c 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221
0709 12:20:10.208807 (+ 46980us) raft_consensus.cc:1685] finished
0709 12:20:10.208836 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:10.208975 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":81277,"prepare.run_cpu_time_us":2252,"prepare.run_wall_time_us":11139,"raft.queue_time_us":18813,"raft.run_cpu_time_us":316,"raft.run_wall_time_us":6683,"spinlock_wait_cycles":125346560,"thread_start_us":259041,"threads_started":2,"wal-append.queue_time_us":241527}
I20260709 12:20:10.210016 30093 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.212379 30093 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:10.154168 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:10.106719 30295 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:10.038362 30271 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:20:10.087563 30306 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.251677 24245 raft_consensus.cc:1275] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:20:10.254317 24813 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:10.262898 30224 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.265544 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.271708 24249 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:20:10.272571 24100 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:20:10.240886 29984 consensus_meta.cc:287] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.538s	user 0.009s	sys 0.005s
W20260709 12:20:10.297189 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.281968 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.275269 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:10.097210 30130 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.085477 30260 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.236002 30258 raft_consensus.cc:697] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:10.316879 24066 leader_election.cc:400] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
I20260709 12:20:10.328459 24066 leader_election.cc:403] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:10.313006 24245 raft_consensus.cc:2376] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16. Re-sending same reply.
W20260709 12:20:10.275538 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 121499us
I20260709 12:20:10.331204 24779 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:10.247417 30274 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.248175 30295 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:20:10.329221 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 75461.7us
I20260709 12:20:10.312186 29984 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:10.337420 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.342368 24807 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:10.312763 30263 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.352209 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:10.348114 24245 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:20:10.312426 30261 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:10.368854 24099 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:10.314559 30173 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:10.378526 24168 raft_consensus.cc:1240] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:10.369799 30267 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.034s	sys 0.054s
I20260709 12:20:10.375216 30263 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.390856 30330 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:10.335480 30250 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:10.343325 30266 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:10.391781 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:10.420698 24248 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:10.341981 29855 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:10.369257 30136 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.370003 30184 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14.
W20260709 12:20:10.399102 30267 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.035s	sys 0.054s
I20260709 12:20:10.343360 30274 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.402314 24100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:10.380318 30276 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:10.401234 24245 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:20:10.425295 24100 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:20:10.390873 30225 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:10.427095 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:10.435542 24095 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
W20260709 12:20:10.427703 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 75616us
I20260709 12:20:10.444077 24248 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:20:10.419886 30335 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.448809 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.427640 30271 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.400841 30261 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:20:10.392508 30251 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:10.453001 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.429816 30262 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:20:10.421707 30185 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:20:10.468887 24248 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:20:10.424609 30266 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.428548 30250 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.472257 24809 raft_consensus.cc:1240] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: []
I20260709 12:20:10.471596 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:10.429231 29855 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.429574 30258 consensus_queue.cc:237] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.460011 30271 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.489253 24248 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:20:10.509780 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 116970us
I20260709 12:20:10.509948 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:10.429443 30136 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.461933 30306 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.516381 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 494333us
I20260709 12:20:10.437678 30295 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.455775 30335 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.523144 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:10.526120 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.466840 30328 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.521193 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:10.537334 30313 consensus_queue.cc:1048] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:10.542447 30333 log.cc:927] Time spent T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:20:10.543519 30332 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:20:10.517043 30306 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.595613 24808 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:20:10.549602 30136 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.473133 30305 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:10.552464 29855 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.553618 30107 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:10.519858 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 205770us
W20260709 12:20:10.566484 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 235373us
I20260709 12:20:10.478945 30260 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.484076 30225 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:10.503321 30267 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.597836 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 87971.9us
I20260709 12:20:10.603612 30276 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:10.604566 24812 raft_consensus.cc:1275] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 16. (term mismatch)
I20260709 12:20:10.605978 30306 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.606906 30136 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:10.638571 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:10.606770 30338 log.cc:927] Time spent T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:20:10.650969 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 17 index: 16 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:10.655107 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.682282 24815 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:10.658262 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:10.636759 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:10.662943 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:10.659977 24812 pending_rounds.cc:85] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Aborting all ops after (but not including) 15
I20260709 12:20:10.684083 24812 pending_rounds.cc:107] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260709 12:20:10.684406 24812 raft_consensus.cc:2889] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:10.684119 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 47637.6us
I20260709 12:20:10.653365 30107 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.675954 30130 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:10.694417 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 222925us
I20260709 12:20:10.633502 30184 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.072s
I20260709 12:20:10.701853 24141 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:10.598747 30328 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.658974 30225 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:10.711978 24094 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:10.707463 24095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:10.709904 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 59910.9us
W20260709 12:20:10.714085 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.714406 24095 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 18.
I20260709 12:20:10.714634 24779 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:10.691180 30107 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:10.719728 24779 leader_election.cc:400] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: Vote denied by peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043) with higher term. Message: Invalid argument: T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for earlier term 17. Current term is 18.
I20260709 12:20:10.667477 30267 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.691964 30079 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:10.686513 30274 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:10.664336 29855 consensus_queue.cc:1059] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:20:10.704243 30260 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:10.693537 30202 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:10.743280 30202 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.648015 30305 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.724885 24098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
W20260709 12:20:10.748703 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49804us
I20260709 12:20:10.749800 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:10.715687 30308 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.687515 30136 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:10.717728 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 192883us
W20260709 12:20:10.745859 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.743916 30274 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.721052 30130 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:10.753172 24098 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
W20260709 12:20:10.732043 30341 log.cc:927] Time spent T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:20:10.753600 24100 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:20:10.753743 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 55888.8us
I20260709 12:20:10.760715 30202 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:10.721053 30313 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:10.783537 30313 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.742457 30107 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.784021 30136 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.752683 30251 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:10.786172 30107 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:10.786211 30305 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.770555 30274 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.788607 30267 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:10.768887 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.789860 30274 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.772151 30266 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:10.774703 30328 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:10.762435 30263 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:10.777869 30130 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:10.725423 30079 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.791345 30079 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:10.791476 30272 consensus_meta.cc:287] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.605s	user 0.008s	sys 0.006s
I20260709 12:20:10.791214 30225 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.782620 30250 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.787644 30331 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.766534 30308 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.790009 24808 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 18.
W20260709 12:20:10.796207 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 46549.2us
I20260709 12:20:10.792517 30225 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:10.803289 30271 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:10.795022 30130 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:10.809280 30079 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.784066 30313 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:10.798918 30353 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:20:10.796419 30305 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:10.813846 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:10.813951 30335 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:10.799572 30093 consensus_meta.cc:287] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.587s	user 0.012s	sys 0.003s
I20260709 12:20:10.817262 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:10.817200 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.814551 24808 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:10.818374 24813 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:20:10.815793 30308 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:10.823808 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 128241us
W20260709 12:20:10.820268 30201 consensus_meta.cc:287] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.007s
I20260709 12:20:10.833091 24066 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:10.816553 30079 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.796617 30246 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:20:10.836114 29855 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:10.837862 29855 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:10.838455 29855 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:10.839128 24216 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:10.840238 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:10.842345 30353 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.843240 30107 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:10.843676 30107 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:10.843931 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.799171 30331 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.844735 30107 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.846073 30107 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:10.847890 30357 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:20:10.848531 24808 raft_consensus.cc:2468] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:20:10.853278 24095 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:10.854120 24094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:10.854836 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:10.855369 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:10.855579 24248 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:20:10.855634 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:10.856156 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.857134 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.857787 24808 raft_consensus.cc:2468] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:20:10.859347 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.830071 30305 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:10.863287 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.865736 24097 raft_consensus.cc:1275] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:20:10.830086 30271 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:10.861471 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.861951 24243 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:20:10.862268 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:10.868172 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.868816 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.869241 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.870114 24093 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1"
I20260709 12:20:10.869854 24092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "729aa4b1ccec48b588c14e67652c61e1" is_pre_election: true
I20260709 12:20:10.869833 24246 raft_consensus.cc:1813] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Handling vote request from an unknown peer 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:10.872118 24246 raft_consensus.cc:2410] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:20:10.873193 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.873847 24811 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:10.874687 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.869895 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:10.874948 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.879261 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:10.879954 24806 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 10.
I20260709 12:20:10.875349 24813 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 7.
I20260709 12:20:10.880400 24248 raft_consensus.cc:1240] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:10.861042 30308 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:10.875262 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.881599 24241 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
I20260709 12:20:10.881692 30349 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 12:20:10.870957 30266 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.884594 30266 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.888271 30305 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.889611 30276 raft_consensus.cc:3055] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:10.890071 30276 raft_consensus.cc:740] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:10.890733 30271 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:10.891819 30271 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.903405 24814 raft_consensus.cc:2393] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:10.905833 24095 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:20:10.906205 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 67222.9us
I20260709 12:20:10.908239 30358 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:20:10.910429 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 48249.7us
I20260709 12:20:10.912775 24066 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:10.916365 30249 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:10.930866 24214 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:10.933557 24249 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 19.
W20260709 12:20:10.904659 30314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.003s	sys 0.007s
I20260709 12:20:10.935989 30358 raft_consensus.cc:697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:10.936537 30314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.003s	sys 0.007s
I20260709 12:20:10.936827 30267 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:10.937281 30358 consensus_queue.cc:237] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.938953 30184 raft_consensus.cc:2804] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:10.939472 30184 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.939867 30184 raft_consensus.cc:3060] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:10.943488 29909 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:10.944828 24780 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:10.945621 29909 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:10.946017 29909 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:10.946139 24780 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:10.946389 29909 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:10.946277 30263 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:10.886826 30266 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:10.945413 30130 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.948810 30346 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:20:10.949591 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:10.954551 24066 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:10.949791 30224 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:10.842893 30353 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.864027 30331 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:10.958616 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.959894 24098 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:20:10.958272 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:10.953526 24779 connection.cc:256] RPC call timeout handler was delayed by -1.3780451249999714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1507s for a response
I20260709 12:20:10.971321 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:10.971860 24779 connection.cc:256] RPC call timeout handler was delayed by -1.2187451249997139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:20:10.972379 24779 leader_election.cc:336] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 2.218s (SENT)
I20260709 12:20:10.957114 30346 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:10.960364 30353 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:10.985157 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.985848 24248 raft_consensus.cc:2468] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:10.958909 30359 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:10.969563 30107 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.989082 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:10.995822 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.996199 24248 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:10.904244 30276 consensus_queue.cc:260] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:10.973806 30263 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:10.994797 24246 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:10.887019 30313 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:10.997639 24244 raft_consensus.cc:1275] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:10.997856 24099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4235) took 1098 ms. Trace:
I20260709 12:20:10.998862 24241 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:10.958364 30266 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:20:10.996488 24245 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
I20260709 12:20:11.000216 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:10.977856 30271 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:10.991746 30268 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.017s	sys 0.016s
I20260709 12:20:11.004822 30359 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:11.005797 29855 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.007328 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.966118 30308 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:20:11.008318 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:10.984701 30260 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:11.009934 24099 rpcz_store.cc:276] 0709 12:20:09.899117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.899309 (+   192us) service_pool.cc:224] Handling call
0709 12:20:09.899642 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:10.369515 (+469873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.997553 (+628038us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54002d78d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:10.997767 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034127104}
I20260709 12:20:11.018712 24168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59356 (request call id 3077) took 1059 ms. Trace:
W20260709 12:20:11.019078 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 46735.8us
I20260709 12:20:10.973093 30197 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 2
W20260709 12:20:11.024672 24779 connection.cc:256] RPC call timeout handler was delayed by -1.1807766609999817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1534s for a response
I20260709 12:20:11.002194 30107 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.027663 22903 tablet_server.cc:179] TabletServer@127.22.93.193:0 shutting down...
I20260709 12:20:11.030067 30359 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.008034 30246 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.023805 24168 rpcz_store.cc:276] 0709 12:20:09.960108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.960267 (+   159us) service_pool.cc:224] Handling call
0709 12:20:09.960707 (+   440us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:10.379026 (+418319us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.014878 (+635852us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54003e99d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:11.018653 (+  3775us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960335104}
W20260709 12:20:11.017836 30268 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.018s	sys 0.017s
W20260709 12:20:11.040416 24779 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.507s (SENT)
I20260709 12:20:11.084321 24779 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.040755 30261 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.012441 30263 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.089421 24215 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:11.084421 30258 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.090893 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:11.091471 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.092327 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:11.099665 24241 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:11.093016 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:11.094530 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:11.100829 24249 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:11.090497 24215 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:11.097371 24808 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:20:11.099032 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 58626.8us
I20260709 12:20:11.042732 29855 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:11.042888 30107 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:11.109565 24170 raft_consensus.cc:2393] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:20:11.117025 30334 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.646s	user 0.005s	sys 0.008s
I20260709 12:20:11.048638 30295 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.121963 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:11.047139 30297 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.056594 30130 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:11.084408 30276 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:11.108223 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:11.111985 24215 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:11.044013 30185 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.069s
I20260709 12:20:11.122681 24242 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:11.087459 29853 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.043788 30272 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:20:11.105957 30249 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:11.106439 30201 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:11.120517 24780 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:11.098850 30294 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.134752 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:11.139611 24249 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:11.140434 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.127210 24141 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:11.118813 30206 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:11.143453 24174 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:20:11.143762 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.147511 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:11.148211 24175 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:11.151926 24174 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:11.153090 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.090365 30261 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.156988 24172 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:11.160498 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.161183 24172 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:11.088243 30246 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.162351 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.109885 30288 consensus_queue.cc:1048] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.029s
I20260709 12:20:11.165228 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.136210 30349 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:20:11.155793 30173 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.155669 30347 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:11.137199 30249 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.110962 30258 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.205678 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:11.222476 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 177062us
I20260709 12:20:11.222806 24168 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 13: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:11.136474 30340 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:11.195053 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:11.144871 30206 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.165664 29855 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:11.168356 24241 raft_consensus.cc:2468] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 7.
I20260709 12:20:11.225474 24167 raft_consensus.cc:1275] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:11.169441 30307 raft_consensus.cc:2804] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:11.205447 30349 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:11.230341 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 82136.1us
I20260709 12:20:11.138371 30297 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.155859 30294 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.237490 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:11.145520 29853 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.249997 24249 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 15.
I20260709 12:20:11.220651 30347 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:11.222180 30249 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:11.228840 30268 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.232456 30185 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.230454 30340 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.231922 30206 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:11.238623 30349 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:11.239125 30328 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.173034 29909 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.236968 30136 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:11.249658 30079 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.284456 24175 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:20:11.222000 30173 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.278465 30358 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:20:11.278972 30366 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
W20260709 12:20:11.279348 30367 log.cc:927] Time spent T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:20:11.280507 30258 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:11.281721 30365 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
I20260709 12:20:11.289708 30263 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:11.290180 29927 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.263301 30347 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:11.271973 30340 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.264485 30313 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:11.237167 30221 consensus_queue.cc:1059] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:20:11.301220 24248 raft_consensus.cc:1240] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:11.269017 30268 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.252892 29855 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.284819 30093 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:20:11.384907 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 156116us
W20260709 12:20:11.390612 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 143191us
I20260709 12:20:11.271586 30185 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.271176 30360 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 12:20:11.394059 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 156579us
W20260709 12:20:11.395756 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 293036us
W20260709 12:20:11.392949 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 434642us
I20260709 12:20:11.285893 30328 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:11.410192 24779 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.684s (SENT)
I20260709 12:20:11.370671 30201 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:11.391103 30266 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.330192 30079 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.411550 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.412418 24779 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:11.397747 30093 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.343151 30288 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
W20260709 12:20:11.478752 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 67283.7us
I20260709 12:20:11.371626 29927 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.486545 24066 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:11.469273 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49903.7us
I20260709 12:20:11.494354 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.493287 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:11.503834 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 263579us
I20260709 12:20:11.476850 30093 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:11.508687 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 98420.2us
I20260709 12:20:11.512872 24780 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:11.517498 24779 leader_election.cc:336] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.962s (SENT)
I20260709 12:20:11.474453 30368 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:11.482736 30261 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:11.468783 30272 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.528625 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:11.427361 30221 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.084s
I20260709 12:20:11.505906 30307 raft_consensus.cc:697] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:11.538046 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 114846us
I20260709 12:20:11.506122 30263 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:11.427485 30201 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.481904 30266 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:11.566620 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.574903 24175 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
I20260709 12:20:11.525619 30130 raft_consensus.cc:2804] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:20:11.532191 30288 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:11.583132 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 89903.2us
I20260709 12:20:11.508857 30308 consensus_queue.cc:1059] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:20:11.514405 30324 consensus_queue.cc:1048] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:20:11.539772 30305 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:11.588286 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.585521 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.588955 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.562906 30368 raft_consensus.cc:2804] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:11.602773 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.603536 24175 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
I20260709 12:20:11.600217 24167 raft_consensus.cc:2393] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:11.564541 29853 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:11.539274 30225 consensus_queue.cc:1048] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:20:11.591291 30184 consensus_meta.cc:287] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.651s	user 0.012s	sys 0.003s
I20260709 12:20:11.575344 30294 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:11.595834 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:11.553243 30272 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:11.622185 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 106036us
I20260709 12:20:11.584398 30297 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:11.589752 30246 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:11.593606 30130 raft_consensus.cc:697] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:11.636987 24808 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.604782 30305 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.640242 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.603159 30368 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.641606 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.648546 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:11.651295 24245 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:11.638825 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:11.603101 30173 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:11.652020 24807 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:20:11.656710 24249 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:11.607455 29909 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:11.663652 24779 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:11.670567 24779 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:11.671562 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.672391 24175 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:11.683344 30272 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:11.682927 30130 consensus_queue.cc:237] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:11.684259 30377 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:20:11.685886 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.708180 24808 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:11.662154 30297 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:11.627379 30184 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.649652 30305 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:11.714869 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70208.7us
W20260709 12:20:11.722764 24779 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:11.674844 30221 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:11.662774 30368 raft_consensus.cc:3060] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:11.724691 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:11.695348 30369 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.305s	user 0.001s	sys 0.000s
I20260709 12:20:11.728700 24815 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:20:11.729939 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.738590 24245 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:11.660903 30288 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
W20260709 12:20:11.728943 30374 log.cc:927] Time spent T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
W20260709 12:20:11.741339 24779 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:11.765421 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.745332 30268 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:11.745715 30380 raft_consensus.cc:2764] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
W20260709 12:20:11.746759 30376 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:20:11.687613 30173 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
W20260709 12:20:11.747400 30373 log.cc:927] Time spent T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:20:11.752256 30391 raft_consensus.cc:3055] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:11.754556 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:11.775019 24215 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:11.800009 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 70149.7us
W20260709 12:20:11.811834 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 226396us
I20260709 12:20:11.813097 24141 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:11.802614 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61301.3us
W20260709 12:20:11.814908 24779 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:11.815490 24779 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:11.819360 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 44498.7us
I20260709 12:20:11.820305 24215 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:11.733184 30359 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:11.797757 30224 consensus_meta.cc:287] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.831s	user 0.012s	sys 0.003s
I20260709 12:20:11.847344 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:11.796452 30185 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:11.854457 30201 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:11.855348 30266 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:11.856007 30266 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:11.856613 30266 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.804764 30268 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:11.669481 30307 consensus_queue.cc:237] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:11.806071 30225 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:11.861006 24174 raft_consensus.cc:2410] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:20:11.846119 30287 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:11.809018 30391 raft_consensus.cc:740] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:11.865688 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:11.866509 24142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.002s	sys 0.017s
W20260709 12:20:11.910617 24142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.002s	sys 0.018s
I20260709 12:20:11.851900 30317 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:11.876010 30268 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.881891 30185 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.896667 30287 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.941545 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.946832 24175 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 8.
I20260709 12:20:11.955367 30354 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:11.956040 30354 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:11.956498 30354 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:11.901078 29927 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:11.962260 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60548.6us
I20260709 12:20:11.890478 30173 consensus_queue.cc:1048] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:20:11.875114 30224 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
W20260709 12:20:11.931143 30276 consensus_meta.cc:287] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.797s	user 0.010s	sys 0.007s
W20260709 12:20:11.963248 24214 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 52 similar messages]
I20260709 12:20:11.935791 30288 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:11.936230 30268 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:11.990828 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:11.991873 24175 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:11.940882 30225 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:11.977901 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 78482.1us
I20260709 12:20:11.927491 30393 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:11.958623 30287 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:11.958312 30330 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:12.018275 30391 consensus_queue.cc:260] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.056840 30391 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:12.101203 30375 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:12.102062 30375 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:12.110937 24246 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:12.121479 24092 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4257) took 1200 ms. Trace:
I20260709 12:20:12.122035 24092 rpcz_store.cc:276] 0709 12:20:10.920800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.920968 (+   168us) service_pool.cc:224] Handling call
0709 12:20:10.921364 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.934432 (+ 13068us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.934467 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.936341 (+  1874us) log.cc:844] Serialized 26 byte log entry
0709 12:20:11.399006 (+462665us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18004704a0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:20:11.583994 (+184988us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:11.594484 (+ 10490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:11.594796 (+   312us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.121142 (+526346us) raft_consensus.cc:1685] finished
0709 12:20:12.121168 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.121402 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12662,"raft.queue_time_us":13297,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":109,"spinlock_wait_cycles":24014720,"thread_start_us":184730,"threads_started":1,"wal-append.queue_time_us":1182803}
I20260709 12:20:12.002700 30276 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:11.959405 30185 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.128005 24216 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:12.001538 30360 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:12.138466 24214 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:12.111084 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:12.138289 24216 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:12.125183 30397 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:12.148288 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 301024us
I20260709 12:20:12.156275 24067 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:12.164786 30295 consensus_meta.cc:287] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.041s	user 0.015s	sys 0.000s
W20260709 12:20:12.141505 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 328489us
I20260709 12:20:12.140583 30353 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:20:12.235344 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:12.237129 24781 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:12.199077 24093 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:12.241504 24781 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:12.137679 30203 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:20:12.156801 30184 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.007110 30385 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.494s
I20260709 12:20:12.239147 30295 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:12.138127 30276 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.257076 24175 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:12.052548 30393 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.242290 30173 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:12.269063 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.008s	sys 0.014s
W20260709 12:20:12.252944 30305 consensus_meta.cc:287] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.003s
I20260709 12:20:12.244549 30201 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:12.143478 30360 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.254673 30266 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.255082 30358 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:12.270923 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.008s	sys 0.014s
W20260709 12:20:12.289285 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 133126us
I20260709 12:20:12.291347 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:12.269955 30382 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.168330 30397 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.242851 30353 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:12.140836 30375 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.276700 30184 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:12.277016 30399 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:12.309082 30406 consensus_queue.cc:1048] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:20:12.310108 30393 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.281622 30317 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:12.312412 30402 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:20:12.293656 30225 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:12.313760 30225 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.314155 30225 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:12.316341 30268 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.318634 30268 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.281401 30396 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:12.289628 30224 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:12.312739 30317 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.277084 30173 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.342747 30405 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:12.343508 30405 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:12.343950 30405 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:12.345014 30185 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.347306 30397 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.302268 30353 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:12.271446 30295 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:12.326346 30399 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.363592 30258 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:20:12.364830 30349 consensus_meta.cc:287] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.072s	user 0.009s	sys 0.006s
I20260709 12:20:12.365594 30313 raft_consensus.cc:3055] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:20:12.366008 30340 consensus_meta.cc:287] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.969s	user 0.014s	sys 0.000s
I20260709 12:20:12.280740 30305 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.369216 30260 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:12.369585 30206 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.084s	user 0.016s	sys 0.000s
I20260709 12:20:12.370448 30314 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:12.395069 24779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.025s	sys 0.024s
W20260709 12:20:12.400674 24779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.025s	sys 0.024s
W20260709 12:20:12.388252 30347 consensus_meta.cc:287] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.996s	user 0.005s	sys 0.011s
W20260709 12:20:12.403182 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 255358us
I20260709 12:20:12.406497 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.406678 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:20:12.415882 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 600991us
I20260709 12:20:12.375836 30258 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:12.544482 30258 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.423368 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.381132 30313 raft_consensus.cc:740] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:12.425741 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.547091 24812 raft_consensus.cc:2393] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 15: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:12.371889 30224 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.547220 30313 consensus_queue.cc:260] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.548555 30313 raft_consensus.cc:3060] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:20:12.549575 30224 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.378154 30295 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.304267 30382 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.551851 30295 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.552119 30382 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.371441 30396 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.399801 30260 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.554582 30396 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.554747 30260 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.418238 30314 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.391604 30340 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.556780 30375 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:12.387357 30349 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.402781 30206 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.557300 30314 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.557387 30375 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.558373 24176 raft_consensus.cc:2368] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11.
I20260709 12:20:12.559329 30206 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.426913 30347 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.516505 30359 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:12.525396 30093 consensus_meta.cc:287] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.988s	user 0.011s	sys 0.002s
I20260709 12:20:12.528705 30405 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.562830 30268 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.585418 30268 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.586658 30405 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:12.587240 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 459197us
I20260709 12:20:12.589215 30317 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.557246 30340 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.591141 30173 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.415716 24808 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:12.535912 24807 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:20:12.537395 24815 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:20:12.535230 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:12.530028 30399 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.566905 24247 raft_consensus.cc:1240] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:20:12.598651 24170 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:20:12.599128 24170 pending_rounds.cc:85] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 9
I20260709 12:20:12.599416 24170 pending_rounds.cc:107] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:20:12.599684 24170 raft_consensus.cc:2889] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:12.600468 30409 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.601037 30409 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.586663 30347 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.603531 30268 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.603825 30206 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:12.604161 30380 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.542068 30225 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.543081 30397 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:12.560755 24779 leader_election.cc:336] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:12.559958 30260 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:12.542737 30249 consensus_meta.cc:287] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.270s	user 0.014s	sys 0.006s
I20260709 12:20:12.565009 30375 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.565687 30349 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.565142 30359 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.529965 30276 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.607232 30267 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.591264 30414 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:12.531174 30364 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.490s	user 0.000s	sys 0.012s
I20260709 12:20:12.534186 24093 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
W20260709 12:20:12.592945 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 58350us
I20260709 12:20:12.594587 30391 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:12.566143 30360 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.606891 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 3315) took 1445 ms. Trace:
I20260709 12:20:12.608614 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.608362 30380 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.609295 30268 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:12.609562 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.613952 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:12.562320 30295 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.567499 30314 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.647472 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:12.623245 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:12.607048 30405 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.606864 30340 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:12.589529 24214 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:12.607517 30206 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:12.651060 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61598.6us
I20260709 12:20:12.525509 30184 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:12.632105 30409 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.638538 24174 rpcz_store.cc:276] 0709 12:20:11.152371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.152783 (+   412us) service_pool.cc:224] Handling call
0709 12:20:12.597917 (+1445134us) spinlock_profiling.cc:243] Waited 697 ms on lock 0x7b540016e9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:12.598063 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1604048128}
W20260709 12:20:12.653362 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 92657.6us
I20260709 12:20:12.662225 24246 raft_consensus.cc:1240] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14. Ops: [13.10-13.10]
W20260709 12:20:12.662391 24779 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:12.664886 24214 consensus_peers.cc:597] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:12.666216 30197 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:12.666641 30197 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:12.667647 30197 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.667843 30206 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.668788 30197 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:12.646530 30274 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:12.651502 30295 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.669658 30274 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.632277 30267 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.624025 30249 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.622385 30260 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.639635 30079 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.671700 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.632725 30353 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.637743 30391 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.673012 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.673594 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.674175 24174 raft_consensus.cc:2468] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:12.674786 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.675271 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.675629 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:12.635763 30349 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.621416 30093 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.642468 30358 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:12.683176 24243 raft_consensus.cc:1275] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:12.663961 24167 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:20:12.683074 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.684373 24095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37614 (request call id 4256) took 1774 ms. Trace:
I20260709 12:20:12.684764 24245 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:20:12.692070 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.684823 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:12.629169 30375 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:20:12.623819 30397 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:12.690999 24214 consensus_peers.cc:597] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:12.660966 30347 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:12.693786 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.692369 24095 rpcz_store.cc:276] 0709 12:20:10.909567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.911177 (+  1610us) service_pool.cc:224] Handling call
0709 12:20:10.911535 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:10.911890 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:10.911922 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:10.922959 (+ 11037us) log.cc:844] Serialized 26 byte log entry
0709 12:20:10.968100 (+ 45141us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:10.968162 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:10.968261 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:12.468305 (+1500044us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:20:12.675370 (+207065us) raft_consensus.cc:1685] finished
0709 12:20:12.675395 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.684293 (+  8898us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":19284,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":123,"spinlock_wait_cycles":60187904,"thread_start_us":44647,"threads_started":1,"wal-append.queue_time_us":100773}
W20260709 12:20:12.683511 30287 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.578s	user 0.011s	sys 0.007s
W20260709 12:20:12.697103 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:12.687032 30354 consensus_meta.cc:287] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.730s	user 0.016s	sys 0.000s
W20260709 12:20:12.698498 24214 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:12.690814 30360 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:12.701905 30267 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:12.735314 30419 log.cc:927] Time spent T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:20:12.736848 30274 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:12.688391 30368 consensus_meta.cc:287] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.959s	user 0.015s	sys 0.004s
I20260709 12:20:12.737807 30368 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.691484 30413 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:12.727759 30287 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.707093 30391 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.708324 30359 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:12.708760 30418 log.cc:927] Time spent T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:20:12.711942 30249 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.714162 30260 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.723088 24243 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260709 12:20:12.637789 30414 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:12.732637 24214 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:12.695709 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 81151.6us
I20260709 12:20:12.691291 30415 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 12:20:12.704293 24174 raft_consensus.cc:2410] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:20:12.756234 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.756899 24174 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:20:12.650401 30314 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.757604 30415 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:20:12.758147 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.687656 30305 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.676831 30405 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.756801 24066 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:12.759815 24174 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:20:12.760352 30305 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:12.760898 30305 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:12.760972 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.762226 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:12.761972 30305 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.762360 30405 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.762775 24174 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:12.660846 30340 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.764421 24169 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:12.765853 30340 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:12.759420 24214 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:12.687674 30349 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:12.768714 24214 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:12.775585 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.775611 24809 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:20:12.776364 24814 raft_consensus.cc:2468] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 18.
I20260709 12:20:12.783387 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.789551 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.790922 24066 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:12.788408 24812 raft_consensus.cc:2468] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:20:12.794863 24174 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 18.
I20260709 12:20:12.695438 30358 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.790521 24809 raft_consensus.cc:2468] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:12.802611 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.803229 24808 raft_consensus.cc:2468] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:12.804020 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.805819 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:12.807075 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 121332us
I20260709 12:20:12.808707 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.739501 30413 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:12.804613 24815 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:12.746464 30360 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:12.793509 30267 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:12.817675 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:12.804191 30295 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.834517 24241 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:20:12.835080 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.801445 30314 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:12.823383 24214 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:12.838742 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:12.840602 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:12.845643 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:12.822777 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.825744 30414 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.827710 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:12.829066 30360 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.740557 30354 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:12.844172 24214 consensus_peers.cc:597] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:12.829335 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.830487 30422 raft_consensus.cc:2804] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:12.799901 30411 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:20:12.853258 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.852970 24249 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:12.860018 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:12.904102 24171 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:12.905227 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 58897.4us
W20260709 12:20:12.906237 24214 consensus_peers.cc:597] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:12.906900 24214 consensus_peers.cc:597] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:12.907097 30287 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:12.907579 24214 consensus_peers.cc:597] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:12.909077 24214 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:12.859584 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:12.911139 24808 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:12.915586 30397 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.915896 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.916625 24174 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:12.917320 30358 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.917619 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.917925 30358 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:12.919572 30353 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:12.920140 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:12.920799 24173 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:12.920517 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.921422 24168 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:12.922385 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:12.923476 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:12.924840 24168 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 17. Current term is 18. Ops: []
I20260709 12:20:12.927955 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2095) took 1159 ms. Trace:
I20260709 12:20:12.928355 30380 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.928532 24175 rpcz_store.cc:276] 0709 12:20:11.768162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.271871 (+503709us) service_pool.cc:224] Handling call
0709 12:20:12.281984 (+ 10113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:12.555448 (+273464us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.555482 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:12.555529 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:12.555570 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:12.927718 (+372148us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54002567d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:12.927766 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:12.927889 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":627825920}
I20260709 12:20:12.927974 24806 raft_consensus.cc:1275] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:20:12.933199 30328 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:12.935729 24167 raft_consensus.cc:1275] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:20:12.936431 24249 raft_consensus.cc:1240] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:20:12.936923 24167 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:12.938186 24167 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:20:12.939420 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:12.940717 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:12.941327 24245 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
I20260709 12:20:12.943419 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:12.904372 24810 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 9: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:12.956952 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:12.957779 24174 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:12.820696 30093 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:12.918473 30358 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.011327 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:13.012494 24167 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
W20260709 12:20:13.015946 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 70627.8us
W20260709 12:20:13.016672 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 57573.4us
I20260709 12:20:12.840160 30412 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:13.021595 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.017663 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:13.022964 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.018368 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.025224 24810 raft_consensus.cc:2393] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:13.024356 24067 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:13.026129 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:12.952003 30422 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.015714 24066 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:13.030845 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:13.032001 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:13.027235 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:13.018646 24808 raft_consensus.cc:2468] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:13.028842 24806 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:13.034469 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.036228 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 3312) took 1884 ms. Trace:
I20260709 12:20:12.832340 30267 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:13.045992 24243 raft_consensus.cc:2410] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:20:12.982376 30360 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.046591 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:13.036645 24172 rpcz_store.cc:276] 0709 12:20:11.151487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.171700 (+ 20213us) service_pool.cc:224] Handling call
0709 12:20:11.209767 (+ 38067us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:11.626548 (+416781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:11.626584 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:11.644811 (+ 18227us) log.cc:844] Serialized 26 byte log entry
0709 12:20:11.906463 (+261652us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:11.906501 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.027518 (+1121017us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b5400199e54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:13.027587 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.027641 (+    54us) raft_consensus.cc:1685] finished
0709 12:20:13.027654 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.036150 (+  8496us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":78699,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":8724,"spinlock_wait_cycles":95580032,"thread_start_us":570082,"threads_started":2,"wal-append.queue_time_us":472187}
I20260709 12:20:13.042668 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:13.051537 24214 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.039276 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:13.057176 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:13.057950 24250 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.059441 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.060176 24241 raft_consensus.cc:2468] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:20:13.062469 24172 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 12:20:13.066092 24214 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:13.066601 24171 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 18.
I20260709 12:20:13.041965 24808 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:20:13.073467 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:13.093227 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.029841 30314 raft_consensus.cc:2804] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:13.099560 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:13.101557 24247 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 3390) took 1462 ms. Trace:
I20260709 12:20:12.932269 30347 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.098s
I20260709 12:20:13.045192 30184 raft_consensus.cc:2804] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:13.094449 24810 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 15: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:20:13.076323 24214 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:13.036149 30414 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:13.105580 24806 raft_consensus.cc:1275] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:20:13.040509 30412 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.107017 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.116973 30412 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:13.117180 24241 raft_consensus.cc:2368] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16.
I20260709 12:20:13.117653 30412 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:13.118333 30412 consensus_queue.cc:1243] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer 5d0f174a97494d0cbf08ae81ec4c807a log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:20:13.040040 30422 raft_consensus.cc:3060] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:13.118423 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.120735 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.057843 30276 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.122660 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:13.025404 29927 consensus_queue.cc:1059] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 12:20:13.123329 30276 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.021052 30308 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:20:13.124025 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.125329 30308 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:13.125902 30308 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:13.127543 24241 raft_consensus.cc:1240] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:13.127954 30411 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:13.128592 30267 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:13.101999 24247 rpcz_store.cc:276] 0709 12:20:11.639759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.641527 (+  1768us) service_pool.cc:224] Handling call
0709 12:20:11.682508 (+ 40981us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.598345 (+915837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.101260 (+502915us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54000604d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:13.101486 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2032844160}
I20260709 12:20:13.058866 30375 raft_consensus.cc:2804] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:13.108503 24216 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:13.058676 30295 raft_consensus.cc:2804] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:13.137462 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:13.093046 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.138787 24242 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:13.059154 30409 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:13.068765 30268 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:13.067876 30185 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:13.130427 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 54149.4us
I20260709 12:20:13.137203 30295 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:13.043220 30093 consensus_queue.cc:1048] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:20:13.135247 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.130113 30184 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.126684 30276 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:13.148211 24214 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:13.148494 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:13.163897 24214 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:13.164644 24214 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:13.165351 24214 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:13.043998 30331 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.092s
I20260709 12:20:13.105353 30314 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:13.105154 30079 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:13.168706 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:13.145447 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 212089us
I20260709 12:20:13.128532 30411 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.124051 29927 raft_consensus.cc:3055] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:13.158532 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.174772 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:13.070356 30360 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:13.133972 30375 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:13.150442 30268 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.098964 30297 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.058s
I20260709 12:20:13.170468 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:13.146088 30409 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.154300 29853 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:13.175365 24242 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:20:13.126863 30308 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:13.157485 30295 raft_consensus.cc:3060] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:13.186015 24216 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:13.187628 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.163194 30184 raft_consensus.cc:3060] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:13.200698 24173 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:20:13.168677 30349 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:13.187568 30203 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:13.145826 30381 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:20:13.208642 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.171970 30079 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:13.258718 24241 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:13.262179 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:13.262844 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 360679us
I20260709 12:20:13.246819 24168 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:13.174823 29927 raft_consensus.cc:740] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:13.215042 24245 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 17.
I20260709 12:20:13.191900 30375 raft_consensus.cc:3060] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.157016 30185 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:13.173300 30314 raft_consensus.cc:3060] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:13.251742 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.252235 30353 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:13.194518 30268 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:13.185565 30272 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:13.206174 30409 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:13.300984 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 281254us
I20260709 12:20:13.265909 24780 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:13.213181 30347 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:20:13.260677 30079 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:13.288201 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:13.216821 24216 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:13.325351 30305 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.326267 30305 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.329545 30305 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:13.334317 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:13.339879 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 123209us
I20260709 12:20:13.284008 30353 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:13.344525 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 305307us
I20260709 12:20:13.356118 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 3396) took 2227 ms. Trace:
I20260709 12:20:13.356734 24248 rpcz_store.cc:276] 0709 12:20:11.108625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.108764 (+   139us) service_pool.cc:224] Handling call
0709 12:20:11.109196 (+   432us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:11.390513 (+281317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.335578 (+1945065us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54003d7f54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:13.335899 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":440969088}
I20260709 12:20:13.345362 24247 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 15: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:13.289917 30272 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.358210 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:13.371459 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 200471us
I20260709 12:20:13.372201 24242 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:13.378623 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:13.385943 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 83400.1us
W20260709 12:20:13.386786 24140 consensus_peers.cc:597] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.377334 24781 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:13.392995 24067 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:13.363306 30353 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:13.358886 30392 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:13.370016 30272 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:13.410403 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.370054 30358 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:13.390477 30437 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.365221 29853 consensus_queue.cc:1048] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:20:13.453944 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:13.382136 30313 consensus_meta.cc:287] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.006s
I20260709 12:20:13.376252 30305 raft_consensus.cc:3060] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.364989 30274 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 12:20:13.408787 30414 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:13.441089 24250 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:20:13.403030 24067 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:13.377945 30128 consensus_queue.cc:1059] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:20:13.466401 24172 raft_consensus.cc:1275] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
W20260709 12:20:13.463850 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 115602us
I20260709 12:20:13.467242 30276 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:13.467042 24172 pending_rounds.cc:85] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 7
I20260709 12:20:13.467806 24172 pending_rounds.cc:107] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:20:13.468146 24172 raft_consensus.cc:2889] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:13.457780 30437 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.457990 24242 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 19: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:13.442608 30093 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:13.474104 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 208239us
I20260709 12:20:13.480552 24141 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:13.481710 30313 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:13.480829 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.487305 30313 consensus_queue.cc:1048] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:13.488735 24141 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:13.490003 30313 raft_consensus.cc:2804] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:13.490935 30328 consensus_queue.cc:1048] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:13.492717 30313 raft_consensus.cc:697] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:13.504969 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 102091us
I20260709 12:20:13.506299 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:13.507375 24141 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:13.391276 29927 consensus_queue.cc:260] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:13.465199 30414 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:13.515974 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.513860 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:13.496696 30313 consensus_queue.cc:237] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:13.532918 24216 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:13.457597 30436 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:20:13.516773 30274 raft_consensus.cc:3055] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:13.596933 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.513967 30358 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:20:13.581647 30426 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.336s	user 0.002s	sys 0.000s
I20260709 12:20:13.595249 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.516255 30411 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:13.528031 30328 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:13.502858 30093 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.525187 30414 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:13.608507 24248 raft_consensus.cc:2393] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 11: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:13.609131 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:13.623374 24808 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:13.618765 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:13.585985 30263 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:13.579523 29855 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:13.637806 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.524444 30330 consensus_queue.cc:1059] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:20:13.594072 30340 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.516484 30276 consensus_queue.cc:1059] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.089s
I20260709 12:20:13.634757 24247 raft_consensus.cc:2393] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 19: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:13.517055 30297 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:13.597939 30260 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.593466 30440 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:13.641149 24175 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.005s	sys 0.033s
W20260709 12:20:13.675741 24175 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.006s	sys 0.033s
I20260709 12:20:13.610409 30360 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:13.608804 30274 raft_consensus.cc:740] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:13.617837 30358 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:13.672887 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:13.642769 30431 log.cc:927] Time spent T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 12:20:13.631844 30136 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.649788 30443 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:13.645416 30452 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:20:13.711853 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 334608us
I20260709 12:20:13.664315 30297 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:13.709707 30433 log.cc:927] Time spent T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260709 12:20:13.682829 30437 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:13.722345 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 3405) took 1025 ms. Trace:
I20260709 12:20:13.663857 30347 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:13.702507 30429 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260709 12:20:13.702495 30430 log.cc:927] Time spent T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.329s	user 0.001s	sys 0.000s
I20260709 12:20:13.675971 30392 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.643843 30263 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.725140 24244 rpcz_store.cc:276] 0709 12:20:12.697384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.705735 (+  8351us) service_pool.cc:224] Handling call
0709 12:20:12.744761 (+ 39026us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.749747 (+  4986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.749784 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.750321 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:20:13.027785 (+277464us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:13.027828 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.027906 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.722060 (+694154us) raft_consensus.cc:1685] finished
0709 12:20:13.722088 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.722269 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":194,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":4957,"thread_start_us":220479,"threads_started":1,"wal-append.queue_time_us":379205}
I20260709 12:20:13.702186 30443 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:13.664966 30340 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:13.741681 30263 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:13.720885 30436 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.723011 30297 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:13.780177 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.724592 30452 raft_consensus.cc:697] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:13.792519 30450 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:13.688308 30260 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.752305 30443 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:13.705323 30136 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.808223 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.804522 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.834293 24808 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:20:13.843060 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.697691 30440 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.799497 30450 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.844758 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.747831 30392 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:13.851445 30434 log.cc:927] Time spent T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:20:13.777271 30328 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:13.877324 30288 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:13.877883 30288 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:13.877982 30328 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.881479 30440 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:13.881922 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:13.882608 24810 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:13.884701 30450 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:13.887707 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 3318) took 1285 ms. Trace:
I20260709 12:20:13.888082 24169 rpcz_store.cc:276] 0709 12:20:12.601965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.604738 (+  2773us) service_pool.cc:224] Handling call
0709 12:20:13.887508 (+1282770us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54003e99d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:13.887640 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286923008}
W20260709 12:20:13.889102 24093 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37614 (request call id 4251) took 3037 ms (client timeout 2985 ms). Trace:
W20260709 12:20:13.889560 24093 rpcz_store.cc:269] 0709 12:20:10.851933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:10.854877 (+  2944us) service_pool.cc:224] Handling call
0709 12:20:13.888857 (+3033980us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54002d73d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:13.888971 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3054338816}
W20260709 12:20:13.891008 24140 consensus_peers.cc:597] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:13.891438 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 504035us
W20260709 12:20:13.892053 24140 consensus_peers.cc:597] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:13.893059 24140 consensus_peers.cc:597] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:13.893680 24140 consensus_peers.cc:597] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:13.894273 24140 consensus_peers.cc:597] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:13.898562 30448 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:13.899278 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:13.899237 30448 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.900102 24815 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:20:13.901062 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:13.901820 30448 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:13.906785 30451 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:20:13.908023 30455 log.cc:927] Time spent T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:20:13.908244 24813 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 915) took 1070 ms. Trace:
I20260709 12:20:13.908630 24813 rpcz_store.cc:276] 0709 12:20:12.837794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.891616 (+ 53822us) service_pool.cc:224] Handling call
0709 12:20:12.892207 (+   591us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:13.250433 (+358226us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.250492 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.254149 (+  3657us) log.cc:844] Serialized 26 byte log entry
0709 12:20:13.533470 (+279321us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:13.533518 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.533591 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.907997 (+374406us) raft_consensus.cc:1685] finished
0709 12:20:13.908026 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.908178 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41692,"raft.queue_time_us":360976,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5935,"thread_start_us":463779,"threads_started":2,"wal-append.queue_time_us":368949}
I20260709 12:20:13.910085 30288 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:13.911988 24815 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:13.912705 30093 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:13.913537 24810 raft_consensus.cc:2468] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:20:13.745800 30347 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:13.854106 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:13.864192 24809 raft_consensus.cc:2393] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 14: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:13.788373 30446 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260709 12:20:13.811390 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:13.926059 24140 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:13.875905 30428 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.286s	user 0.001s	sys 0.000s
I20260709 12:20:13.806499 30358 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:13.798884 30436 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:13.946640 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:13.953483 24140 consensus_peers.cc:597] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:13.976286 24140 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:13.980129 24174 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.002s	sys 0.009s
W20260709 12:20:13.980576 24174 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.002s	sys 0.009s
I20260709 12:20:13.981527 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 3329) took 1245 ms. Trace:
I20260709 12:20:13.976969 24140 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:13.981916 24174 rpcz_store.cc:276] 0709 12:20:12.736141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.982660 (+246519us) service_pool.cc:224] Handling call
0709 12:20:12.983086 (+   426us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:13.015986 (+ 32900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:13.016024 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:13.040357 (+ 24333us) log.cc:844] Serialized 26 byte log entry
0709 12:20:13.389492 (+349135us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:20:13.980944 (+591452us) log.cc:844] Serialized 14 byte log entry
0709 12:20:13.981193 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.981274 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:13.981318 (+    44us) raft_consensus.cc:1685] finished
0709 12:20:13.981329 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:13.981464 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33424,"raft.queue_time_us":33576,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":14557,"thread_start_us":775589,"threads_started":2,"wal-append.queue_time_us":679231}
I20260709 12:20:13.998939 30465 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:13.999835 30465 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.002193 30465 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:14.004140 30454 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:14.006240 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:14.006958 24241 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:14.007282 30340 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.008028 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:14.016297 30260 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.019096 30136 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.022274 30347 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.029527 24815 raft_consensus.cc:1275] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:14.002774 30465 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:14.033676 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 390627us
I20260709 12:20:14.034627 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:14.039649 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:14.041038 24140 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:14.068152 30197 consensus_meta.cc:287] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 1.399s	user 0.015s	sys 0.003s
I20260709 12:20:14.069908 29855 raft_consensus.cc:3055] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:14.070392 29855 raft_consensus.cc:740] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:20:14.070822 30422 consensus_meta.cc:287] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.952s	user 0.010s	sys 0.003s
I20260709 12:20:14.073453 24241 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 15.
W20260709 12:20:14.074848 24214 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:14.079304 24214 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:14.082322 30288 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.084584 30414 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:14.086120 24172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2103) took 1076 ms. Trace:
W20260709 12:20:14.080214 24214 consensus_peers.cc:597] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:14.086520 24172 rpcz_store.cc:276] 0709 12:20:13.009838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.065365 (+ 55527us) service_pool.cc:224] Handling call
0709 12:20:13.065642 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.468806 (+403164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.085848 (+617042us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b540019a354. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:14.086046 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920636160}
W20260709 12:20:14.094491 24779 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.064s	sys 0.060s
W20260709 12:20:14.095026 24779 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.064s	sys 0.060s
W20260709 12:20:14.095348 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 589919us
W20260709 12:20:14.096331 24779 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:14.110384 24779 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:14.114148 24814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33926 (request call id 988) took 1332 ms. Trace:
I20260709 12:20:14.068951 30313 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:14.117144 29855 consensus_queue.cc:260] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.130474 29855 raft_consensus.cc:3060] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:14.131028 30470 consensus_queue.cc:1048] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:20:14.132824 30221 raft_consensus.cc:3055] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:14.117380 30347 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:14.133317 30221 raft_consensus.cc:740] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:14.135493 30436 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:14.136471 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:14.114626 24814 rpcz_store.cc:276] 0709 12:20:12.781980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.784111 (+  2131us) service_pool.cc:224] Handling call
0709 12:20:12.784580 (+   469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.785116 (+   536us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.785158 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.800666 (+ 15508us) log.cc:844] Serialized 26 byte log entry
0709 12:20:13.267258 (+466592us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:20:13.267304 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.267384 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.113873 (+846489us) raft_consensus.cc:1685] finished
0709 12:20:14.113900 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.114076 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":710,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":6085,"thread_start_us":446587,"threads_started":1,"wal-append.queue_time_us":661262}
W20260709 12:20:14.138198 24214 consensus_peers.cc:597] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:14.142287 24214 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:14.137879 24215 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:20:14.140228 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 100698us
I20260709 12:20:14.071353 30422 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:14.149299 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 108316us
I20260709 12:20:14.149556 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:14.150578 24140 consensus_peers.cc:597] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:14.151713 24140 consensus_peers.cc:597] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:14.073045 30330 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:14.151126 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.147684 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:14.148672 24175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59344 (request call id 3323) took 1539 ms. Trace:
I20260709 12:20:14.151943 24215 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:14.146716 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:14.134260 30221 consensus_queue.cc:260] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:14.153162 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:14.156862 24214 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:14.158804 24140 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:14.154742 24175 rpcz_store.cc:276] 0709 12:20:12.608974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.930146 (+321172us) service_pool.cc:224] Handling call
0709 12:20:12.930488 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:12.985449 (+ 54961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.985511 (+    62us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:12.986196 (+   685us) log.cc:844] Serialized 26 byte log entry
0709 12:20:13.676254 (+690058us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:13.676313 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:13.676399 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.148345 (+471946us) raft_consensus.cc:1685] finished
0709 12:20:14.148385 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.148588 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62618,"raft.queue_time_us":76938,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":10454,"thread_start_us":618700,"threads_started":1,"wal-append.queue_time_us":904453}
I20260709 12:20:14.160689 24814 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:13.941114 30452 consensus_queue.cc:237] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.155416 30197 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:14.159348 30079 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.794s	user 0.012s	sys 0.003s
I20260709 12:20:14.177079 30458 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:14.177292 30184 consensus_meta.cc:287] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.920s	user 0.007s	sys 0.008s
I20260709 12:20:14.183908 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:14.184479 29927 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:14.157756 30288 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:14.165319 30340 consensus_queue.cc:1059] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 12:20:14.196621 24215 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:14.222349 24215 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:14.222518 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:14.211342 30184 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.239143 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:14.240146 24241 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 14: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:14.235179 30458 raft_consensus.cc:2804] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:20:14.236380 30268 consensus_meta.cc:287] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.946s	user 0.011s	sys 0.004s
I20260709 12:20:14.238662 30443 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.251137 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:14.255834 24244 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
W20260709 12:20:14.257128 30295 consensus_meta.cc:287] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.000s	user 0.012s	sys 0.003s
W20260709 12:20:14.251690 30353 consensus_meta.cc:287] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.807s	user 0.012s	sys 0.001s
I20260709 12:20:14.257603 30422 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.258481 30458 raft_consensus.cc:697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:14.258169 30353 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.259297 30414 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.259632 30458 consensus_queue.cc:237] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.260828 30353 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.261881 24242 raft_consensus.cc:1240] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:20:14.262817 30258 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:14.252946 24241 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 12:20:14.255076 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:14.269104 30409 consensus_meta.cc:287] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.918s	user 0.011s	sys 0.004s
I20260709 12:20:14.269583 30409 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.252570 30197 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:20:14.257644 30295 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:14.276253 30375 consensus_meta.cc:287] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.990s	user 0.016s	sys 0.000s
I20260709 12:20:14.276820 30375 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.278403 30295 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.267685 30268 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:14.292392 30305 consensus_meta.cc:287] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.821s	user 0.013s	sys 0.002s
I20260709 12:20:14.292972 30305 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:14.203323 30079 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:14.296949 24170 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:14.297678 30288 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.298210 30288 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.299787 30354 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.302497 30368 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.281316 30330 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:14.239234 30184 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.312166 24808 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
W20260709 12:20:14.314620 24214 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:14.319907 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:14.313180 30185 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:14.323463 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:14.344669 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:14.373674 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50320.8us
W20260709 12:20:14.367314 24214 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:14.317243 30379 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.015s	sys 0.001s
W20260709 12:20:14.334901 30272 consensus_meta.cc:287] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.885s	user 0.013s	sys 0.002s
I20260709 12:20:14.380681 30468 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:14.303766 30330 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.376147 30399 raft_consensus.cc:2764] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:20:14.385768 30469 consensus_queue.cc:1059] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
W20260709 12:20:14.380105 30297 consensus_meta.cc:287] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.000s
W20260709 12:20:14.383549 30379 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.016s	sys 0.001s
I20260709 12:20:14.388332 30468 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:14.415377 30468 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:14.416263 30314 consensus_meta.cc:287] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 1.128s	user 0.014s	sys 0.001s
I20260709 12:20:14.374456 30375 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.416766 30314 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:14.393332 24214 consensus_peers.cc:597] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:14.428704 24214 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:14.393056 30272 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:14.442168 24214 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:14.428854 30314 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.442689 24214 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:14.399725 30297 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:14.452421 24249 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 17: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:14.444080 30409 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:14.465013 24243 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40978 (request call id 3411) took 1528 ms (client timeout 1906 ms). Trace:
I20260709 12:20:14.451347 30406 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:14.465528 24243 rpcz_store.cc:269] 0709 12:20:12.936944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.943160 (+  6216us) service_pool.cc:224] Handling call
0709 12:20:14.464797 (+1521637us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540035a7d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:14.464947 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":233518976}
I20260709 12:20:14.472656 30413 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:14.474792 30184 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:14.475533 30184 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:14.478801 30409 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.479415 30409 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:14.483690 24243 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:14.459856 30268 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.478062 30184 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.463711 30469 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:14.464656 30314 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.501231 30380 raft_consensus.cc:3055] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:14.501834 30380 raft_consensus.cc:740] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:14.506624 30484 log.cc:927] Time spent T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:20:14.509527 30409 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.489428 30443 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:14.519755 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:14.523006 24811 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:14.538977 30297 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.539204 30272 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:14.508074 30314 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.542615 30358 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:14.571386 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:14.571732 24811 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:20:14.547326 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:14.575923 24813 raft_consensus.cc:2410] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:14.548962 30225 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:14.551419 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:14.579340 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:14.579855 30330 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.580114 24810 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:14.552206 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:14.552592 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:14.552940 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:14.581236 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:14.499818 30469 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:14.555708 30288 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.556560 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:14.557257 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:14.557309 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:14.558145 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:14.558518 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:14.558883 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:14.559657 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40990 (request call id 3404) took 1397 ms. Trace:
I20260709 12:20:14.561028 24167 pending_rounds.cc:85] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 8
I20260709 12:20:14.558175 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:14.562134 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:14.502815 30380 consensus_queue.cc:260] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.568403 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:14.569406 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:14.572880 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:20:14.574167 24140 consensus_peers.cc:597] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:14.542932 30314 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:14.577031 24243 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:20:15.255487 30358 consensus_meta.cc:287] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.000s
I20260709 12:20:15.258011 30452 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:14.598191 30357 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:15.262238 30452 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.262455 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:15.244361 30250 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:15.263661 24241 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 16: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:15.264050 30250 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.264734 30452 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.963006 24066 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:15.265527 30452 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.266220 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 314597us
I20260709 12:20:14.633445 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:15.267282 24066 leader_election.cc:400] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16.
I20260709 12:20:15.145555 30354 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:14.666715 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:14.879386 24808 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33922 (request call id 927) took 1290 ms. Trace:
I20260709 12:20:15.266458 30452 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.268224 30354 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:14.707727 30445 log.cc:927] Time spent T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 1.119s	user 0.008s	sys 0.004s
I20260709 12:20:15.269397 24172 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:15.288369 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.289218 30221 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:15.292326 30379 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.293100 30379 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.702662 30468 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:14.586095 30184 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:14.597975 24175 raft_consensus.cc:3060] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:15.297262 30184 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.299024 30079 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.309346 30379 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:15.311973 23995 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 18 to 17, leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 17 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:15.315598 23995 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: config changed from index 9 to 10, term changed from 11 to 12, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to <none>, VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) evicted. New cstate: current_term: 12 committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:15.317659 23995 catalog_manager.cc:5697] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:20:15.319133 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.320216 23995 catalog_manager.cc:5697] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 14 to 15, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 15 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:15.323894 24245 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 1250) took 1685 ms. Trace:
I20260709 12:20:15.324525 24245 rpcz_store.cc:276] 0709 12:20:13.638058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.880146 (+242088us) service_pool.cc:224] Handling call
0709 12:20:14.464915 (+584769us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.465181 (+   266us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:14.478238 (+ 13057us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.576903 (+ 98665us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.577644 (+   741us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:14.580821 (+  3177us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:14.580891 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.580977 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.296900 (+715923us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b1800306340. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:20:15.319576 (+ 22676us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b1800306340. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4
0709 12:20:15.320246 (+   670us) spinlock_profiling.cc:243] Waited 5.88 ms on lock 0x7b1800306340. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e522 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:20:15.323631 (+  3385us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540035a7d0. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557a8ad 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:15.323798 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12637,"prepare.queue_time_us":14127,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":1094,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":1219,"spinlock_wait_cycles":1505331328,"thread_start_us":96836,"threads_started":1}
I20260709 12:20:15.323292 23995 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 16 to 18, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 18 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:15.328330 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:15.270695 30314 raft_consensus.cc:2804] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:15.330785 30314 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.331036 24244 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:15.331350 30314 raft_consensus.cc:3060] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:15.266330 24167 pending_rounds.cc:107] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:20:15.332430 24167 raft_consensus.cc:2889] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:15.332818 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:15.333601 24811 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 11.
I20260709 12:20:15.335400 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:15.270469 30452 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.267660 24066 leader_election.cc:403] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:20:15.336038 24811 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
W20260709 12:20:15.336964 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69840.5us
I20260709 12:20:15.337167 24171 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:15.268635 24808 rpcz_store.cc:276] 0709 12:20:13.588937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.844314 (+255377us) service_pool.cc:224] Handling call
0709 12:20:14.879088 (+1034774us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400a140d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:14.879280 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1023479680}
I20260709 12:20:15.265960 24814 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:14.950817 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:59766 (request call id 1248) took 1356 ms. Trace:
I20260709 12:20:14.723308 24246 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 3401) took 2045 ms. Trace:
I20260709 12:20:15.272821 30359 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:15.270927 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 1.10865e+06us
W20260709 12:20:15.341827 24140 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.345719 24813 raft_consensus.cc:1240] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: []
W20260709 12:20:15.346813 24140 consensus_peers.cc:597] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:15.264662 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:15.262816 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:15.268638 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:15.273352 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:14.682752 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.274657 24173 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
W20260709 12:20:15.355002 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.275370 24249 rpcz_store.cc:276] 0709 12:20:13.161872 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.162026 (+   154us) service_pool.cc:224] Handling call
0709 12:20:14.559441 (+1397415us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003ab954. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:14.559593 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2771139328}
W20260709 12:20:15.355815 24140 consensus_peers.cc:597] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:15.358497 24140 consensus_peers.cc:597] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:15.278235 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.274108 30250 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:15.365111 24174 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
W20260709 12:20:14.697124 30426 log.cc:927] Time spent T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:20:14.712879 24815 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 928) took 1109 ms. Trace:
I20260709 12:20:14.578486 30375 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.392359 24067 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.007s
W20260709 12:20:15.392843 24067 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.007s	sys 0.007s
W20260709 12:20:15.393194 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 521938us
I20260709 12:20:15.395639 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:15.280373 30380 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:14.677763 30390 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.278848 30274 consensus_queue.cc:260] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:15.282733 24176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 3309) took 4139 ms (client timeout 1987 ms). Trace:
I20260709 12:20:15.270143 30357 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.285024 30392 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:15.328657 23998 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 310) took 7008 ms. Trace:
I20260709 12:20:15.403710 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:15.404608 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:15.329181 23995 catalog_manager.cc:5697] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 13 to 15, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 15 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:20:15.339231 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:15.406713 24814 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:15.387787 30206 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:14.716969 24170 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 3327) took 2072 ms (client timeout 1968 ms). Trace:
I20260709 12:20:14.661087 30331 raft_consensus.cc:3055] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:15.347929 24811 raft_consensus.cc:1275] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:15.312896 24175 raft_consensus.cc:2468] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 9.
I20260709 12:20:14.721179 30469 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:14.597790 30266 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:15.276208 24242 raft_consensus.cc:2468] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
I20260709 12:20:15.358937 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:15.415357 24808 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:15.360886 24813 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:20:15.361503 24172 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
W20260709 12:20:15.361979 24169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.021s	sys 0.058s
W20260709 12:20:15.416473 24169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.021s	sys 0.058s
I20260709 12:20:14.584823 30409 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:15.360797 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:15.372463 24141 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.022s
I20260709 12:20:14.584530 30268 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.375092 24815 rpcz_store.cc:276] 0709 12:20:13.603390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.913094 (+309704us) service_pool.cc:224] Handling call
0709 12:20:13.913405 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:14.030124 (+116719us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.712425 (+682301us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b54009d3354. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:14.712747 (+   322us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190671744}
I20260709 12:20:15.379983 24780 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:15.363137 24140 leader_election.cc:336] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.404134 23998 rpcz_store.cc:276] 0709 12:20:08.362684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:08.369541 (+  6857us) service_pool.cc:224] Handling call
0709 12:20:15.328575 (+6959034us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:09.270315 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:09.447431 (+177116us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:09.447494 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:20:09.447524 (+    30us) tablet.cc:662] Decoding operations
0709 12:20:09.448403 (+   879us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:09.448512 (+   109us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:09.448543 (+    31us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:20:09.449129 (+   586us) tablet.cc:701] Row locks acquired
0709 12:20:09.449188 (+    59us) write_op.cc:260] PREPARE: finished
0709 12:20:09.449396 (+   208us) write_op.cc:270] Start()
0709 12:20:09.449574 (+   178us) write_op.cc:276] Timestamp: P: 1783599609449320 usec, L: 0
0709 12:20:09.449614 (+    40us) op_driver.cc:348] REPLICATION: starting
0709 12:20:09.450540 (+   926us) log.cc:844] Serialized 1774 byte log entry
0709 12:20:09.795577 (+345037us) op_driver.cc:464] REPLICATION: finished
0709 12:20:10.034886 (+239309us) write_op.cc:301] APPLY: starting
0709 12:20:10.046769 (+ 11883us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:10.100420 (+ 53651us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:10.100585 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:10.260677 (+160092us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:10.260999 (+   322us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:20:10.261062 (+    63us) write_op.cc:312] APPLY: finished
0709 12:20:10.261435 (+   373us) log.cc:844] Serialized 49 byte log entry
0709 12:20:10.261677 (+   242us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:10.261808 (+   131us) write_op.cc:454] Released schema lock
0709 12:20:10.261870 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:10.262367 (+   497us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:10.262396 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":227120,"apply.run_cpu_time_us":9760,"apply.run_wall_time_us":230053,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20855,"num_ops":4,"prepare.queue_time_us":220528,"prepare.run_cpu_time_us":32052,"prepare.run_wall_time_us":311683,"raft.queue_time_us":134364,"raft.run_cpu_time_us":34883,"raft.run_wall_time_us":198559,"replication_time_us":345724,"thread_start_us":509526,"threads_started":4,"wal-append.queue_time_us":114351,"wal-append.run_cpu_time_us":36532,"wal-append.run_wall_time_us":1827273}]]}
I20260709 12:20:15.381112 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:15.340685 24246 rpcz_store.cc:276] 0709 12:20:12.677837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.678053 (+   216us) service_pool.cc:224] Handling call
0709 12:20:12.678473 (+   420us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:12.803619 (+125146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:12.803654 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:12.808972 (+  5318us) log.cc:844] Serialized 52 byte log entry
0709 12:20:13.163778 (+354806us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:20:13.183715 (+ 19937us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.449220 (+1265505us) spinlock_profiling.cc:243] Waited 5.71 ms on lock 0x7b1800267580. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02408c0a 00007f4c0bb48219 00007f4c02490a40 00007f4c0248b4e4 00007f4c0248b455 00007f4c08f733c7 00007f4c055859a7 00007f4c055950bf 00007f4c05595038
0709 12:20:14.449444 (+   224us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.449729 (+   285us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.563328 (+113599us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800267580. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:20:14.580172 (+ 16844us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b1800267580. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:20:14.722761 (+142589us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400059954. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:14.722850 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:14.722930 (+    80us) raft_consensus.cc:1685] finished
0709 12:20:14.722949 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.723207 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1210369,"prepare.queue_time_us":1290687,"prepare.run_cpu_time_us":109,"prepare.run_wall_time_us":112,"raft.queue_time_us":3835,"raft.run_cpu_time_us":382,"raft.run_wall_time_us":7740,"spinlock_wait_cycles":313696512,"thread_start_us":336186,"threads_started":1,"wal-append.queue_time_us":469737}
I20260709 12:20:15.296777 30468 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:15.386741 24215 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:15.339116 30354 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:15.351063 30267 raft_consensus.cc:3060] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:20:15.389756 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:15.398430 24243 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 17: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:20:15.399783 24176 rpcz_store.cc:269] 0709 12:20:11.143319 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:11.143438 (+   119us) service_pool.cc:224] Handling call
0709 12:20:15.282476 (+4139038us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b54002aeed4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:15.282628 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3247240448}
I20260709 12:20:15.382894 30452 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:15.407924 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 68775.7us
I20260709 12:20:15.338193 24250 rpcz_store.cc:276] 0709 12:20:13.594708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.598233 (+  3525us) service_pool.cc:224] Handling call
0709 12:20:13.598924 (+   691us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.601635 (+  2711us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:14.459496 (+857861us) log.cc:844] Serialized 14 byte log entry
0709 12:20:14.950234 (+490738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:14.950325 (+    91us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:14.950412 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:14.950520 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:14.950711 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":851354,"prepare.queue_time_us":873451,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":48,"raft.queue_time_us":1349,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":10068,"thread_start_us":488918,"threads_started":1}
I20260709 12:20:15.391191 30136 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:15.411646 24170 rpcz_store.cc:269] 0709 12:20:12.644938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:12.693458 (+ 48520us) service_pool.cc:224] Handling call
0709 12:20:14.716685 (+2023227us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54002ae9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:14.716853 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3659291392}
I20260709 12:20:15.430482 24806 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:15.406116 23995 catalog_manager.cc:5697] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 12 to 14, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 14 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:15.412675 24241 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:20:15.391165 30287 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.391435 30349 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.360972 30359 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.417446 24245 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:15.417522 24141 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.007s	sys 0.022s
W20260709 12:20:15.452608 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 630318us
I20260709 12:20:15.422470 24140 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:20:15.362249 30308 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.653s	user 0.036s	sys 0.045s
W20260709 12:20:15.423480 24779 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.648s (SENT)
I20260709 12:20:15.413431 30331 raft_consensus.cc:740] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:15.422847 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:15.413452 30411 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:15.431196 30225 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:15.400241 30375 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.438406 30357 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:15.410272 30347 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:15.432904 30266 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.428879 30268 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.406333 30390 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.416059 30206 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.413980 30274 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:15.447476 30452 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.451179 23995 catalog_manager.cc:5697] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 reported cstate change: term changed from 15 to 16, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 16 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:20:15.456794 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:15.427253 24247 raft_consensus.cc:1240] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 18. Current term is 19. Ops: [18.15-18.15]
W20260709 12:20:15.460954 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.435577 24066 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:15.468991 30225 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:15.463708 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 100613us
W20260709 12:20:15.489225 24140 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:15.489548 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 54565.2us
I20260709 12:20:15.489852 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:15.467689 30469 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:15.457011 30136 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.423625 30409 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.432638 30107 raft_consensus.cc:2804] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:15.510660 24249 raft_consensus.cc:2468] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:15.458704 30349 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:15.458907 30308 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.752s	user 0.036s	sys 0.045s
I20260709 12:20:15.493999 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:15.497205 30314 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.501425 24245 raft_consensus.cc:2468] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:15.464296 30468 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:15.508361 24140 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.526918 24140 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:15.462556 30287 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.504282 30225 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:15.537851 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.539331 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.540537 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.538887 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:15.541460 24248 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.036s	sys 0.071s
W20260709 12:20:15.541831 24248 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.036s	sys 0.071s
I20260709 12:20:15.543766 24176 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:15.475976 30347 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.512915 30462 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:15.542830 24248 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 3419) took 1947 ms. Trace:
I20260709 12:20:15.499478 30368 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:15.549520 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.555485 24172 raft_consensus.cc:2393] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 18: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:15.549849 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.550006 24176 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:15.537096 30184 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.537528 30288 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:15.553560 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.557101 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.566283 24175 raft_consensus.cc:3060] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:15.566809 24176 raft_consensus.cc:2393] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:15.567724 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.567857 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.568310 24176 raft_consensus.cc:3060] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:15.527684 30107 raft_consensus.cc:697] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:15.540541 30467 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:15.553368 24248 rpcz_store.cc:276] 0709 12:20:13.595805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:13.622328 (+ 26523us) service_pool.cc:224] Handling call
0709 12:20:13.622666 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:13.622921 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:20:14.949143 (+1326222us) log.cc:844] Serialized 14 byte log entry
0709 12:20:15.542340 (+593197us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:15.542426 (+    86us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:15.542493 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.542592 (+    99us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.542754 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":834717,"prepare.queue_time_us":852487,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":54,"raft.queue_time_us":106,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":6399,"thread_start_us":1073357,"threads_started":2}
I20260709 12:20:15.506326 30411 consensus_queue.cc:1059] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:20:15.565950 30288 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:15.559794 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.579435 30288 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:15.580796 30496 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:20:15.569527 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.581722 24172 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:15.543109 30468 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.595757 30268 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.548782 30308 consensus_queue.cc:1059] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 12:20:15.600286 24140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.601176 30328 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.601761 30328 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } attrs { replace: true } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:15.603188 30494 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:20:15.604598 30491 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260709 12:20:15.605332 30328 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:15.607144 30328 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.608006 30328 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.610741 30328 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.611557 30328 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:15.613981 30328 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.511379 30331 consensus_queue.cc:260] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.616775 30331 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:15.618295 30328 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.625121 24176 raft_consensus.cc:2468] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:20:15.631397 30314 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:15.631906 24140 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.625857 30225 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.632164 30314 raft_consensus.cc:3055] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:20:15.632835 30314 raft_consensus.cc:740] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:15.632848 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.633445 30375 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:15.635818 30390 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:15.633819 30314 consensus_queue.cc:260] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.634334 30359 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.637277 30452 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.637657 30359 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:15.638073 30359 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:15.637902 30452 consensus_queue.cc:1059] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:15.638474 30359 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:15.637238 24140 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:15.639842 24140 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.640537 24140 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:15.641402 30467 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:15.642707 24140 consensus_peers.cc:597] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:15.648556 30359 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.651870 30225 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.663527 24175 raft_consensus.cc:2468] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11.
I20260709 12:20:15.665123 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.666429 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.667418 24172 raft_consensus.cc:2410] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:20:15.668668 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.669391 24172 raft_consensus.cc:2468] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 12.
W20260709 12:20:15.675836 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.675885 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.677271 24168 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:15.681421 24140 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.555773 30221 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:20:15.684238 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:15.681471 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:15.683024 24140 leader_election.cc:336] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.682231 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.687148 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:15.687976 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.693557 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:15.694908 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:15.695205 24140 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:15.696244 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.653030 30468 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.697468 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:15.697805 24140 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.698094 24175 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
I20260709 12:20:15.698416 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:15.700641 24140 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.701589 24168 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:15.702526 24140 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:15.669008 30378 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:15.703493 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.704864 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.705515 24168 raft_consensus.cc:2376] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 18. Re-sending same reply.
I20260709 12:20:15.706743 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.706876 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.715788 24168 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:20:15.714443 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.716818 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:15.691308 30225 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:15.693055 30268 raft_consensus.cc:2804] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:15.719352 24140 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.732191 24140 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:15.732556 24172 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:20:15.695632 30462 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:15.738521 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.739449 24173 raft_consensus.cc:2376] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16. Re-sending same reply.
I20260709 12:20:15.704355 30467 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260709 12:20:15.741285 24140 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.742213 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.745462 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:15.733538 30268 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:15.719993 30378 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:15.715423 30107 consensus_queue.cc:237] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.750806 24175 raft_consensus.cc:2393] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 9: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:15.736783 30468 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:15.747320 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:15.767640 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:15.840704 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 99153.3us
I20260709 12:20:15.842070 24173 raft_consensus.cc:1240] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:20:15.749632 30268 raft_consensus.cc:3060] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:15.841270 30347 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:15.844065 30500 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 12:20:15.783783 30359 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.743041 30328 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:15.767997 30266 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.841238 24172 raft_consensus.cc:2393] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 17: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:15.845501 30221 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:20:15.849758 24140 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.747004 30225 raft_consensus.cc:3055] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:15.794273 30409 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:15.791792 30136 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:15.860970 30206 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:15.829018 30368 raft_consensus.cc:3055] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:15.801822 30287 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:15.876700 24140 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.881225 24173 raft_consensus.cc:1240] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:15.877759 30225 raft_consensus.cc:740] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
W20260709 12:20:15.889268 24140 leader_election.cc:336] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.867733 30349 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:15.905737 24216 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.014s
W20260709 12:20:15.912806 24216 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.000s	sys 0.015s
W20260709 12:20:15.913246 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 524927us
I20260709 12:20:15.916419 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:20:15.919523 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:15.929394 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:15.930341 24243 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:15.935804 24067 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:20:15.935199 24140 consensus_peers.cc:597] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:15.942199 24067 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:15.886021 30368 raft_consensus.cc:740] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:15.944422 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:15.953078 24169 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.000s	sys 0.011s
W20260709 12:20:15.958066 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:15.960798 24169 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.000s	sys 0.011s
W20260709 12:20:15.949564 24171 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.003s	sys 0.007s
W20260709 12:20:15.961519 24171 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.003s	sys 0.007s
I20260709 12:20:15.931838 30349 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.942627 24812 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.001s	sys 0.013s
W20260709 12:20:15.942731 24140 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:15.968027 24812 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.001s	sys 0.013s
W20260709 12:20:15.968833 24140 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:15.941974 30406 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:15.948462 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:15.961877 24169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2107) took 1407 ms. Trace:
W20260709 12:20:15.975440 24167 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.006s	sys 0.027s
W20260709 12:20:15.976338 24167 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.006s	sys 0.027s
I20260709 12:20:15.973362 24169 rpcz_store.cc:276] 0709 12:20:14.554782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.554956 (+   174us) service_pool.cc:224] Handling call
0709 12:20:14.555344 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:14.567443 (+ 12099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:14.567477 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:14.568054 (+   577us) log.cc:844] Serialized 26 byte log entry
0709 12:20:15.416895 (+848841us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:15.961283 (+544388us) log.cc:844] Serialized 14 byte log entry
0709 12:20:15.961556 (+   273us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.961636 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:15.961679 (+    43us) raft_consensus.cc:1685] finished
0709 12:20:15.961691 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:15.961816 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11617,"prepare.queue_time_us":424547,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":46,"raft.queue_time_us":22564,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":9317,"thread_start_us":1357356,"threads_started":2,"wal-append.queue_time_us":861773}
I20260709 12:20:15.973752 24067 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:15.948066 30266 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:15.948014 30287 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:15.971638 24140 leader_election.cc:336] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:15.969651 30267 consensus_meta.cc:287] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.537s	user 0.008s	sys 0.004s
I20260709 12:20:15.942340 30409 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:15.950035 30411 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:15.993624 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.004069 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:15.910749 30288 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.998828 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.011823 24173 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:15.960086 24243 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:16.001655 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.013502 24169 raft_consensus.cc:2393] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 17: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:16.013764 30379 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:15.984274 30375 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:15.974633 30349 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.000077 30368 consensus_queue.cc:260] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.019002 30368 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:16.019737 30349 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.001037 30266 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:16.022163 30266 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:15.996317 30184 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:15.999790 30409 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.001295 30267 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 15. Current term is 16.
I20260709 12:20:16.015372 30390 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:16.031554 24170 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:15.988301 30357 consensus_queue.cc:1059] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260709 12:20:16.048683 24140 leader_election.cc:336] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:16.008657 30079 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.008s	sys 0.000s
W20260709 12:20:16.037310 24779 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.005s	sys 0.005s
I20260709 12:20:16.015466 30274 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:20:16.043138 24214 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.067122 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.067996 24173 raft_consensus.cc:2468] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
W20260709 12:20:16.042723 24174 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.000s	sys 0.012s
I20260709 12:20:15.989504 30406 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.023407 30375 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:16.001333 30287 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:16.060683 24779 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.005s	sys 0.005s
W20260709 12:20:16.060902 24780 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.012s	sys 0.048s
W20260709 12:20:16.074882 24780 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.013s	sys 0.048s
W20260709 12:20:16.074903 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.075409 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 611421us
W20260709 12:20:16.077854 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 654369us
W20260709 12:20:16.060204 30079 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.009s	sys 0.002s
W20260709 12:20:16.085144 24141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.003s	sys 0.014s
I20260709 12:20:16.085147 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:20:16.085784 24141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.003s	sys 0.015s
W20260709 12:20:16.086150 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 529887us
I20260709 12:20:16.062026 30512 consensus_queue.cc:1059] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:20:16.064911 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.069326 24174 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.000s	sys 0.013s
I20260709 12:20:16.070417 24176 raft_consensus.cc:2410] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 19 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:20:15.972829 30225 consensus_queue.cc:260] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.072901 24169 raft_consensus.cc:1240] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260709 12:20:16.036581 30409 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:16.081841 24779 leader_election.cc:336] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.932s (SENT)
I20260709 12:20:16.101483 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:16.061445 24066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.002s	sys 0.010s
I20260709 12:20:16.095539 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.095598 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.096274 24808 raft_consensus.cc:1275] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 12:20:16.102574 24066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.003s	sys 0.010s
I20260709 12:20:16.103166 24814 raft_consensus.cc:2410] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:20:16.103883 24141 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.097091 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.077896 30375 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:16.063082 30411 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
W20260709 12:20:16.101564 24779 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.973s (SENT)
W20260709 12:20:16.103067 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 611906us
I20260709 12:20:16.110298 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.111290 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:16.078977 30331 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:16.106350 24174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2116) took 1539 ms. Trace:
I20260709 12:20:16.115712 24174 rpcz_store.cc:276] 0709 12:20:14.567280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.375001 (+807721us) service_pool.cc:224] Handling call
0709 12:20:15.375395 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:15.379275 (+  3880us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:15.379307 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:15.379831 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:20:15.498736 (+118905us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b1800385660. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:20:16.093255 (+594519us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:20:16.093303 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.093371 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:16.093412 (+    41us) raft_consensus.cc:1685] finished
0709 12:20:16.093424 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.106282 (+ 12858us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3489,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":4010,"spinlock_wait_cycles":27977088,"thread_start_us":594285,"threads_started":1,"wal-append.queue_time_us":670079}
I20260709 12:20:16.117812 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.096489 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.118656 24811 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 18.
I20260709 12:20:16.107771 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.123554 24808 raft_consensus.cc:2410] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:20:16.107710 30328 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:20:16.092670 23995 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.013s	sys 0.006s
W20260709 12:20:16.130892 24779 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.987s (SENT)
W20260709 12:20:16.131958 23995 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.014s	sys 0.006s
I20260709 12:20:16.083595 30501 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:16.117715 24066 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:16.112367 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.140367 24169 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 18.
I20260709 12:20:16.140635 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:16.098634 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.115284 30225 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:16.121570 30331 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.158183 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:16.135414 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.163623 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.164412 24809 raft_consensus.cc:1813] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Handling vote request from an unknown peer 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:20:16.137674 30380 consensus_meta.cc:287] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.736s	user 0.013s	sys 0.000s
I20260709 12:20:16.147126 30136 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:16.147805 30274 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:16.121090 30462 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:20:16.132453 24779 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 2.005s (SENT)
I20260709 12:20:16.165544 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:16.181319 24808 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 14: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:16.168331 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.169838 24809 raft_consensus.cc:2410] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 12:20:16.175664 24168 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:16.148417 30206 consensus_queue.cc:1048] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:20:16.183812 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.200578 24813 raft_consensus.cc:2393] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 14: Already voted for candidate 729aa4b1ccec48b588c14e67652c61e1 in this term.
I20260709 12:20:16.201283 24174 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:16.177852 30136 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.180310 30328 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:16.216394 30328 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:16.216739 30504 log.cc:927] Time spent T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:20:16.216818 30328 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.217680 30406 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:16.218854 30508 log.cc:927] Time spent T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:20:16.182569 30274 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.219214 30221 consensus_queue.cc:1048] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:16.220148 30288 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.221093 30274 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.222747 24171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2114) took 1656 ms. Trace:
I20260709 12:20:16.225353 24171 rpcz_store.cc:276] 0709 12:20:14.566705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.383111 (+816406us) service_pool.cc:224] Handling call
0709 12:20:15.390109 (+  6998us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:15.391879 (+  1770us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:15.396608 (+  4729us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:15.397070 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:20:15.961860 (+564790us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:20:15.961907 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:15.961990 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:16.222493 (+260503us) raft_consensus.cc:1685] finished
0709 12:20:16.222515 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.222677 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1205,"raft.queue_time_us":1313,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":4952,"thread_start_us":537440,"threads_started":1,"wal-append.queue_time_us":596066}
I20260709 12:20:16.202584 30314 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:16.227500 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.232918 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.235797 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.236488 24813 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
I20260709 12:20:16.236696 30308 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:16.237159 30308 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:16.237452 30507 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:20:16.237581 30308 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:16.238049 24215 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:16.231441 30409 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.241345 30516 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.241716 30274 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:16.242230 30274 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:16.241989 30516 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.242691 30274 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:16.202915 30462 raft_consensus.cc:697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:16.253935 30328 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.255796 30462 consensus_queue.cc:237] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.256754 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.257712 30328 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.203778 30378 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:16.258760 30136 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:16.262971 30409 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:16.246438 30331 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.183262 30287 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:16.263240 30274 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.248804 30510 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:16.264412 30409 raft_consensus.cc:2804] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:16.182216 30469 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:20:16.264823 30409 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.265219 30409 raft_consensus.cc:3060] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:16.149716 30501 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.268637 30501 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:16.270061 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.246779 30267 raft_consensus.cc:3055] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:16.271024 24176 raft_consensus.cc:2410] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 17 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:20:16.271174 30267 raft_consensus.cc:740] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:16.271891 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.271934 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.272192 30267 consensus_queue.cc:260] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.251058 30390 raft_consensus.cc:3055] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:16.273211 30390 raft_consensus.cc:740] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:16.202147 30411 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.247784 30308 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.272801 24176 raft_consensus.cc:2410] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:20:16.176549 30467 consensus_queue.cc:1048] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.074s
I20260709 12:20:16.272800 24170 raft_consensus.cc:2410] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:16.283542 24168 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:16.283787 24167 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44066 (request call id 2109) took 1728 ms. Trace:
I20260709 12:20:16.284339 24167 rpcz_store.cc:276] 0709 12:20:14.555467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.560333 (+  4866us) service_pool.cc:224] Handling call
0709 12:20:14.560708 (+   375us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:15.350161 (+789453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:15.350215 (+    54us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:15.350925 (+   710us) log.cc:844] Serialized 52 byte log entry
0709 12:20:15.976881 (+625956us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:16.009462 (+ 32581us) log.cc:844] Serialized 14 byte log entry
0709 12:20:16.009899 (+   437us) log.cc:844] Serialized 14 byte log entry
0709 12:20:16.010123 (+   224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.010204 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:16.236820 (+226616us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:20:16.240567 (+  3747us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b4800111e58. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0a4a4aa1 00007f4c0a49bb37 00007f4c0a49b9ca 00007f4c0a59326f 00007f4c0a592f37 00007f4c0a5a755c 00007f4c0a5a7508 00007f4c0a5a7488 00007f4c0a5a7443 00007f4c0a5a66ec 00007f4c094d0a96
0709 12:20:16.263720 (+ 23153us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b180043fa20. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240
0709 12:20:16.264493 (+   773us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b180043fa20. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1
0709 12:20:16.265631 (+  1138us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b180043fa20. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:20:16.283498 (+ 17867us) raft_consensus.cc:1685] finished
0709 12:20:16.283531 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.283708 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":302360,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":19712,"raft.run_cpu_time_us":3416,"raft.run_wall_time_us":233432,"spinlock_wait_cycles":53821952,"thread_start_us":585205,"threads_started":1,"wal-append.queue_time_us":674975}
I20260709 12:20:16.244635 30516 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.289539 30184 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:16.290954 30184 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:16.316551 24781 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.001s	sys 0.023s
W20260709 12:20:16.317315 24781 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.001s	sys 0.023s
W20260709 12:20:16.317997 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.322268 24139 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.017s	sys 0.006s
W20260709 12:20:16.322949 24139 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.017s	sys 0.007s
W20260709 12:20:16.335021 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 202572us
W20260709 12:20:16.336150 24779 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 2.060s (SENT)
I20260709 12:20:16.336691 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.338615 30501 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:16.340117 24812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 933) took 1005 ms. Trace:
I20260709 12:20:16.340716 24812 rpcz_store.cc:276] 0709 12:20:15.335049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:15.343261 (+  8212us) service_pool.cc:224] Handling call
0709 12:20:15.343686 (+   425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:15.343986 (+   300us) raft_consensus.cc:1534] Early marking committed up to index 16
0709 12:20:15.968419 (+624433us) log.cc:844] Serialized 14 byte log entry
0709 12:20:16.338284 (+369865us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:16.338367 (+    83us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:20:16.338419 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:16.339831 (+  1412us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:16.340037 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":603323,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":1284,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":156,"thread_start_us":954005,"threads_started":2,"wal-append.queue_time_us":366498}
W20260709 12:20:16.347020 24779 leader_election.cc:336] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.512s (SENT)
W20260709 12:20:16.347862 24779 leader_election.cc:336] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.714s (SENT)
I20260709 12:20:16.348312 24779 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:16.360682 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 349441us
W20260709 12:20:16.361248 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 347860us
I20260709 12:20:16.362941 24216 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:16.368335 24779 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.796s (SENT)
I20260709 12:20:16.371802 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:16.372822 24779 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 1.805s (SENT)
I20260709 12:20:16.378463 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.274169 30390 consensus_queue.cc:260] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.383666 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.280069 30268 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.356757 30501 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:16.384526 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 266902us
I20260709 12:20:16.363202 30530 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:16.382354 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 202818us
I20260709 12:20:16.397910 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.402400 24066 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.363394 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:16.387480 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:16.382511 30378 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:16.396001 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.391408 24781 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.388628 24216 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:16.405341 24812 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:16.406569 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:16.407390 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.407673 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:16.407946 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:16.408581 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.391848 30274 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.376420 30518 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:16.413825 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.413977 24216 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:16.385878 30487 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.013s	sys 0.017s
I20260709 12:20:16.412024 24176 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:16.384194 30392 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:16.414929 24781 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.411795 24168 raft_consensus.cc:2393] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 15: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:16.416370 30079 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:16.417982 30268 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:16.421319 30308 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:16.421689 30267 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:16.423125 30525 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:16.396225 30406 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:16.396824 30517 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.412981 30266 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:16.431890 30510 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:16.439080 30526 raft_consensus.cc:2804] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:20:16.500275 24780 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.439606 30368 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:16.442186 24810 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:16.442762 24170 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:20:16.452451 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 54635.3us
I20260709 12:20:16.505283 24141 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:20:16.457952 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 44191.3us
W20260709 12:20:16.460935 24214 consensus_peers.cc:597] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.405594 30501 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:16.463613 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 48796.1us
I20260709 12:20:16.512797 24781 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:16.464270 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.411028 30390 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:16.443945 30487 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.013s	sys 0.018s
W20260709 12:20:16.469393 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60812.1us
I20260709 12:20:16.493938 29909 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:16.499357 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 120981us
W20260709 12:20:16.499953 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.463485 30314 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:16.525240 24176 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 18.
W20260709 12:20:16.506870 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 51272.2us
I20260709 12:20:16.426395 30375 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.508036 24141 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:16.509006 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.497242 30266 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:16.462620 30079 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:16.518765 24781 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.462317 30357 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:16.473317 30518 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:16.462702 30287 raft_consensus.cc:2804] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:20:16.520506 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 106608us
W20260709 12:20:16.523708 24140 consensus_peers.cc:597] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:16.409384 30468 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:16.409690 30530 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.497411 30510 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:16.502645 30526 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:16.562345 24815 raft_consensus.cc:2410] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:16.558085 24781 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:16.572885 24067 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:16.577212 30314 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:16.577955 30314 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:16.579185 30314 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.567042 30136 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.585860 30136 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.598031 30378 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:16.523988 30452 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:16.519821 30467 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:16.536671 24214 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.560369 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:16.612221 24809 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.560734 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:16.554565 24779 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 2.172s (SENT)
I20260709 12:20:16.614749 24779 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.496012 30527 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.084s
I20260709 12:20:16.500419 30517 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.563437 30462 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.569387 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:16.600266 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:16.626420 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:16.603986 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:16.554050 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 45172.3us
I20260709 12:20:16.628083 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.606132 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:16.554483 30266 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.556447 30531 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:16.602041 30526 raft_consensus.cc:3060] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:16.556198 30411 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.563616 30359 raft_consensus.cc:2804] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:20:16.618657 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 64120.8us
I20260709 12:20:16.554927 30357 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:16.556924 30518 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:16.532366 30406 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:20:16.570418 30510 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:16.611469 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 74827.5us
W20260709 12:20:16.672154 24214 leader_election.cc:336] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.599812 30287 raft_consensus.cc:697] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:16.535490 29909 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.696808 29909 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.655627 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.698418 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:16.614529 30511 raft_consensus.cc:2764] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:20:16.699434 30519 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.657356 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.700063 30519 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.613284 30452 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:16.701372 30452 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:16.661053 24779 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Timed out: RequestConsensusVote RPC to 127.22.93.193:44043 timed out after 2.136s (SENT)
I20260709 12:20:16.702813 24779 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.703131 30136 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:16.652969 30409 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.667769 30357 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:16.556496 30079 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:16.705822 30409 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:16.675400 30543 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:16.707568 30543 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:16.653337 30206 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:16.708221 30206 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.708638 30206 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:16.675113 30359 raft_consensus.cc:697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:16.709803 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:16.668262 30518 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:16.710378 30359 consensus_queue.cc:237] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.711208 30136 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:16.712143 30136 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:16.659264 30533 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:16.715556 30533 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:16.716612 30375 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:16.658955 30541 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:16.718945 30541 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:16.719360 30541 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:16.725456 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:16.567507 30468 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:16.707459 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50218.8us
I20260709 12:20:16.733704 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:16.675551 24214 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.735302 24214 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:20:16.736176 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60678us
I20260709 12:20:16.691730 30287 consensus_queue.cc:237] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.734716 24066 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.724684 30274 consensus_queue.cc:1059] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:20:16.740347 30274 raft_consensus.cc:3055] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:20:16.740435 24214 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.740756 30274 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:16.740984 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:16.741640 30274 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:16.742139 24214 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.744321 24809 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:20:16.744423 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:16.745355 24214 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:16.746129 24214 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.745113 24812 raft_consensus.cc:2468] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:20:16.746567 24214 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.751520 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:16.650240 30462 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:16.743216 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 170992us
I20260709 12:20:16.769806 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:20:16.750931 24214 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.742904 30274 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:16.779486 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:16.776713 24214 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:16.743373 29909 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:16.762934 30267 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:16.789259 30519 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.789333 30266 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.775928 30107 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:16.747939 30409 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:20:16.782922 30314 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:16.794440 30411 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:16.748801 30406 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:16.738297 30357 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:16.784968 24214 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:16.818463 24214 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.765072 30136 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:16.803315 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:16.775635 30527 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:20:16.809841 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:16.824097 24214 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:16.824880 24214 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.800064 30379 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:16.800737 30531 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:16.834120 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 267702us
W20260709 12:20:16.839515 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:16.840819 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:16.841594 24812 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Advancing to term 20
W20260709 12:20:16.854346 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 72330.5us
I20260709 12:20:16.856829 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:16.811105 30516 raft_consensus.cc:2804] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:16.866621 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.867272 24813 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
W20260709 12:20:16.861456 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 58250us
I20260709 12:20:16.819479 30314 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.864815 24811 raft_consensus.cc:2410] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:16.872525 24215 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:16.872576 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:16.876013 24812 raft_consensus.cc:2468] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 20.
I20260709 12:20:16.828310 30107 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.858948 30531 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:16.862190 30527 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:16.880950 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.882581 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:16.882212 30184 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:20:16.890304 30357 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:16.894296 24214 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:16.869019 30468 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.895601 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:16.882964 24215 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:16.882503 30557 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:16.873708 30314 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:16.868798 30516 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:16.872576 30501 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:16.874568 30530 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:16.904981 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 180042us
I20260709 12:20:16.885480 30375 raft_consensus.cc:2804] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:16.863772 30510 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.920315 30510 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:16.923056 24168 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:16.922623 30267 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:16.927498 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:16.908067 24215 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:16.875437 30206 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:16.897475 24812 raft_consensus.cc:2410] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 12:20:16.883232 29909 raft_consensus.cc:2804] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:16.885216 30532 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:16.912792 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:16.897341 30340 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:16.943161 30340 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.943743 30379 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:16.909842 30557 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.944686 30206 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:16.912773 30375 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:16.947492 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:16.906342 30525 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:16.908962 30516 raft_consensus.cc:3060] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:16.948184 24168 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.941455 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:16.950235 24812 raft_consensus.cc:2368] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15.
I20260709 12:20:16.912815 30517 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:16.952804 24215 leader_election.cc:400] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15.
I20260709 12:20:16.954394 24215 leader_election.cc:403] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:20:16.945580 30340 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.950870 29909 raft_consensus.cc:697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:16.956487 30462 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:16.957506 30549 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:16.957067 29909 consensus_queue.cc:237] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.947530 30532 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.950824 30375 raft_consensus.cc:3060] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:16.966338 30266 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:16.967123 30531 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.971747 30557 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:16.947911 30390 raft_consensus.cc:2804] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:16.974452 30390 raft_consensus.cc:697] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 20 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:16.975677 30390 consensus_queue.cc:237] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.994236 30518 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:16.995839 24809 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:16.999832 30532 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.042739 24170 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
W20260709 12:20:17.044203 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 103149us
I20260709 12:20:17.046607 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:17.042447 24140 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 155 similar messages]
I20260709 12:20:17.049084 24243 raft_consensus.cc:1275] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:17.050557 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.056108 24168 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:17.057576 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.059175 24243 raft_consensus.cc:2393] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 8: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:17.065191 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.066130 24245 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:17.073642 24067 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
W20260709 12:20:17.075350 24214 leader_election.cc:336] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:17.077205 24214 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:17.077656 24214 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:17.078598 30525 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:17.081724 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:17.084688 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 212023us
I20260709 12:20:17.087165 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.067152 30267 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:20:17.047725 30287 consensus_queue.cc:1059] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 12:20:17.097360 30287 raft_consensus.cc:3055] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:17.097807 30287 raft_consensus.cc:740] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:17.099785 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:17.095925 30556 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:17.099785 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.084522 30559 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:17.110095 24066 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:17.116401 24247 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 15.
I20260709 12:20:17.113832 30266 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:17.085008 30411 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:20:17.121696 30533 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:17.124388 30559 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:17.101411 30287 consensus_queue.cc:260] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.125696 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.125447 30559 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:17.126410 24241 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:20:17.126609 30287 raft_consensus.cc:3060] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:17.135236 30079 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.137850 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:17.139321 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.137881 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.140259 24243 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:17.141510 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.142215 24171 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 17.
I20260709 12:20:17.143059 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:17.143635 24171 raft_consensus.cc:2376] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 11. Re-sending same reply.
I20260709 12:20:17.145179 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.144428 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:17.147529 24780 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.149320 24175 raft_consensus.cc:1240] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:17.150727 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.149188 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:17.151573 24167 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:17.153867 24066 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:17.156545 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.158766 30533 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:17.161983 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:17.159523 24066 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.164561 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.167480 24066 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:17.168788 24172 raft_consensus.cc:1240] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:17.171939 30375 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.167461 30543 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:17.167663 30462 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:17.184185 30452 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.187338 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.188390 30079 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.189862 24173 raft_consensus.cc:1240] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:20:17.192153 24176 raft_consensus.cc:1275] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:17.266819 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:17.201361 24214 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:17.166733 30533 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:17.239127 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 71769.3us
W20260709 12:20:17.238829 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:17.209551 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47630.1us
W20260709 12:20:17.237591 24140 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:17.244566 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.255543 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.168326 30411 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:20:17.262012 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.280019 24243 raft_consensus.cc:2393] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 19: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:17.276676 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.278751 24066 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:17.283015 24780 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:20:17.277249 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 68030us
I20260709 12:20:17.285538 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.268859 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.287503 24245 raft_consensus.cc:1813] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Handling vote request from an unknown peer 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:17.155385 30530 consensus_queue.cc:1048] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 12:20:17.257539 30544 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:17.258870 30527 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:17.295145 24245 raft_consensus.cc:2393] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:17.302142 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:17.290241 30541 consensus_meta.cc:287] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.000s
I20260709 12:20:17.275804 30462 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:17.311606 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.321777 24244 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 12.
I20260709 12:20:17.323145 24246 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:20:17.315531 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.309788 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.319464 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.326051 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.330439 24814 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 19. Current term is 20. Ops: []
I20260709 12:20:17.294411 30268 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:17.331355 24246 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:17.333556 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.294947 30079 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.339041 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:17.301134 30511 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:17.294025 30267 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:17.335202 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.336586 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.337894 24242 raft_consensus.cc:1275] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:20:17.354243 24141 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.334800 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:17.341255 24809 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:17.344852 24807 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:17.345206 24813 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:17.345548 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.357546 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.358439 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.358918 24246 raft_consensus.cc:2393] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 14: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:17.359561 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.360561 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.362763 24241 raft_consensus.cc:1240] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:17.346336 24169 raft_consensus.cc:1240] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:20:17.346414 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.347826 24216 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:17.349990 24779 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:17.364238 24241 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260709 12:20:17.364699 24241 pending_rounds.cc:85] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 8
I20260709 12:20:17.364940 24241 pending_rounds.cc:107] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260709 12:20:17.350072 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.303159 30518 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:17.352346 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.365181 24241 raft_consensus.cc:2889] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:17.366456 24244 raft_consensus.cc:1240] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 20 LEADER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:20:17.346668 30527 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.369059 24216 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:17.315745 30544 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:17.369441 30527 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.370024 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:17.370901 24242 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 17.
I20260709 12:20:17.372063 30527 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.335268 30487 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:17.346060 30308 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.328128 30554 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:17.350950 30511 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:17.377923 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:17.378218 30487 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:17.378823 30206 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:17.369094 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.346447 30184 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.382776 24245 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:17.375348 30308 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.361626 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.352761 30079 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.365396 30519 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:17.389820 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:17.380705 30392 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:17.331887 30541 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.386356 30511 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:17.379900 30516 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:17.392699 30184 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.387600 29909 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:17.378875 30390 consensus_queue.cc:1059] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:20:17.394306 30549 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for earlier term 14. Current term is 15.
I20260709 12:20:17.396479 30392 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.408844 30452 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:17.379004 30462 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.370719 30544 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.411126 30375 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.544668 30518 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:17.412863 30540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.018s	sys 0.011s
W20260709 12:20:17.584429 30540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.962s	user 0.019s	sys 0.011s
W20260709 12:20:17.492810 24140 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:17.587405 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 95010.1us
W20260709 12:20:17.494946 22903 thread.cc:527] Waited for 1000ms trying to join with heartbeat (tid 24126)
I20260709 12:20:17.505105 24248 raft_consensus.cc:2410] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:20:17.505414 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 115535us
I20260709 12:20:17.506342 24249 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
W20260709 12:20:17.520341 24213 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:17.522277 24779 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:17.530126 30079 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.532371 29909 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:17.532641 30184 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.535890 30308 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.410033 30392 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:17.411350 30526 consensus_meta.cc:287] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.007s
I20260709 12:20:17.377923 24141 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.414258 30541 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.627350 30526 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:17.561141 30107 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.561884 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:17.562600 30516 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:17.630577 30526 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:17.590377 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:17.635583 30107 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:17.637665 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:17.639159 30563 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:17.639473 24779 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:17.641163 30452 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:17.641863 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 119950us
I20260709 12:20:17.642515 30274 consensus_queue.cc:1048] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:17.643414 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:17.646519 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:17.598616 29909 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:17.649443 29909 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:17.561192 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:17.620725 30267 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:17.619866 30518 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.652664 30079 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.655742 30079 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:17.661375 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 283437us
I20260709 12:20:17.622036 30559 consensus_queue.cc:1059] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:17.663324 30469 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:17.663599 30559 consensus_queue.cc:1243] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:20:17.664865 30267 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.671073 30079 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.623560 30314 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.560012 30467 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:17.563683 24214 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:17.558643 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:17.696504 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 133104us
W20260709 12:20:17.691497 24779 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:17.704021 24779 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:17.704650 24815 raft_consensus.cc:1275] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:20:17.684603 30267 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:17.704636 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 193947us
I20260709 12:20:17.710891 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:17.716357 30206 raft_consensus.cc:3055] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:17.716960 30206 raft_consensus.cc:740] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:17.719220 30357 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.014s	sys 0.010s
W20260709 12:20:17.719830 30357 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.014s	sys 0.010s
I20260709 12:20:17.723428 30406 consensus_queue.cc:1048] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:17.725045 30518 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:17.728279 30510 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:17.729295 30510 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.734733 24814 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:17.735270 30467 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.739800 30314 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:17.743692 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 77096.7us
I20260709 12:20:17.744719 24215 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:17.746708 30107 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:17.760711 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 53961.3us
W20260709 12:20:17.762318 24214 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:17.762833 24214 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:17.764474 30452 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:17.775358 30107 consensus_queue.cc:1059] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:20:17.776625 30545 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:17.777611 30545 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.778000 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:17.778321 30107 raft_consensus.cc:3055] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:20:17.778805 24810 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
W20260709 12:20:17.787699 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 144730us
I20260709 12:20:17.788633 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:17.789822 24815 raft_consensus.cc:2393] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:17.790182 30501 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:17.791049 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:17.791057 30501 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:17.788866 24779 leader_election.cc:336] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:17.796633 24779 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:17.797163 24779 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:17.778756 30107 raft_consensus.cc:740] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:17.821547 30510 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:17.823827 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61610.6us
I20260709 12:20:17.824016 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.824764 30349 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:20:17.827100 24173 raft_consensus.cc:1275] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:20:17.827558 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.834439 24174 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:20:17.829203 30359 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:17.836284 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.829394 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:17.810468 24779 leader_election.cc:336] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:17.794773 30501 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:17.837929 24171 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 19.
I20260709 12:20:17.838860 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.718624 30206 consensus_queue.cc:260] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:17.862672 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:17.869736 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:17.875720 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:17.871490 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:17.856150 30107 consensus_queue.cc:260] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:17.885543 24168 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:20:17.887010 30544 consensus_queue.cc:1048] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:20:17.890940 30359 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:17.891515 24214 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:17.895720 24140 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:17.901834 24814 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:17.877674 30349 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:20:17.915342 24140 consensus_peers.cc:597] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:17.925647 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 146419us
I20260709 12:20:17.928126 30409 raft_consensus.cc:3055] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:20:17.928776 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:17.930104 24781 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:20:17.931128 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 61456us
I20260709 12:20:17.931882 30501 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:17.933076 30510 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:17.933590 30510 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:17.933935 30467 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:17.934015 30510 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:17.928169 30206 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:17.930341 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 48018.1us
I20260709 12:20:17.917517 30545 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:17.946595 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:17.947245 29909 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.948827 24066 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:17.950649 30511 consensus_meta.cc:287] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.546s	user 0.015s	sys 0.006s
I20260709 12:20:17.963114 30107 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:17.928776 30409 raft_consensus.cc:740] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:17.977861 30409 consensus_queue.cc:260] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:17.979079 30409 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:17.982311 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:17.987330 30519 consensus_meta.cc:287] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Time spent flushing consensus metadata: real 0.590s	user 0.019s	sys 0.000s
I20260709 12:20:17.987192 30511 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:17.988001 30519 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:17.996040 24809 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:17.998522 30390 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:17.999435 30390 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.003309 30527 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:18.005875 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 206875us
W20260709 12:20:18.014348 30287 consensus_meta.cc:287] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.887s	user 0.011s	sys 0.011s
I20260709 12:20:18.015328 30527 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.018330 30526 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 12:20:18.018695 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 70022.9us
I20260709 12:20:18.019809 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.020673 30527 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:18.020823 30526 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:18.012312 23996 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 11 to 12, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 12 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:18.028213 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 52108.5us
I20260709 12:20:18.076491 23996 catalog_manager.cc:5697] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 10 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 11 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.028427 30511 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:18.030277 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:18.035401 24167 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 18. Current term is 19. Ops: []
I20260709 12:20:18.035905 30392 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.037058 29909 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:18.037746 30583 log.cc:927] Time spent T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.348s	user 0.000s	sys 0.006s
I20260709 12:20:18.046628 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.017465 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:18.051397 24066 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.052798 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.054015 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.054337 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.057020 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.060858 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:18.067240 30390 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:18.068076 23995 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47144 (request call id 281) took 8989 ms. Trace:
W20260709 12:20:18.114825 30595 log.cc:927] Time spent T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.104s	user 0.001s	sys 0.002s
I20260709 12:20:18.117445 24243 raft_consensus.cc:2468] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
W20260709 12:20:18.117816 30594 log.cc:927] Time spent T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.104s	user 0.000s	sys 0.002s
I20260709 12:20:18.119076 24249 raft_consensus.cc:2393] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:18.078460 23996 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 15 to 16, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 16 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.121440 23996 catalog_manager.cc:5697] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 7 to 8, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.112871 23995 rpcz_store.cc:276] 0709 12:20:09.078814 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:09.079192 (+   378us) service_pool.cc:224] Handling call
0709 12:20:18.067787 (+8988595us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:16.226566 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:16.227314 (+   748us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:16.227360 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:20:16.227379 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:16.228364 (+   985us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:16.228462 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:16.228507 (+    45us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:20:16.229218 (+   711us) tablet.cc:701] Row locks acquired
0709 12:20:16.229239 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:20:16.229408 (+   169us) write_op.cc:270] Start()
0709 12:20:16.229538 (+   130us) write_op.cc:276] Timestamp: P: 1783599616229357 usec, L: 0
0709 12:20:16.229559 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:20:16.427409 (+197850us) log.cc:844] Serialized 3267 byte log entry
0709 12:20:16.871803 (+444394us) op_driver.cc:464] REPLICATION: finished
0709 12:20:17.118595 (+246792us) write_op.cc:301] APPLY: starting
0709 12:20:17.118743 (+   148us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:17.180280 (+ 61537us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:17.180434 (+   154us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:17.186390 (+  5956us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:17.186674 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:20:17.186723 (+    49us) write_op.cc:312] APPLY: finished
0709 12:20:17.187076 (+   353us) log.cc:844] Serialized 81 byte log entry
0709 12:20:17.187248 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:17.187392 (+   144us) write_op.cc:454] Released schema lock
0709 12:20:17.187447 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:17.187911 (+   464us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:17.187944 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2952363,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":235003,"apply.run_cpu_time_us":14077,"apply.run_wall_time_us":71808,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37583,"num_ops":8,"prepare.queue_time_us":635973,"prepare.run_cpu_time_us":31426,"prepare.run_wall_time_us":322929,"raft.queue_time_us":212041,"raft.run_cpu_time_us":33911,"raft.run_wall_time_us":251846,"replication_time_us":622366,"thread_start_us":1773493,"threads_started":4,"wal-append.queue_time_us":71238}]]}
I20260709 12:20:18.068393 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:18.070255 24810 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:20:18.110893 24214 consensus_peers.cc:597] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:18.128808 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:18.130312 24214 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:18.124862 24814 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 18.
I20260709 12:20:18.133519 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:18.142027 30516 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:18.145677 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 123967us
W20260709 12:20:18.146338 30591 log.cc:927] Time spent T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.077s	user 0.001s	sys 0.001s
I20260709 12:20:18.146692 24066 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.147908 30516 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:18.148555 23996 catalog_manager.cc:5697] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 9 to 12, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.152979 24246 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
I20260709 12:20:18.159191 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:18.165972 24250 raft_consensus.cc:2393] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:20:18.166426 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 149175us
W20260709 12:20:18.172813 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 125396us
I20260709 12:20:18.177956 24174 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:20:18.170297 23996 catalog_manager.cc:5697] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.185739 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.168766 30519 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:20:18.197877 24214 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:18.208120 24064 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.209189 23984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 159363us
I20260709 12:20:18.209962 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:18.200738 24779 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:18.212239 24814 raft_consensus.cc:1240] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 11. Current term is 12. Ops: []
I20260709 12:20:18.173691 30516 consensus_queue.cc:1059] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:20:18.191431 30519 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:18.218394 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:18.218417 30221 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.223502 24168 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:20:18.224625 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 55583us
I20260709 12:20:18.207468 23996 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 11 to 12, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 12 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.235198 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:18.218732 30526 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:20:18.225668 30519 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:18.202037 30510 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:18.251147 24214 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:18.250108 24244 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 19.
I20260709 12:20:18.239850 23996 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 reported cstate change: leader changed from <none> to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 12 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.252278 30516 consensus_queue.cc:1243] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 17.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:18.269606 30221 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.306356 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.307478 24244 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:18.309568 30221 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:18.294778 30409 consensus_queue.cc:1059] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 12:20:18.299845 24066 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:18.320622 30527 raft_consensus.cc:3055] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:20:18.321121 30527 raft_consensus.cc:740] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:18.324129 30510 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:18.328967 30593 log.cc:927] Time spent T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.323s	user 0.003s	sys 0.000s
I20260709 12:20:18.331266 30409 consensus_queue.cc:1243] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:20:18.331997 30409 raft_consensus.cc:3055] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:20:18.332404 30409 raft_consensus.cc:740] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:18.333740 30409 consensus_queue.cc:260] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.343863 24814 raft_consensus.cc:1275] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:20:18.347652 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.318186 23996 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 17 to 18, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 18 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:20:18.351881 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 161867us
W20260709 12:20:18.337740 23984 catalog_manager.cc:4755] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): ChangeConfig:REMOVE_PEER RPC failed for tablet 290d272848834ed2813ddb5e16609dba: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:18.356508 24779 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:18.352317 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:18.322322 30527 consensus_queue.cc:260] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.366111 24250 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 19: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:18.377828 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.379889 30359 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:18.383091 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.384243 30409 raft_consensus.cc:3060] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:18.378810 30527 raft_consensus.cc:3060] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:18.375646 23996 catalog_manager.cc:5697] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 16 to 18, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 18 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.393721 24175 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
W20260709 12:20:18.401721 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 184680us
I20260709 12:20:18.388396 30533 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:20:18.418524 24250 raft_consensus.cc:1240] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:18.416220 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:18.389216 30545 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:20:18.403184 30516 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:18.403146 30357 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.416720 23996 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 10 to 11, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.429570 30501 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.435950 23996 catalog_manager.cc:5697] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 11 to 12, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.439520 30225 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:18.440222 30225 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:18.441087 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 157319us
I20260709 12:20:18.442684 30411 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:20:18.443778 24066 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.444252 30411 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:20:18.444654 30357 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.446714 30225 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:18.430577 30390 consensus_queue.cc:1059] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:20:18.452212 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:18.452651 30390 raft_consensus.cc:3055] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:18.453120 30390 raft_consensus.cc:740] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:18.453503 24140 leader_election.cc:336] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:18.454154 30390 consensus_queue.cc:260] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.459815 30314 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:18.459650 24067 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:18.426419 30516 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:18.462453 24250 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 15 index: 15. (index mismatch)
I20260709 12:20:18.467635 30516 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:18.469067 30379 consensus_queue.cc:1048] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:18.471505 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:18.473001 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 44462.5us
W20260709 12:20:18.474112 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.474591 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:18.479429 24140 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:18.480212 30314 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:18.487315 30357 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:18.487628 30314 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.484570 23996 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 13 to 14, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 14 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.490428 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:18.493964 24250 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.488049 30314 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:18.497467 30390 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:18.503158 30392 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:18.437633 30501 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.515726 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:18.488365 30379 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.519585 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:18.521855 24244 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:18.524300 30544 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:18.524850 30544 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:18.526077 30544 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.528004 24175 raft_consensus.cc:2393] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 12: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:18.528450 30379 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.529323 30501 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:18.531761 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:18.536334 24780 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:20:18.543637 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 100023us
I20260709 12:20:18.520294 24141 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:18.561396 24216 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:18.564481 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 44278.2us
I20260709 12:20:18.551700 22903 tablet_replica.cc:333] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:18.569903 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:18.583189 24814 raft_consensus.cc:2410] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:20:18.585031 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:18.570770 30604 raft_consensus.cc:2749] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:18.598012 23996 catalog_manager.cc:5697] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 7 to 8, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 8 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:20:18.602324 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.607179 30602 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:20:18.608318 30467 raft_consensus.cc:3055] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:20:18.608731 30467 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:18.609736 30467 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.611308 30467 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:18.589603 30469 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:18.588847 30357 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:18.572111 30206 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.618939 30516 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.630151 30516 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:18.619174 30349 consensus_meta.cc:287] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.007s
I20260709 12:20:18.619365 24168 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:18.632580 30379 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:18.623456 30206 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.635358 30544 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:18.636094 30206 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:18.610524 30519 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.640318 24167 raft_consensus.cc:3060] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:18.643124 30511 raft_consensus.cc:2804] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:18.643759 30511 raft_consensus.cc:697] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:18.645099 30519 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:18.644785 30511 consensus_queue.cc:237] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.646751 30533 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.647405 30533 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.649770 30533 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:18.657018 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 170472us
W20260709 12:20:18.658560 24140 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:18.684155 24066 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:18.689193 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:18.687268 24781 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:18.700052 24167 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:18.703408 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:18.706463 24250 raft_consensus.cc:2468] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:18.708673 24173 raft_consensus.cc:1275] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:20:18.717526 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 181327us
I20260709 12:20:18.718713 24780 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.721243 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:18.729467 24781 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:18.699476 30533 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:18.719610 30379 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.733150 30267 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:18.733520 30462 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:18.750402 30379 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.710882 30359 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:18.751436 30359 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.751834 30359 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:18.753494 30379 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:18.754333 30462 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:18.726432 30527 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.755581 30462 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.743997 30610 raft_consensus.cc:2804] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:18.756385 30510 consensus_queue.cc:1059] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:18.757226 30610 raft_consensus.cc:697] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 14 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:18.757658 30527 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.759474 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:18.760149 30527 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:18.747958 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 62280.9us
I20260709 12:20:18.739832 22903 raft_consensus.cc:2243] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:18.761363 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:18.762317 22903 pending_rounds.cc:70] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 2 pending ops.
I20260709 12:20:18.763427 30603 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:18.763893 30603 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:18.764267 30501 raft_consensus.cc:3055] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:18.764755 30501 raft_consensus.cc:740] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:18.764631 23996 catalog_manager.cc:5697] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 12 to 13, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 13 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.765858 30501 consensus_queue.cc:260] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:18.763459 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 79477.8us
I20260709 12:20:18.770025 30267 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:18.764286 30603 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:18.772152 30267 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:18.773554 30526 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:18.773947 30526 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:18.760197 24174 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:18.774955 30526 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.776260 30526 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:18.762645 22903 pending_rounds.cc:77] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 15 index: 10 } timestamp: 7305624032768831488 op_type: NO_OP noop_request { }
I20260709 12:20:18.779373 22903 raft_consensus.cc:2889] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:18.779718 22903 pending_rounds.cc:77] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 14 index: 9 } timestamp: 7305624003432677376 op_type: NO_OP noop_request { }
I20260709 12:20:18.780071 22903 raft_consensus.cc:2889] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:18.780453 22903 raft_consensus.cc:2272] T 67948aed495f4bd9b04d87c9adbfe164 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:18.758298 30610 consensus_queue.cc:237] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.783108 30533 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.749676 30225 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:18.706004 30206 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:18.770221 24066 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:18.789150 30267 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:18.788635 30206 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.766646 23996 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 11 to 12, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.809662 30314 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:18.811833 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.812893 30604 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:18.814704 30604 consensus_queue.cc:1048] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:18.815915 30533 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:18.802034 23996 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 10 to 11, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:20:18.820742 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 50662.9us
I20260709 12:20:18.848909 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.849699 24174 raft_consensus.cc:2468] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 18.
I20260709 12:20:18.859500 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:18.864364 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:18.865417 24167 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:18.854939 23996 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 11 to 12, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 12 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:18.863816 30392 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:18.882679 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:18.883961 24167 raft_consensus.cc:2368] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18.
I20260709 12:20:18.880117 30392 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.887840 30392 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:18.873799 30519 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:18.874217 30406 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:18.895813 30206 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:18.900607 30379 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:18.904948 30379 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.907250 30349 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:40964 (request call id 87) took 11582 ms. Trace:
I20260709 12:20:18.907764 30349 rpcz_store.cc:276] 0709 12:20:07.325182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:07.327065 (+  1883us) service_pool.cc:224] Handling call
0709 12:20:07.635677 (+308612us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b24001e3818. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02311cb9 00007f4c0230fdcb 00007f4c0240e2b1 00007f4c02409848 00007f4c024097ad 00007f4c0384a9a7 00007f4c054d785c 00007f4c054d7699 00007f4c054d46ad 00007f4c054d4527
0709 12:20:07.699065 (+ 63388us) log.cc:844] Serialized 501 byte log entry
0709 12:20:18.898464 (+11199399us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11692,"raft.queue_time_us":34808,"raft.run_cpu_time_us":746,"raft.run_wall_time_us":745,"spinlock_wait_cycles":14804864,"thread_start_us":195288,"threads_started":2,"wal-append.queue_time_us":201476,"wal-append.run_cpu_time_us":2428,"wal-append.run_wall_time_us":1004365}
I20260709 12:20:18.896397 30406 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:18.913321 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 159073us
I20260709 12:20:18.914574 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:18.910383 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 65411.8us
I20260709 12:20:18.911693 23996 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 6 to 7, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 7 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:18.933017 24066 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.913837 30357 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:18.951969 24780 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.958053 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:18.964718 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:18.953328 22903 tablet_replica.cc:333] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:18.952280 30206 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:18.980775 24067 leader_election.cc:400] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18.
I20260709 12:20:18.981221 24067 leader_election.cc:403] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:20:18.980894 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:18.982091 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:18.984391 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:18.990038 24066 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:18.991904 23985 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9e016416bdc742068f5568ff2bebabd1 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:20:18.992918 24139 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:18.993148 30501 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:18.962108 30516 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:20:18.983870 30287 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:18.975487 30225 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:20:18.996649 30549 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:19.003732 30612 log.cc:927] Time spent T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:20:19.008093 30406 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.008991 30517 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:18.994802 30379 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:18.989662 24214 consensus_peers.cc:597] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:19.018200 30406 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.019227 30406 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:18.976172 30357 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.021596 30406 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.021994 30357 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.023032 30511 raft_consensus.cc:2749] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.025769 30314 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:19.026594 30314 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.028155 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.029618 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.030138 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:19.018102 30206 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:19.030721 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 68822us
W20260709 12:20:19.031613 24214 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:18.982438 30533 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:19.037782 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 85924.7us
W20260709 12:20:19.038430 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:20:19.039613 24214 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.039909 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:19.052352 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.039979 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.040742 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:19.041150 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.042011 24246 raft_consensus.cc:1240] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:20:19.059564 24242 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:19.040737 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:19.048846 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 64591.2us
I20260709 12:20:19.050890 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.060395 24248 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:19.037025 30516 raft_consensus.cc:3060] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:19.047940 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 64739.5us
I20260709 12:20:19.054149 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.053601 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:19.014791 30359 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.102396 30411 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.057119 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:19.063659 24214 consensus_peers.cc:597] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:19.138008 30603 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:19.215332 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 151747us
I20260709 12:20:19.213940 24809 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:20:19.215418 30545 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:20:19.216251 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 159253us
I20260709 12:20:19.218139 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:19.218487 24215 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:19.218837 24171 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.220050 30623 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:19.064375 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:19.222899 30519 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:19.223335 30519 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.223676 30519 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:19.226125 30545 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:19.227372 24214 consensus_peers.cc:597] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:19.229300 24171 raft_consensus.cc:2468] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 15.
I20260709 12:20:19.058382 30314 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.052961 22903 raft_consensus.cc:2243] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:19.230937 24781 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:19.069150 30533 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:19.051443 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 86823.8us
I20260709 12:20:19.110685 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.099366 30267 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.163654 30516 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18.
I20260709 12:20:19.110136 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.178121 30526 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.213984 24249 raft_consensus.cc:2368] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18.
I20260709 12:20:19.104748 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.262151 24247 raft_consensus.cc:2410] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:19.105151 30615 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.267052 30615 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.268500 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.270071 30615 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.232228 30519 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.265650 29909 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.271456 29909 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.272657 30519 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:19.273588 29909 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.274019 30526 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.114941 30527 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.275378 30527 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:19.275763 24214 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:19.276513 24214 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.278081 30526 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.278168 30527 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:19.235433 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 171177us
I20260709 12:20:19.103215 30206 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.127017 30501 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.280200 24141 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.280303 30501 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.283636 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.237687 30409 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.238651 30631 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.202620 24170 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:19.239032 30627 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.240702 30411 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.241778 30603 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.295809 24216 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:19.298244 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.170632 24248 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:20:19.247169 30359 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.251627 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.301293 30627 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.302424 30411 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:19.295343 24214 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:19.303507 24214 leader_election.cc:336] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.295208 30314 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.303851 30627 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:19.304576 30631 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:19.305208 24214 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.305800 30314 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:19.306252 24214 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:19.306871 24214 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.308012 30622 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:19.311414 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:19.312062 24247 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:20:19.131295 24140 consensus_peers.cc:597] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:19.313015 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 181811us
W20260709 12:20:19.313725 24140 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:19.317039 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.256533 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.318758 24810 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:19.265538 30349 consensus_queue.cc:1048] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:19.321373 24247 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:19.321611 30409 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.325495 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:19.325724 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.326122 24170 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.326893 24216 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:19.329260 24779 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:19.330169 24815 raft_consensus.cc:2393] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
W20260709 12:20:19.330264 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 50179.9us
I20260709 12:20:19.291834 30519 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:19.292202 30526 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.331907 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.332808 24807 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:20:19.332922 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.333518 24174 raft_consensus.cc:1240] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:19.295567 30610 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.334785 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.336350 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.338608 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.339457 24814 raft_consensus.cc:2410] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260709 12:20:19.334270 24779 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.337280 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.339596 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:19.337554 30379 raft_consensus.cc:2764] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:20:19.340490 22903 raft_consensus.cc:2272] T ce278f8a39b344f9a0cd7dcd099a3b66 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:19.341302 24173 raft_consensus.cc:2410] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:20:19.291970 30545 raft_consensus.cc:2804] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:19.339989 24779 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.342723 24248 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:20:19.344767 24248 pending_rounds.cc:85] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 9
I20260709 12:20:19.344954 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.345868 24174 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 16: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:19.340200 24249 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 19.
I20260709 12:20:19.329938 30206 raft_consensus.cc:2804] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:19.345022 24248 pending_rounds.cc:107] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:20:19.349237 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.350593 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:19.341837 30501 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:19.348070 30359 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:19.354625 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.355329 24814 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:19.348507 24248 raft_consensus.cc:2889] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:19.357867 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.359606 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.358238 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.279453 30267 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.380311 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.354641 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.364208 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.362707 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.392014 24814 raft_consensus.cc:2410] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:19.362957 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.359994 24815 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
W20260709 12:20:19.379983 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 48748.9us
I20260709 12:20:19.342283 30631 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.369536 24807 raft_consensus.cc:2410] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 20 because replica has last-logged OpId of term: 18 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:20:19.357048 24215 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:19.394484 24247 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:19.394934 24215 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:19.379421 30206 raft_consensus.cc:697] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:19.396716 24779 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.343030 30610 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.388779 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.390961 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.386745 30409 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.393218 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.401636 24174 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:19.348353 30603 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:19.406634 24215 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
W20260709 12:20:19.405361 24214 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.355773 30623 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:19.408178 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 47086.9us
I20260709 12:20:19.411959 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.399442 24779 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.362089 30406 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.405814 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.345404 30526 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.376750 30545 raft_consensus.cc:697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:19.409636 24244 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
W20260709 12:20:19.411521 24214 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:19.414247 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.415031 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:19.413689 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 49614.9us
I20260709 12:20:19.361585 30314 consensus_queue.cc:1059] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:20:19.419958 24215 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:19.420833 29909 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:19.420897 24066 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.421227 24215 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:19.421342 29909 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.421897 29909 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:19.404269 30392 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:19.407321 30379 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:19.427775 24779 leader_election.cc:336] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.428254 30544 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:20:19.430078 30487 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:19.430337 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.433235 30136 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:19.433776 30390 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:19.437431 30545 consensus_queue.cc:237] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.438392 30267 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.439841 24167 raft_consensus.cc:2955] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Committing config change with OpId 9.8: config changed from index 7 to 8, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:19.442037 30610 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.422078 30409 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:20:19.444087 23984 catalog_manager.cc:4755] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): ChangeConfig:REMOVE_PEER RPC failed for tablet 290d272848834ed2813ddb5e16609dba: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.445091 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.446745 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.410063 30604 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:19.461571 24170 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:19.433846 30533 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:19.467880 24244 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 12:20:19.468189 30206 consensus_queue.cc:237] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.474920 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.460189 30136 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.460003 30390 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.458527 30621 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.485037 24066 leader_election.cc:400] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for earlier term 17. Current term is 18.
I20260709 12:20:19.457772 30487 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.487846 22903 tablet_replica.cc:333] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:19.516448 24066 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:19.488391 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 60662.5us
W20260709 12:20:19.517638 24779 leader_election.cc:336] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.475502 30411 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.518136 24066 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:19.493412 30314 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.474503 30627 raft_consensus.cc:3055] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:19.521627 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.533075 22903 raft_consensus.cc:2243] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:19.513597 30390 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.516292 30349 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.520900 24066 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:19.551232 22903 raft_consensus.cc:2272] T 0996a24d22664e97aa7ba765bb20ef47 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:19.553830 29909 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.512418 30136 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:19.518906 30487 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:19.556951 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:19.578125 30357 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:19.581476 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 60665.7us
I20260709 12:20:19.585873 24066 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.518430 30501 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.584436 29909 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.537849 30533 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:19.548796 30409 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:19.548094 30615 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.580986 30314 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.543862 30627 raft_consensus.cc:740] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:19.592871 29909 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:20:19.598646 29909 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting leader election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.599195 29909 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:20:19.593775 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:19.595891 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:19.556113 30623 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.583190 30610 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.605870 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:19.588614 30411 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:19.582613 30359 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.581570 30622 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.608280 24066 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:19.605379 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 190468us
I20260709 12:20:19.588063 30107 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.578138 30349 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:19.624071 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 43908.8us
I20260709 12:20:19.618216 24066 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:19.518577 30621 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.620735 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.597373 30631 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:19.613312 30527 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:19.632671 30527 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:19.632726 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 115124us
I20260709 12:20:19.633149 30527 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:19.633605 24779 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.634043 24779 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:19.628213 30533 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:19.630892 30622 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.641506 30622 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.645323 30621 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.646713 30621 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:19.594657 30501 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.603366 30267 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:20:19.648696 30501 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.610253 30623 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.650394 30519 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:19.607431 30516 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.617959 30379 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:19.616153 30615 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.650914 30623 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.656486 30615 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:19.651402 30516 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.658607 30516 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.652488 30314 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:19.654388 22903 tablet_replica.cc:333] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:19.659677 30526 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:19.661262 22903 raft_consensus.cc:2243] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:19.621261 30107 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.662037 30627 consensus_queue.cc:260] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.663578 30627 raft_consensus.cc:3060] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.664925 30107 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.669075 29909 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.611238 30549 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:19.678232 29909 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.596220 30357 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.717947 30406 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.718890 30406 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.721887 30406 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.723335 30644 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:19.724049 30644 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.725062 30544 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:19.711671 30409 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:19.642691 30622 consensus_queue.cc:1059] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 14.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:20:19.686805 30631 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:19.628427 30359 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.766958 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.713815 30107 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.761390 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.762468 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.773330 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:19.776921 22903 raft_consensus.cc:2272] T 46a4dd5f831f4ddca30827249660c52a P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:19.791759 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:19.796365 24168 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 19.
W20260709 12:20:19.772680 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 147641us
I20260709 12:20:19.733412 30644 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:19.798293 24140 consensus_peers.cc:597] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:19.799789 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.800118 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:19.796386 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 110043us
I20260709 12:20:19.806623 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:19.807703 24243 raft_consensus.cc:2368] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
W20260709 12:20:19.809652 24140 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.775753 30487 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.732583 30409 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.805541 30107 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.835421 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.839017 30349 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.810775 30645 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:19.841452 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:19.845095 30107 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.847788 30357 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.811147 30517 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:19.811565 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:19.812397 24161 tablet_service.cc:1558] Processing DeleteTablet for tablet 5bc5bc9605e64854a78054b02b3da6dd with delete_type TABLET_DATA_TOMBSTONED (TS 5d0f174a97494d0cbf08ae81ec4c807a not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:55732
I20260709 12:20:19.875393 24814 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:19.876606 30645 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:19.812052 24140 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.824287 30267 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.818064 24807 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:19.879452 30267 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.874711 30517 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.882171 30267 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:19.879293 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 67276.8us
W20260709 12:20:19.884356 24140 consensus_peers.cc:597] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:19.855374 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 237223us
I20260709 12:20:19.818522 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:19.885740 24812 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:19.800503 30406 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.820099 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:19.866510 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:19.775171 30411 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:19.819204 22903 tablet_replica.cc:333] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:19.886969 24066 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:19.867324 24779 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:19.891506 24140 consensus_peers.cc:597] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:19.900719 24779 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.894055 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:19.903623 24140 consensus_peers.cc:597] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:19.906527 24806 raft_consensus.cc:2393] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 12: Already voted for candidate c090031f610346ed82285cd847bca6d6 in this term.
I20260709 12:20:19.908164 24248 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:19.915235 24067 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: 
I20260709 12:20:19.919335 22903 raft_consensus.cc:2243] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:19.921965 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
W20260709 12:20:19.912799 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 109976us
I20260709 12:20:19.924608 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.926052 30653 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:19.926437 30646 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:19.927218 30533 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.927819 30533 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.928720 22903 raft_consensus.cc:2272] T 07add62ce67548c3bdb714821b78d1d1 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:19.930186 30533 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.818696 30527 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.930918 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.931437 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:19.946722 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 59949.3us
I20260709 12:20:19.931113 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:19.949174 24245 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:19.949910 30359 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.903931 30406 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.937047 30533 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:19.956303 30533 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:19.956898 30136 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.958101 24247 raft_consensus.cc:1240] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:19.932585 30653 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:20:19.959405 30533 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:19.959966 30653 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:19.960425 30653 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:19.956688 30406 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:19.906663 30636 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:20:19.956724 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:19.933725 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:19.964869 30527 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:19.965410 24811 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:19.954270 30390 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:19.966972 24242 raft_consensus.cc:2393] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 15: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:19.968132 30390 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:19.969815 24140 consensus_peers.cc:597] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:19.970968 24140 consensus_peers.cc:597] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:19.983055 24140 consensus_peers.cc:597] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:19.984344 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:19.987629 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 135326us
W20260709 12:20:19.988554 24779 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:19.989032 24779 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:19.973923 24172 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:19.979317 24248 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
I20260709 12:20:20.029675 24814 raft_consensus.cc:2468] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
W20260709 12:20:20.003324 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 78238.5us
I20260709 12:20:20.000283 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.978530 24244 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:19.972050 24812 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
W20260709 12:20:20.050413 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 50273.5us
I20260709 12:20:19.986670 30641 raft_consensus.cc:3055] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:20.055527 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:20.055537 24249 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: []
I20260709 12:20:20.056257 24811 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:19.914436 30517 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.053454 24066 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:19.936223 30645 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:20.052691 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 72205us
I20260709 12:20:20.054911 24245 raft_consensus.cc:2468] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 17.
I20260709 12:20:20.063815 24809 raft_consensus.cc:1240] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 15. Current term is 16. Ops: []
I20260709 12:20:19.980412 24141 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.067853 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.068843 24215 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:20.032616 30267 raft_consensus.cc:493] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.075344 24066 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:20.080449 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 100141us
I20260709 12:20:20.077353 24215 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:20.081700 24141 leader_election.cc:400] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:20:20.082070 24141 leader_election.cc:403] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:20.080819 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:20.088516 24066 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:20.089228 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.090036 24172 raft_consensus.cc:2410] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:20:20.092993 24780 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.055851 30641 raft_consensus.cc:740] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:20.096838 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.104352 24171 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 12.
I20260709 12:20:20.068747 30527 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:20.097712 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.099845 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.070096 30526 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:20.114049 24249 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:20.115114 30487 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 20 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:20.115289 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 126779us
W20260709 12:20:20.116230 24779 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:20.082193 30349 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:20.105589 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:20.118947 30136 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.122892 30526 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:20.107724 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9dd67e018d26493bae6d921a57dfc306" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.098799 30267 raft_consensus.cc:515] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:20.081519 30314 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:20.074581 30406 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.138402 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:20.128670 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 53672.9us
I20260709 12:20:20.149235 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.151019 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.151965 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.129184 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.085318 30462 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157) with higher term. Message: Invalid argument: T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:20:20.161710 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.163538 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.177703 24250 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 19.
I20260709 12:20:20.082614 30604 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:20.173592 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.126246 22903 tablet_replica.cc:333] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:20.102509 30409 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:20.095952 30645 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:20.181298 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:20.182142 24809 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:20.082159 30642 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:20.105273 30631 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:20.131531 30517 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:20.222234 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.214546 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.213579 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.183988 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.229298 24176 raft_consensus.cc:1275] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:20:20.232728 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:20.121766 30349 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:20.240757 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 141444us
W20260709 12:20:20.227339 24214 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.243883 24806 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:20:20.184597 24216 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:19.975898 30411 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 14.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.245924 24249 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 8.
I20260709 12:20:20.150344 30392 raft_consensus.cc:2804] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:20:20.259575 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 75108.4us
I20260709 12:20:20.263010 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.258886 30349 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:20.213864 30409 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.260504 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.279735 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.280192 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1c672629a7b441f9e55890cd643e03a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.175287 30526 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:20.281375 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 107958us
I20260709 12:20:20.281878 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:20.284163 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 56861.6us
I20260709 12:20:20.291975 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:20.267325 30658 tablet_replica.cc:333] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:20.292667 24066 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:20.300554 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.290194 24141 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.258332 30516 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:20.304116 24214 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.304839 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.302045 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:20.215785 30406 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.310837 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:20.311966 23984 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 270876us
I20260709 12:20:20.227452 30604 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.281667 30549 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:20:20.322712 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:20.322937 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.323464 24244 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:20.323823 24247 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
W20260709 12:20:20.318595 24214 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.281154 30392 raft_consensus.cc:697] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:20.295866 30655 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:20.288132 30409 raft_consensus.cc:3060] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:20.315501 24249 raft_consensus.cc:1240] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 15. Current term is 16. Ops: [15.15-15.15]
I20260709 12:20:20.324436 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.326285 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:20.265393 30359 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:20:20.307209 30610 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.332846 24250 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:20.327363 24066 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.287127 30631 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.315009 30533 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:20:20.364427 30527 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:20.365146 24066 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.366122 30527 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:20.367156 30622 consensus_queue.cc:1048] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:20.119764 30641 consensus_queue.cc:260] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.15, Last appended by leader: 15, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.374689 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.312386 30519 consensus_queue.cc:1059] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:20:20.314587 30314 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:20.319213 30645 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:20.342630 24245 raft_consensus.cc:1275] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:20.344201 29909 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:20.345784 30659 log.cc:927] Time spent T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:20:20.345785 30267 leader_election.cc:290] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:20.386966 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:20.348074 30657 log.cc:927] Time spent T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:20:20.293327 30603 consensus_queue.cc:1059] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:20:20.348456 30406 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.349220 30392 consensus_queue.cc:237] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.353022 24250 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:20.359958 30610 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.393353 30610 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:20.324915 30516 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.394150 30664 raft_consensus.cc:2804] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:20.395813 30516 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.333534 30549 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:20.398584 30549 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:20.341514 24214 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.295751 30526 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:20.404182 30526 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:20.405308 24214 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:20.406373 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 64921.8us
I20260709 12:20:20.411021 30655 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:20.416340 30604 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.423403 30641 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:20.427611 22903 raft_consensus.cc:2243] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:20.428516 22903 raft_consensus.cc:2272] T 9dd67e018d26493bae6d921a57dfc306 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:20.430043 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:20.431443 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.432225 24814 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:20.431474 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.372504 30639 consensus_queue.cc:1059] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
I20260709 12:20:20.430857 24810 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:20:20.377899 30631 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:20.440742 24214 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:20.443894 24214 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.449115 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.449898 24247 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:20.454475 24809 raft_consensus.cc:2468] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:20.385186 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.363389 30533 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.363598 30627 raft_consensus.cc:493] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.381908 30527 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:20.448465 24214 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.467338 24214 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:20.465236 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 80131.7us
I20260709 12:20:20.469242 24066 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.466924 30526 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:20.470558 24066 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.470659 30526 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:20.471168 24214 consensus_peers.cc:597] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:20.471414 30516 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:20.471506 30627 raft_consensus.cc:515] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.472299 30644 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:20.472858 24066 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:20.439630 30603 raft_consensus.cc:3055] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:20:20.473692 30603 raft_consensus.cc:740] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:20.438910 30519 raft_consensus.cc:3055] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:20.474150 30627 leader_election.cc:290] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.474455 30519 raft_consensus.cc:740] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:20.474769 30603 consensus_queue.cc:260] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.475556 30519 consensus_queue.cc:260] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.382351 24811 raft_consensus.cc:2468] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
I20260709 12:20:20.478946 24780 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:20.480290 24244 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 20.
W20260709 12:20:20.481043 24781 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.481305 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.447603 30631 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:20.476341 30603 raft_consensus.cc:3060] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:20.479558 30501 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:20.489748 24813 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:20:20.465677 30533 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:20.483345 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.484046 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:20.495076 24214 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:20.495559 24245 raft_consensus.cc:2393] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 17: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
W20260709 12:20:20.497706 24214 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:20.487627 30527 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:20.500560 22903 tablet_replica.cc:333] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:20.501390 30467 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:20.501894 22903 raft_consensus.cc:2243] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:20.502355 30666 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:20.503211 30646 consensus_meta.cc:287] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: Time spent flushing consensus metadata: real 0.576s	user 0.013s	sys 0.000s
I20260709 12:20:20.503808 30646 raft_consensus.cc:2749] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:20.504748 24812 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 13.
I20260709 12:20:20.502192 30467 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.507853 30467 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:20.510743 23984 catalog_manager.cc:4755] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): ChangeConfig:REMOVE_PEER RPC failed for tablet 290d272848834ed2813ddb5e16609dba: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.486495 24066 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.512382 30527 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:20.513783 30627 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:20.513710 30527 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:20.517668 24141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:20.518482 24141 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.484946 30639 raft_consensus.cc:3055] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:20:20.485294 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.486454 30664 raft_consensus.cc:697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:20.486752 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.487056 30645 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.517494 24215 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:20.484563 30653 consensus_meta.cc:287] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.524s	user 0.008s	sys 0.004s
I20260709 12:20:20.530802 30639 raft_consensus.cc:740] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:20.546190 24215 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:20.548063 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:20.510568 30519 raft_consensus.cc:3060] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:20.550192 22903 raft_consensus.cc:2272] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:20.530938 30501 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:20.538393 24810 raft_consensus.cc:2468] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 20.
I20260709 12:20:20.552408 30406 raft_consensus.cc:2804] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:20.560089 30604 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:20.560678 30604 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:20.561059 30604 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:20.550034 30487 raft_consensus.cc:2804] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:20.564160 30487 raft_consensus.cc:697] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:20.565275 30487 consensus_queue.cc:237] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.544749 30645 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.571138 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.509536 30610 consensus_queue.cc:1048] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:20:20.571636 30658 raft_consensus.cc:2243] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:20.547099 30357 raft_consensus.cc:2804] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:20:20.572347 30636 raft_consensus.cc:670] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:20:20.547300 30653 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:20.575309 30653 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:20.576905 30664 consensus_queue.cc:237] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:20.580973 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:20.581794 24247 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:20.584611 30645 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.585426 30639 consensus_queue.cc:260] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.588794 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.586675 30639 raft_consensus.cc:3060] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:20.605347 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.591111 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:20.591446 30658 raft_consensus.cc:2272] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:20.607120 24812 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
I20260709 12:20:20.510349 30666 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:20.592964 24808 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 15.
I20260709 12:20:20.558768 30501 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.611555 30501 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:20.612102 30666 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:20.613226 24066 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:20.614195 30631 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:20.614748 30631 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:20.595887 30406 raft_consensus.cc:697] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:20.615279 30631 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:20.616299 30406 consensus_queue.cc:237] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.595993 30357 raft_consensus.cc:697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:20.598228 30668 consensus_queue.cc:1175] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c090031f610346ed82285cd847bca6d6" responder_term: 15 status { last_received { term: 12 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: [14.13-14.13]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:20:20.620126 30357 consensus_queue.cc:237] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.620929 30658 ts_tablet_manager.cc:1916] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:20:20.633160 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.634097 24250 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:20.602066 24244 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:20:20.607064 24140 consensus_peers.cc:597] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:20.642536 24141 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:20.653585 22903 tablet_replica.cc:333] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
W20260709 12:20:20.666239 24140 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.668655 22903 raft_consensus.cc:2243] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:20.670742 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:20.671684 24244 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 18.
I20260709 12:20:20.668741 30668 raft_consensus.cc:2804] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:20.674259 22903 raft_consensus.cc:2272] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:20.674712 30668 raft_consensus.cc:697] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:20.662396 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:20.676079 30668 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.650156 30409 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.639717 30644 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.682173 24172 raft_consensus.cc:1275] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:20.673782 24247 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 20.
I20260709 12:20:20.688544 30663 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:20.689108 30663 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:20.689499 30663 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:20.697881 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.678328 22903 tablet_replica.cc:333] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:20.703258 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:20.721377 24171 raft_consensus.cc:1275] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:20:20.732223 30544 consensus_queue.cc:1048] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:20.735945 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.668404 30533 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.739182 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.739506 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:20.755647 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e303f1b8c84a32a8a6522ee6c6fb27" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.758213 30392 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:20.758360 30487 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:20.762511 24066 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:20.765486 24167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.765564 24174 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:20:20.765895 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.702682 30644 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.783998 24067 leader_election.cc:304] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.787770 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.790004 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:20.790120 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.792914 24170 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:20.792913 24174 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 14.
I20260709 12:20:20.796665 24216 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:20.799526 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 140155us
I20260709 12:20:20.801213 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c29a1bdc82674a4ab1ad6c3b54c69e25" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:20.771001 30390 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:20.773325 30623 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:20.784646 30627 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:20:20.760831 30663 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.813781 30671 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:20.815269 29909 consensus_queue.cc:1048] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:20.825799 24176 raft_consensus.cc:2410] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 13 because replica has last-logged OpId of term: 12 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:20.774325 30411 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:20:20.765050 30487 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:20.807634 30645 raft_consensus.cc:2749] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:20.849305 22903 raft_consensus.cc:2243] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:20.831861 24243 raft_consensus.cc:1240] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260709 12:20:20.852528 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:20.853312 24809 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:20:20.853884 30409 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:20.827090 24779 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.859252 24779 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:20.861603 24779 leader_election.cc:336] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.862027 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.863122 24170 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 20.
W20260709 12:20:20.863373 24779 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.864893 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:20.866007 24811 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 16: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:20.866762 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.869737 24809 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
W20260709 12:20:20.820812 30349 consensus_meta.cc:287] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: Time spent flushing consensus metadata: real 0.526s	user 0.009s	sys 0.003s
I20260709 12:20:20.878014 22903 raft_consensus.cc:2272] T 73fc2a59a00e4ea6a3b63c28c6f58512 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:20.823583 30671 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:20.899832 24066 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:20.845472 30533 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 9 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.904579 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:20.825084 30627 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:20.905548 24248 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:20:20.895170 24779 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:20.908319 24779 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.852550 30411 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:20.912838 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 142749us
I20260709 12:20:20.872691 30667 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:20.916816 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:20.888830 30603 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.883034 30544 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:20.920356 24245 raft_consensus.cc:2393] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 16: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:20.893198 30671 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:20.846963 30604 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.912377 30645 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:20:20.874506 30545 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:20.917594 24779 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.934859 24779 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.890511 30349 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:20.939916 24779 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:20.943970 24067 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:20.944965 24067 raft_consensus.cc:2686] T 30d4ada45d4b4872986993abc4470158 P 729aa4b1ccec48b588c14e67652c61e1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:20.946239 24067 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:20.946612 30604 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.947438 24175 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:20.947918 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:20.904469 30501 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:20.950341 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
W20260709 12:20:20.938166 30681 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260709 12:20:20.944484 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:20.934070 30314 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:20.958879 24248 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 9.
I20260709 12:20:20.919844 30411 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:20.939304 30645 raft_consensus.cc:697] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:20.967367 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:20.967371 24811 raft_consensus.cc:2368] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:20:20.971189 30314 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:20.950313 30641 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:20.975091 30527 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:20.929306 30603 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:20.976408 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:20.988619 24245 raft_consensus.cc:2393] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:20.973445 30501 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:20.976186 22903 tablet_replica.cc:333] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:20.995134 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:20.999862 22903 raft_consensus.cc:2243] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:21.000650 22903 pending_rounds.cc:70] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 1 pending ops.
I20260709 12:20:21.000911 22903 pending_rounds.cc:77] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 11 index: 8 } timestamp: 7305624000628236288 op_type: NO_OP noop_request { }
I20260709 12:20:21.000978 30603 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:21.001287 22903 raft_consensus.cc:2889] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:21.001698 22903 raft_consensus.cc:2272] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:20.954620 30516 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 12:20:21.008224 30314 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:20.986515 30544 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:21.019618 30645 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:21.023948 30663 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:21.025089 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:21.025990 30349 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:20.967187 30533 raft_consensus.cc:3060] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:21.028872 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 45348.1us
I20260709 12:20:21.030587 30411 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:21.031867 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:21.032209 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:21.033181 24242 raft_consensus.cc:2393] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 13: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:21.032212 30487 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:20.968319 30627 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:21.041841 24779 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:21.042346 24779 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:21.049520 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:21.053346 24814 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:21.057658 24779 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:21.058220 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:21.059056 30672 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:21.059793 30672 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:21.061208 24812 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 15 index: 15. Preceding OpId from leader: term: 16 index: 15. (term mismatch)
I20260709 12:20:21.061595 24812 pending_rounds.cc:85] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Aborting all ops after (but not including) 14
I20260709 12:20:21.061861 24812 pending_rounds.cc:107] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Aborting uncommitted NO_OP operation due to leader change: 15.15
I20260709 12:20:21.062099 24812 raft_consensus.cc:2889] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:21.063055 24810 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 13.
W20260709 12:20:21.067184 24779 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:21.067734 24779 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:21.067893 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:21.068527 24811 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.069864 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:21.071537 24779 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:21.070379 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:21.078398 24242 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:20:21.079252 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:21.079968 24245 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:21.081090 24169 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:21.085729 24809 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:20:21.086318 24141 leader_election.cc:400] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:20:21.086752 24141 leader_election.cc:403] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:20:21.041329 30136 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:21.093999 30603 raft_consensus.cc:3060] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:21.094558 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:21.104090 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:21.104790 24172 raft_consensus.cc:3060] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:20:21.103953 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 156093us
I20260709 12:20:21.105783 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:21.105808 24067 leader_election.cc:304] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:21.100214 24241 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:20:21.100323 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:21.060226 30671 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:21.111945 24811 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:21.104578 24176 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:21.065521 30653 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:20:21.125921 24067 raft_consensus.cc:2686] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 729aa4b1ccec48b588c14e67652c61e1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:21.135619 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:21.143986 24814 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:21.079555 30641 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:21.143796 24215 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:21.137336 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47156.1us
I20260709 12:20:21.152025 30462 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:21.155464 30549 raft_consensus.cc:2804] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:21.155880 30462 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:21.156129 30549 raft_consensus.cc:697] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
W20260709 12:20:21.157243 30631 consensus_meta.cc:287] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.541s	user 0.013s	sys 0.000s
I20260709 12:20:21.157330 30549 consensus_queue.cc:237] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:21.157778 30631 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:21.152367 30672 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.162076 30672 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:21.086591 30527 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
W20260709 12:20:21.166857 30691 log.cc:927] Time spent T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:20:21.156315 30462 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.134456 30406 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:20:21.172017 30533 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:21.172791 29909 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:20:21.175091 24810 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:21.187557 24814 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:20:21.149056 30665 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:21.200908 24172 raft_consensus.cc:2468] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:21.201116 24242 raft_consensus.cc:1275] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:21.195114 24245 raft_consensus.cc:2468] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:21.206605 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:21.207401 24250 raft_consensus.cc:3060] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:21.211484 30379 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:20:21.215379 30663 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:20:21.221370 30644 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:21.223783 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:21.246650 30695 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.095s
I20260709 12:20:21.248402 22903 tablet_replica.cc:333] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:21.249650 22903 raft_consensus.cc:2243] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:21.251332 24812 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 13.
I20260709 12:20:21.252767 24215 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:21.252844 30631 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:21.253911 30107 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:20:21.254334 30107 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:21.254681 30107 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:21.186743 30527 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260709 12:20:21.206828 30671 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:21.262344 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:21.211683 30665 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:21.273149 24812 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.283627 24250 raft_consensus.cc:2468] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 19.
I20260709 12:20:21.301498 22903 raft_consensus.cc:2272] T c07ef51fde0145f3ab7d32fa63626a55 P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:21.302258 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:21.304265 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:21.305035 24169 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:20:21.307299 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:21.265590 30631 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.312407 30631 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:21.313555 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 224745us
I20260709 12:20:21.315603 30665 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:21.324581 24176 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:20:21.325058 24176 pending_rounds.cc:85] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 11
I20260709 12:20:21.325263 24176 pending_rounds.cc:107] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 12.12
I20260709 12:20:21.325610 24176 raft_consensus.cc:2889] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:21.222232 30639 consensus_queue.cc:1048] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:20:21.327952 24067 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:21.329579 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:21.328117 24140 consensus_peers.cc:597] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:21.334225 24812 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:20:21.322602 30631 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:21.337009 24140 consensus_peers.cc:597] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:21.330933 30527 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:21.332329 30645 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.334190 30695 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:21.372802 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:21.372982 30645 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:21.343860 24214 consensus_peers.cc:597] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:21.374567 24214 consensus_peers.cc:597] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:21.356110 30672 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:21.355139 30658 ts_tablet_manager.cc:1929] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 11.9
I20260709 12:20:21.368391 24141 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:21.375478 30658 log.cc:1199] T 5bc5bc9605e64854a78054b02b3da6dd P 5d0f174a97494d0cbf08ae81ec4c807a: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/wals/5bc5bc9605e64854a78054b02b3da6dd
I20260709 12:20:21.376967 30670 raft_consensus.cc:2804] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:20:21.357050 30700 log.cc:927] Time spent T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.110s	user 0.000s	sys 0.004s
I20260709 12:20:21.377692 30670 raft_consensus.cc:697] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:21.380626 24780 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:21.386875 30545 raft_consensus.cc:2804] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:21.387485 30545 raft_consensus.cc:697] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 14 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:21.388542 30545 consensus_queue.cc:237] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:21.377113 30658 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:55732 (request call id 9) took 1639 ms. Trace:
I20260709 12:20:21.384124 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:21.393026 30658 rpcz_store.cc:276] 0709 12:20:19.773071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.810431 (+ 37360us) service_pool.cc:224] Handling call
0709 12:20:20.103529 (+293098us) ts_tablet_manager.cc:1151] Deleting tablet 5bc5bc9605e64854a78054b02b3da6dd
0709 12:20:20.175468 (+ 71939us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:20:20.992621 (+817153us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:21.354924 (+362303us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:21.376991 (+ 22067us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":183955,"tablet-delete.queue_time_us":200450,"thread_start_us":39875,"threads_started":1}
I20260709 12:20:21.395364 24810 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:21.373665 24173 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 12.
I20260709 12:20:21.394029 30107 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:21.398669 24214 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:21.400110 30645 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:21.378238 30603 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187) with higher term. Message: Invalid argument: T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14.
I20260709 12:20:21.398753 24781 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:21.412111 24813 raft_consensus.cc:1275] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:20:21.415345 24169 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:20:21.378767 30670 consensus_queue.cc:237] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:21.426393 30462 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:21.433442 30501 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:21.434070 30501 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:21.434514 30501 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:21.398432 23986 catalog_manager.cc:5028] TS 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): tablet 5bc5bc9605e64854a78054b02b3da6dd (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
W20260709 12:20:21.419550 24140 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:21.461436 30349 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 12:20:21.457613 30136 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.464938 30462 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:21.500665 29909 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:20:21.470293 22903 tablet_replica.cc:333] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:21.472319 30107 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:21.472816 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:21.503387 24245 raft_consensus.cc:3060] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:21.502290 24214 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:21.476454 24243 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:21.480463 24809 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:20:21.484354 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:20:21.512375 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 164267us
I20260709 12:20:21.548053 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:21.553045 24248 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 12:20:21.554191 24214 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:21.554382 22903 raft_consensus.cc:2243] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:21.554194 24140 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:21.550825 24066 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6; no voters: 
W20260709 12:20:21.556568 24140 consensus_peers.cc:597] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:21.556773 30653 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:21.557344 30653 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Leader. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:21.523945 30604 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:21.505537 30136 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:21.690235 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 130210us
I20260709 12:20:21.542802 24245 raft_consensus.cc:2468] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
W20260709 12:20:21.584326 24140 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:21.673662 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 111282us
I20260709 12:20:21.675235 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:21.558355 30653 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:21.687537 24244 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:20:21.691767 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:21.689204 24214 consensus_peers.cc:597] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:21.702034 24810 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:21.702786 24810 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:20:21.701436 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 144445us
W20260709 12:20:21.719806 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 162628us
W20260709 12:20:21.720714 24140 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:21.721827 24140 consensus_peers.cc:597] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:21.723272 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:21.727397 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:21.727531 24810 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:21.733255 22903 raft_consensus.cc:2272] T 66b5cb14ed8f4b58a27e168bcac560d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:21.689275 30627 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.742467 24170 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:21.737761 24215 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:21.740586 30705 log.cc:927] Time spent T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.180s	user 0.000s	sys 0.004s
I20260709 12:20:21.735591 30670 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:21.769253 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 71112.1us
I20260709 12:20:21.701929 30517 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 12:20:21.730870 30314 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:20:21.770773 30392 raft_consensus.cc:2804] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:20:21.757913 30690 consensus_queue.cc:1048] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
W20260709 12:20:21.852226 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 93699.9us
I20260709 12:20:21.770503 30627 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:21.877997 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 113042us
I20260709 12:20:21.826198 30527 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:21.856127 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 110404us
I20260709 12:20:21.811098 30671 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.086s
I20260709 12:20:21.809175 30645 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260709 12:20:21.848307 30392 raft_consensus.cc:697] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:21.907780 30527 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:21.920481 30719 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:22.027611 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 247563us
I20260709 12:20:22.028618 24066 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:22.019877 30519 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:21.961344 30501 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.050810 24141 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:22.055083 24214 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 206 similar messages]
I20260709 12:20:22.034611 30409 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:21.955749 30719 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:22.042008 23986 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 290d272848834ed2813ddb5e16609dba with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER failed with leader 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260709 12:20:22.117172 23986 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 75224.1us
W20260709 12:20:22.120393 30718 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:20:22.121891 30668 raft_consensus.cc:2804] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:22.122534 30668 raft_consensus.cc:697] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:22.122807 30695 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.267858 30409 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.140684 22903 tablet_replica.cc:333] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:22.059159 30519 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.136914 30724 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.040319 30392 consensus_queue.cc:237] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.414387 22903 raft_consensus.cc:2243] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.307641 30627 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:22.433758 30733 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.381s	user 0.000s	sys 0.001s
I20260709 12:20:22.434871 30527 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:22.435209 30716 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.521s	user 0.001s	sys 0.000s
I20260709 12:20:22.443149 22903 raft_consensus.cc:2272] T e1bb72a9478347d3a00d4ee984094ca3 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.313453 30695 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.319329 30409 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.514598 24250 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 3510) took 1033 ms. Trace:
W20260709 12:20:22.515915 30739 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:20:22.518685 22903 tablet_replica.cc:333] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:22.515208 24250 rpcz_store.cc:276] 0709 12:20:21.481502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.481661 (+   159us) service_pool.cc:224] Handling call
0709 12:20:21.482074 (+   413us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:21.482577 (+   503us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:21.482611 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:21.483465 (+   854us) log.cc:844] Serialized 52 byte log entry
0709 12:20:21.757173 (+273708us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:22.016204 (+259031us) log.cc:844] Serialized 14 byte log entry
0709 12:20:22.019350 (+  3146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.019459 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:22.514280 (+494821us) raft_consensus.cc:1685] finished
0709 12:20:22.514306 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:22.514512 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2837,"prepare.queue_time_us":128547,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":6858,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":11338,"thread_start_us":498038,"threads_started":2,"wal-append.queue_time_us":325161}
W20260709 12:20:22.546816 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:22.499079 30527 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:22.598621 30712 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.684s	user 0.001s	sys 0.000s
W20260709 12:20:22.600896 30738 log.cc:927] Time spent T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:20:22.601605 30136 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:22.425846 30668 consensus_queue.cc:237] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:22.610483 30501 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:22.611104 30736 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:22.611979 30736 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.613191 30409 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:22.614599 30519 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:22.615257 30519 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:22.614856 30736 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:22.615752 30519 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:22.615769 22903 raft_consensus.cc:2243] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:22.619722 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 568975us
I20260709 12:20:22.494431 30724 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:22.630617 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 521887us
W20260709 12:20:22.632136 24215 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.000s	sys 0.014s
W20260709 12:20:22.632627 24215 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.000s	sys 0.014s
W20260709 12:20:22.632969 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 678092us
I20260709 12:20:22.622690 30527 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.641611 24808 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:22.642391 30527 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:22.594748 30719 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:22.667300 22903 raft_consensus.cc:2272] T f4b7521a95604ae58fb9e26c98b5e4a6 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.635778 30696 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:22.675428 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:22.661206 30519 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:22.678293 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:22.679747 24807 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:22.683384 30722 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:22.684047 30722 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.686381 30722 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:22.687776 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:22.693698 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:22.697310 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:22.668921 30379 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:22.707573 24243 raft_consensus.cc:1275] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:20:22.711067 30107 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:22.711651 30107 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:22.713356 30107 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:22.832962 30737 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:22.833918 24142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.014s
W20260709 12:20:22.834353 24142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.000s	sys 0.014s
I20260709 12:20:22.833813 30737 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:22.835173 30533 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:22.835799 30533 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.838869 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:22.833855 22903 tablet_replica.cc:333] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:22.844141 30533 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:22.689683 30696 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.856293 22903 raft_consensus.cc:2243] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:22.708829 30379 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:22.837370 30527 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.905016 22903 raft_consensus.cc:2272] T 07fcc70b8c0d43ae8334ea802c9a9924 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:22.841925 30467 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:22.918655 30743 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:22.919493 30743 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:22.922302 30743 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.007277 30411 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.053761 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 342164us
I20260709 12:20:22.946743 30695 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.068585 30743 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.079531 24249 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 3498) took 1521 ms. Trace:
I20260709 12:20:23.072815 30749 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:22.917160 30527 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.068166 30668 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:22.967653 30467 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.107816 30646 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:23.067624 30411 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.099967 30737 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:23.121373 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 351650us
I20260709 12:20:23.084302 30136 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:23.122809 30349 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:23.113509 24806 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:20:23.121409 24249 rpcz_store.cc:276] 0709 12:20:21.548130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.549821 (+  1691us) service_pool.cc:224] Handling call
0709 12:20:21.676355 (+126534us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:21.742053 (+ 65698us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:21.742087 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:21.998448 (+256361us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b2c000970b8. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c03e74a11 00007f4c03e84372 00007f4c055b6a01 00007f4c0557b43a 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2
0709 12:20:21.999012 (+   564us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.124750 (+125738us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:20:22.124796 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:23.060620 (+935824us) spinlock_profiling.cc:243] Waited 54.9 ms on lock 0x7b5400059454. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:23.060716 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:23.060820 (+   104us) raft_consensus.cc:1685] finished
0709 12:20:23.060841 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.069328 (+  8487us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14607,"raft.queue_time_us":10457,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":10239,"spinlock_wait_cycles":151515520,"thread_start_us":77450,"threads_started":1,"wal-append.queue_time_us":268214}
I20260709 12:20:23.125653 30749 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.083250 30743 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.158337 30752 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:23.158143 30349 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.146250 30646 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.137518 30668 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.161058 30349 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.161360 30646 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.161556 30641 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:23.162163 30641 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.162546 30668 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.163154 30527 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.164399 30641 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.164695 30749 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.165105 30527 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:20:23.154143 30737 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:23.171969 22903 tablet_replica.cc:333] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:23.159148 30752 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.168922 30411 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.154088 30136 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:23.174913 30713 log.cc:927] Time spent T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 1.148s	user 0.018s	sys 0.010s
I20260709 12:20:23.200160 22903 raft_consensus.cc:2243] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:23.179706 30641 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:23.216928 30754 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:23.217650 30754 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.220069 30754 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.220679 30704 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:23.221284 30704 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.221738 30756 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:23.222324 30756 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:23.223129 30711 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 1.350s	user 0.010s	sys 0.013s
I20260709 12:20:23.224604 30136 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.224901 30756 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.225651 30743 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.225405 30641 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.191651 30737 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.227905 30641 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.228746 24812 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33922 (request call id 1006) took 1753 ms. Trace:
I20260709 12:20:23.231689 30755 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.232344 30755 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.234660 30755 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.235437 22903 raft_consensus.cc:2272] T f1c672629a7b441f9e55890cd643e03a P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:23.235244 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.238727 24809 raft_consensus.cc:2410] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 11.
I20260709 12:20:23.225553 30756 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:23.229219 24812 rpcz_store.cc:276] 0709 12:20:21.474897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.477581 (+  2684us) service_pool.cc:224] Handling call
0709 12:20:21.477935 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:21.478410 (+   475us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:20:21.478738 (+   328us) log.cc:844] Serialized 14 byte log entry
0709 12:20:21.770322 (+291584us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:21.777857 (+  7535us) log.cc:844] Serialized 26 byte log entry
0709 12:20:21.778019 (+   162us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:20:21.778053 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:21.778131 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:23.102926 (+1324795us) spinlock_profiling.cc:243] Waited 52.2 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:20:23.228345 (+125419us) raft_consensus.cc:1685] finished
0709 12:20:23.228472 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:23.228644 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8968,"prepare.queue_time_us":160,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":21307,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":11577,"spinlock_wait_cycles":120166784,"thread_start_us":277054,"threads_started":1,"wal-append.queue_time_us":414408}
I20260709 12:20:23.208401 30696 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.236894 30737 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:23.252058 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 193612us
I20260709 12:20:23.248900 30756 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.261016 30754 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:23.261521 30655 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.262300 22903 tablet_replica.cc:333] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:23.262110 30655 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.263484 22903 raft_consensus.cc:2243] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:23.263945 30752 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.264245 22903 raft_consensus.cc:2272] T 984475bb8f024d469921acdc98196b93 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:23.267432 30467 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.255378 30704 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.271556 22903 tablet_replica.cc:333] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:23.281329 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.272089 30762 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:23.284176 22903 raft_consensus.cc:2243] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:23.287657 24242 raft_consensus.cc:1240] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Rejecting Update request from peer 5d0f174a97494d0cbf08ae81ec4c807a for earlier term 13. Current term is 14. Ops: []
I20260709 12:20:23.289878 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:23.290552 24170 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:23.292217 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.294606 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.295593 24806 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: []
I20260709 12:20:23.296178 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.296525 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.305649 30655 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.312780 30756 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.271672 30752 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:23.313912 30752 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.316954 22903 pending_rounds.cc:70] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 1 pending ops.
I20260709 12:20:23.321269 22903 pending_rounds.cc:77] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 15 index: 10 } timestamp: 7305623984020066304 op_type: NO_OP noop_request { }
I20260709 12:20:23.322757 22903 raft_consensus.cc:2889] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:23.323076 24170 raft_consensus.cc:2468] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 13.
I20260709 12:20:23.323282 22903 raft_consensus.cc:2272] T 988ca15bb1fd49b7822eef733e4a24a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:23.298342 30603 consensus_queue.cc:1059] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:20:23.330938 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:23.332154 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 48923.8us
I20260709 12:20:23.382828 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce278f8a39b344f9a0cd7dcd099a3b66" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:23.385891 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:23.386957 24245 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 16.
W20260709 12:20:23.388664 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 54634.6us
W20260709 12:20:23.379254 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 88202us
I20260709 12:20:23.340225 30603 raft_consensus.cc:3055] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:20:23.399809 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.419037 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:23.420079 24244 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 14.
I20260709 12:20:23.423194 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:23.426826 24811 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.296110 30762 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.388417 30349 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:23.397459 30603 raft_consensus.cc:740] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:23.427681 30462 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:23.387621 30755 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.087s
I20260709 12:20:23.457727 30721 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:23.500041 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.509676 30779 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:23.514312 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 124615us
I20260709 12:20:23.486065 30349 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.514312 30704 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.513780 30779 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.539106 24169 raft_consensus.cc:1240] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260709 12:20:23.540041 24176 raft_consensus.cc:1275] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:20:23.540530 24176 pending_rounds.cc:85] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 12
I20260709 12:20:23.540786 24176 pending_rounds.cc:107] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:20:23.541085 24176 raft_consensus.cc:2889] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:23.517302 30773 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:23.526491 30631 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.546809 24170 raft_consensus.cc:1275] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:20:23.543908 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:23.547261 24170 pending_rounds.cc:85] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 12
I20260709 12:20:23.547905 24170 pending_rounds.cc:107] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:20:23.548287 24170 raft_consensus.cc:2889] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:23.507884 30462 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.553009 24781 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:23.571844 30759 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:20:23.572809 30526 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:23.573550 30526 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.516254 30721 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.542663 30639 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:23.584331 24175 raft_consensus.cc:1275] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:20:23.643970 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:23.645848 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 61170.3us
W20260709 12:20:23.655387 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 102476us
I20260709 12:20:23.664740 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:23.552799 30751 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:23.583290 30766 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:20:23.669667 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.672369 24243 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:20:23.566931 30770 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:23.533895 30603 consensus_queue.cc:260] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.545984 30704 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.675450 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:23.679911 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.647415 30728 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.663560 30641 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.696854 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:23.550132 30773 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.722939 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:23.552345 30631 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.725153 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:23.749171 24815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.750560 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.751796 24806 raft_consensus.cc:2410] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:20:23.726841 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07add62ce67548c3bdb714821b78d1d1" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.668831 30527 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.670920 30645 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.673328 30775 raft_consensus.cc:2804] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:20:23.676342 30751 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:23.764138 30781 log.cc:927] Time spent T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 12:20:23.765620 30751 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.766004 30645 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.748939 30487 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.767499 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.767622 30487 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.768622 30645 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.769230 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.770458 30487 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.770753 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.771421 30779 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.749416 30728 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.772145 30762 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.689869 30622 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:23.758318 22903 tablet_replica.cc:333] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:23.772966 30622 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.773635 22903 raft_consensus.cc:2243] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:20:23.774528 22903 pending_rounds.cc:70] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 2 pending ops.
I20260709 12:20:23.774808 22903 pending_rounds.cc:77] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 9 index: 10 } timestamp: 7305624047707852800 op_type: NO_OP noop_request { }
I20260709 12:20:23.694950 30770 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.775362 22903 raft_consensus.cc:2889] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:23.762012 30704 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.772351 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984475bb8f024d469921acdc98196b93" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.755787 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46a4dd5f831f4ddca30827249660c52a" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.651014 30639 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.775715 22903 pending_rounds.cc:77] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 7 index: 9 } timestamp: 7305624003408936960 op_type: NO_OP noop_request { }
I20260709 12:20:23.789776 22903 raft_consensus.cc:2889] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:23.790258 22903 raft_consensus.cc:2272] T 7b5b70d71470484d8fc5f942623adb98 P 729aa4b1ccec48b588c14e67652c61e1 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:23.788604 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.795255 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0996a24d22664e97aa7ba765bb20ef47" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.761898 30773 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.809434 29909 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:23.810079 29909 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.807607 30771 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:23.813732 30771 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.816561 30771 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.822417 22903 tablet_replica.cc:333] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:23.776399 30527 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.787307 30775 raft_consensus.cc:697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:23.823777 22903 raft_consensus.cc:2243] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:23.825153 22903 raft_consensus.cc:2272] T 5bc5bc9605e64854a78054b02b3da6dd P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:23.825955 30721 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.826346 30349 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.774636 30728 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.828673 22903 tablet_replica.cc:333] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:23.829721 22903 raft_consensus.cc:2243] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:23.830477 22903 pending_rounds.cc:70] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 1 pending ops.
I20260709 12:20:23.831964 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.833986 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.835330 30770 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.835733 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4e320f288fdb4be0ada8bfff79b41a9a" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.752774 30641 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.837299 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.838721 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.838861 30641 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.840248 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.840965 30639 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:23.842052 30631 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:23.842677 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 262392us
I20260709 12:20:23.843545 30462 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.825085 30527 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.824491 30775 consensus_queue.cc:237] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.845844 24806 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Refusing update from remote peer 729aa4b1ccec48b588c14e67652c61e1: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:20:23.862051 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:23.863998 24141 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:23.879962 29909 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.850317 30622 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:23.830747 22903 pending_rounds.cc:77] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 13 index: 13 } timestamp: 7305624003397824512 op_type: NO_OP noop_request { }
I20260709 12:20:23.929733 22903 raft_consensus.cc:2889] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:23.930380 22903 raft_consensus.cc:2272] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:23.882369 30639 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:23.882401 30664 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:23.879190 30526 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.885613 30721 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.941391 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 294652us
I20260709 12:20:23.920529 30527 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:23.944731 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 220072us
I20260709 12:20:23.975898 30527 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:23.978394 30527 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:23.941941 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 184043us
I20260709 12:20:23.978917 30721 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:23.973876 30709 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 2.186s	user 0.012s	sys 0.030s
W20260709 12:20:23.980706 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:23.985013 30721 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:23.992017 30622 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:23.992843 30622 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:23.995952 30622 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:23.997543 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 271400us
I20260709 12:20:24.001919 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.882009 30487 consensus_queue.cc:1048] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260709 12:20:23.998535 30527 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:20:24.008531 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:23.936476 30756 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:24.009326 24813 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
I20260709 12:20:24.016564 24812 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.019797 30664 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.020383 30664 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.025041 24141 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:24.026134 30721 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:24.026522 30721 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.027477 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.026865 30721 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.031529 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.035377 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.042104 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee66a7413b024d4b8e542242a567c0cf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.044687 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.046496 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.944136 30782 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.048183 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e33dc2dd26074c7d8437ce5a91c0f8bf" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.968472 30742 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:24.052156 24066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.057739 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.063344 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.067744 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:23.969812 30639 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:24.072327 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.053128 30527 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:24.076407 24065 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.085357 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66b5cb14ed8f4b58a27e168bcac560d2" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.060555 30782 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.088970 30782 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:24.086705 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.084524 30527 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.090937 30787 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:24.091295 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.092404 30527 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:24.092577 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.093652 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2152258f0d654836a042cc0cf00d66a3" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.096769 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.097952 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.090937 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.095592 24066 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.104377 24066 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.064035 30742 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:24.045665 30756 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.108179 24066 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.117928 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.118553 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.120591 30631 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:24.109179 30787 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:24.137800 30741 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 1.466s	user 0.006s	sys 0.018s
I20260709 12:20:24.138748 30724 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:24.143548 30639 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:24.144981 30664 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:24.146320 24814 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 1496) took 2418 ms. Trace:
I20260709 12:20:24.146752 24814 rpcz_store.cc:276] 0709 12:20:21.727889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:21.728744 (+   855us) service_pool.cc:224] Handling call
0709 12:20:21.729109 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:20:21.729562 (+   453us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:21.729589 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:20:21.730203 (+   614us) log.cc:844] Serialized 26 byte log entry
0709 12:20:22.115303 (+385100us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:22.115370 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:22.115480 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.064001 (+1948521us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c0511686e 00007f4c05115bb6 00007f4c051157d8 00007f4c0511f221 00007f4c0511f1d9 00007f4c0511f169
0709 12:20:24.145778 (+ 81777us) raft_consensus.cc:1685] finished
0709 12:20:24.145810 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.146218 (+   408us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1006,"raft.queue_time_us":670,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":39838080,"thread_start_us":337507,"threads_started":1,"wal-append.queue_time_us":904732}
I20260709 12:20:24.152998 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.153752 24245 raft_consensus.cc:2468] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 11.
I20260709 12:20:24.153831 30721 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.155088 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "290d272848834ed2813ddb5e16609dba" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:24.155798 24067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.155964 24250 raft_consensus.cc:2393] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 in current term 20: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:24.158126 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.164127 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.167847 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.169399 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.170300 30724 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:24.126870 30526 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:20:24.171695 30526 consensus_queue.cc:1243] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer fa8cfbff90bf4881a56772b05008aadb log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:20:24.172703 24167 raft_consensus.cc:1240] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Rejecting Update request from peer 729aa4b1ccec48b588c14e67652c61e1 for earlier term 16. Current term is 17. Ops: []
I20260709 12:20:24.175042 30721 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:24.176047 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2b8234ad7d402bb1de3ebc3a408c0f" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.181005 24250 raft_consensus.cc:2410] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:20:24.176781 30742 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:24.177250 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.178203 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.186820 24809 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:24.192409 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f40c9d3e625486382331d48f50901e2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.192790 24066 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:24.193780 24245 raft_consensus.cc:2410] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:20:24.196070 24245 pending_rounds.cc:85] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Aborting all ops after (but not including) 10
I20260709 12:20:24.195847 24066 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.196736 24245 pending_rounds.cc:107] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260709 12:20:24.198011 24245 raft_consensus.cc:2889] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:24.107909 30527 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:24.200500 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.201195 22903 tablet_replica.cc:333] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:24.203708 24247 raft_consensus.cc:2410] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 729aa4b1ccec48b588c14e67652c61e1 for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 10.
I20260709 12:20:24.199618 30787 raft_consensus.cc:2804] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:20:24.207168 30787 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:24.207624 30787 raft_consensus.cc:3060] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.211185 30526 raft_consensus.cc:3060] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:20:24.202224 30646 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:24.202534 30644 raft_consensus.cc:3055] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:20:24.204259 22903 raft_consensus.cc:2243] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.233317 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.244869 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.245803 24246 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 9.
W20260709 12:20:24.247247 23986 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 290d272848834ed2813ddb5e16609dba with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER failed with leader 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:20:24.256129 22903 pending_rounds.cc:70] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 1 pending ops.
I20260709 12:20:24.262487 22903 pending_rounds.cc:77] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 16 index: 12 } timestamp: 7305624002480349184 op_type: NO_OP noop_request { }
I20260709 12:20:24.263039 22903 raft_consensus.cc:2889] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:24.263433 22903 raft_consensus.cc:2272] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:24.264577 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.229802 30644 raft_consensus.cc:740] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:24.214771 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.224197 24241 raft_consensus.cc:1275] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:24.276400 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.224681 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:24.271268 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.204870 24066 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:24.278581 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 54191us
I20260709 12:20:24.258165 30357 raft_consensus.cc:493] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:24.280951 30786 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:24.281512 30786 raft_consensus.cc:493] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:24.281987 30786 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:24.280944 30357 raft_consensus.cc:515] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.280247 30379 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:24.289419 24780 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:24.279781 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 75037.1us
I20260709 12:20:24.291854 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.297804 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.301179 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.243292 30646 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.303879 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:24.303033 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 117568us
I20260709 12:20:24.290575 30527 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:24.315507 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.315649 24243 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.290762 30752 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:24.326638 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:24.324414 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 209640us
I20260709 12:20:24.315644 30704 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:24.330094 22903 tablet_replica.cc:333] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:24.315340 30788 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:24.343441 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.343670 30357 leader_election.cc:290] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:24.346911 24243 raft_consensus.cc:1275] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:20:24.346518 30788 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.356505 30646 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:24.358223 30788 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:24.359594 24242 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40978 (request call id 3513) took 1667 ms. Trace:
I20260709 12:20:24.360003 24246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.360749 24246 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 18.
I20260709 12:20:24.367548 24250 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.359627 24167 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:20:24.368551 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 70847.5us
I20260709 12:20:24.360054 24242 rpcz_store.cc:276] 0709 12:20:22.692332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:22.693100 (+   768us) service_pool.cc:224] Handling call
0709 12:20:22.702551 (+  9451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.288804 (+586253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.359313 (+1070509us) spinlock_profiling.cc:243] Waited 585 ms on lock 0x7b5400059e54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:24.359521 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1344892928}
I20260709 12:20:24.336898 30704 raft_consensus.cc:493] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
W20260709 12:20:24.378787 24140 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.381361 29909 consensus_queue.cc:1048] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:20:24.391698 24807 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4b7521a95604ae58fb9e26c98b5e4a6" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.389496 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.393785 22903 raft_consensus.cc:2243] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:24.377965 30527 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:24.378144 30747 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.447623 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.457718 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.378419 30549 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:24.393986 30704 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:24.326947 30644 consensus_queue.cc:260] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.465656 22903 raft_consensus.cc:2272] T f9a75b1a807b49b791d2de5abd8f8ca1 P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:24.455358 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47828us
I20260709 12:20:24.394546 30724 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:24.473614 24067 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:24.478853 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.480278 30747 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:24.481590 24174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.482429 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.484095 24806 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:20:24.484776 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.487051 29909 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:24.498020 29909 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:24.399857 30775 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.084s
I20260709 12:20:24.477228 30136 consensus_queue.cc:1059] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:20:24.479979 30549 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.570796 24811 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33918 (request call id 1516) took 1045 ms. Trace:
I20260709 12:20:24.531606 29909 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:24.505002 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 125247us
W20260709 12:20:24.621687 24214 consensus_peers.cc:597] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:24.698238 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 76685.6us
I20260709 12:20:24.696066 24811 rpcz_store.cc:276] 0709 12:20:23.525258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.525446 (+   188us) service_pool.cc:224] Handling call
0709 12:20:23.533308 (+  7862us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:20:23.762591 (+229283us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.762645 (+    54us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:20:23.762704 (+    59us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:23.762751 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.570486 (+807735us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b5400488d54. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557be01 00007f4c0557a83e 00007f4c0a53f419 00007f4c03ab6bd4 00007f4c03ab6b62 00007f4c03ab6a91 00007f4c03ab6a0c 00007f4c03ab5cc2 00007f4c038b648c 00007f4c038b58c6
0709 12:20:24.570546 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.570710 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":526463360}
W20260709 12:20:24.621636 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 57992.4us
W20260709 12:20:24.623584 24779 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.703233 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:24.647763 30808 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
I20260709 12:20:24.503719 30645 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:24.649263 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 169561us
I20260709 12:20:24.607558 24174 raft_consensus.cc:1275] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:20:24.707566 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 84035us
I20260709 12:20:24.685684 30756 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:24.539389 30779 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:24.709309 24067 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:24.709685 30774 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:24.719187 30357 consensus_queue.cc:1048] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
W20260709 12:20:24.723783 30819 log.cc:927] Time spent T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:20:24.738883 24067 raft_consensus.cc:2686] T ee66a7413b024d4b8e542242a567c0cf P 729aa4b1ccec48b588c14e67652c61e1: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:24.740727 24067 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:24.712649 24216 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:24.638355 30824 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:24.710273 24779 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.783761 30740 consensus_queue.cc:1048] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:24.784178 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:24.785338 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 75127.3us
I20260709 12:20:24.785434 30641 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:24.785841 24067 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.568224 30526 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:24.753811 30787 consensus_meta.cc:287] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: Time spent flushing consensus metadata: real 0.546s	user 0.012s	sys 0.000s
I20260709 12:20:24.756657 30724 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:24.804636 30644 raft_consensus.cc:3060] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:20:24.805245 30787 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:24.807817 30787 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:24.756522 30786 raft_consensus.cc:515] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.808492 23998 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.809286 30392 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:20:24.810422 30786 leader_election.cc:290] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:24.713627 30379 consensus_queue.cc:1048] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:20:24.812722 30787 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:24.817632 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 189) took 10251 ms. Trace:
I20260709 12:20:24.765133 30603 raft_consensus.cc:3060] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:20:24.771394 30747 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:24.783672 30824 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:24.786115 24779 leader_election.cc:336] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.833561 24779 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:24.710419 24214 leader_election.cc:336] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.714164 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:24.834537 24214 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:24.788763 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: c090031f610346ed82285cd847bca6d6
I20260709 12:20:24.791904 22903 tablet_replica.cc:333] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
W20260709 12:20:24.835206 24066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 160607us
I20260709 12:20:24.796893 24244 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40990 (request call id 3507) took 1216 ms. Trace:
I20260709 12:20:24.801638 30704 raft_consensus.cc:515] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.802398 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:24.814105 24067 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.825342 23998 catalog_manager.cc:5697] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 10 to 11, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:24.764556 30549 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:24.828444 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 115930us
I20260709 12:20:24.829149 29909 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:24.845947 24067 raft_consensus.cc:2686] T 0ab5a3f1f43046a9860089fc73f7efff P 729aa4b1ccec48b588c14e67652c61e1: unable to run election callback: Service unavailable: Thread pool token was shut down
W20260709 12:20:24.792358 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 47238.1us
W20260709 12:20:24.839193 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 129847us
I20260709 12:20:24.847635 24067 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.840651 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:24.848884 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:24.843096 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 54439.8us
I20260709 12:20:24.849989 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:24.844168 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 58093.6us
I20260709 12:20:24.836005 24244 rpcz_store.cc:276] 0709 12:20:23.580528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.580682 (+   154us) service_pool.cc:224] Handling call
0709 12:20:23.581134 (+   452us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:20:23.581652 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:20:23.581698 (+    46us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:20:23.582484 (+   786us) log.cc:844] Serialized 52 byte log entry
0709 12:20:24.568243 (+985759us) spinlock_profiling.cc:243] Waited 4.95 ms on lock 0x7b1800192700. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c02470e07 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b 00007f4c0511ad23 00007f4c0511b0d1 00007f4c05536a0f
0709 12:20:24.620103 (+ 51860us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:20:24.666358 (+ 46255us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.669712 (+  3354us) log.cc:844] Serialized 14 byte log entry
0709 12:20:24.671323 (+  1611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:20:24.671459 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:20:24.771347 (+ 99888us) spinlock_profiling.cc:243] Waited 1.79 ms on lock 0x7b1800192700. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0245c2a6 00007f4c0245c240
0709 12:20:24.772238 (+   891us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b1800192700. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:20:24.784336 (+ 12098us) spinlock_profiling.cc:243] Waited 3 ms on lock 0x7b1800192700. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c0b356ab1 00007f4c0b363281 00007f4c0248e3f3 00007f4c024907c1 00007f4c02490779 00007f4c02490709 00007f4c024906d1 00007f4c0248f9cd 0000000000388634 0000000000388479 00007f4c0247183a
0709 12:20:24.796635 (+ 12299us) raft_consensus.cc:1685] finished
0709 12:20:24.796662 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:20:24.796823 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2636,"prepare.queue_time_us":129857,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":72,"raft.queue_time_us":8974,"raft.run_cpu_time_us":499,"raft.run_wall_time_us":24615,"spinlock_wait_cycles":27245696,"thread_start_us":51604,"threads_started":1,"wal-append.queue_time_us":1032077}
W20260709 12:20:24.851950 24779 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:24.852908 24779 leader_election.cc:336] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.853488 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.853755 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:24.855733 24216 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:24.863328 24779 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.863718 24067 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:24.864111 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:24.865792 24067 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.830080 23996 rpcz_store.cc:276] 0709 12:20:14.566333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:14.566663 (+   330us) service_pool.cc:224] Handling call
0709 12:20:24.817519 (+10250856us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:19.188579 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:19.189590 (+  1011us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:19.189658 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:20:19.189684 (+    26us) tablet.cc:662] Decoding operations
0709 12:20:19.192072 (+  2388us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:19.192216 (+   144us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:19.192246 (+    30us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:20:19.194086 (+  1840us) tablet.cc:701] Row locks acquired
0709 12:20:19.194146 (+    60us) write_op.cc:260] PREPARE: finished
0709 12:20:19.194383 (+   237us) write_op.cc:270] Start()
0709 12:20:19.194573 (+   190us) write_op.cc:276] Timestamp: P: 1783599619194301 usec, L: 0
0709 12:20:19.194618 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:20:19.197820 (+  3202us) log.cc:844] Serialized 7490 byte log entry
0709 12:20:19.457375 (+259555us) op_driver.cc:464] REPLICATION: finished
0709 12:20:19.818903 (+361528us) write_op.cc:301] APPLY: starting
0709 12:20:19.819067 (+   164us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:20.411760 (+592693us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:20.411925 (+   165us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:21.248434 (+836509us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:21.248855 (+   421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:20:21.248904 (+    49us) write_op.cc:312] APPLY: finished
0709 12:20:21.249458 (+   554us) log.cc:844] Serialized 172 byte log entry
0709 12:20:21.285107 (+ 35649us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:21.285628 (+   521us) write_op.cc:454] Released schema lock
0709 12:20:21.285783 (+   155us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:21.311439 (+ 25656us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:21.311478 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":660121,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":345018,"apply.run_cpu_time_us":58788,"apply.run_wall_time_us":1492515,"cfile_cache_hit":78,"cfile_cache_hit_bytes":83585,"num_ops":19,"prepare.queue_time_us":144542,"prepare.run_cpu_time_us":10201,"prepare.run_wall_time_us":49558,"raft.queue_time_us":153141,"raft.run_cpu_time_us":24170,"raft.run_wall_time_us":313512,"replication_time_us":219855,"thread_start_us":501752,"threads_started":5,"wal-append.queue_time_us":123949,"wal-append.run_cpu_time_us":13132,"wal-append.run_wall_time_us":2200430}]]}
W20260709 12:20:24.898458 24142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:20:24.899401 24216 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:24.900779 29909 raft_consensus.cc:2749] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:24.842453 30787 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:24.853082 30779 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:24.867633 30549 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:24.854274 30747 raft_consensus.cc:2749] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:24.846001 30786 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:24.867091 30754 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:20:24.896314 24779 leader_election.cc:336] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.866639 30664 raft_consensus.cc:2749] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:24.886669 30641 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:24.919667 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.901914 30610 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:24.911128 24140 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.908376 30779 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
W20260709 12:20:24.915828 24779 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.918511 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b29f161fe0e24b51ad5c1903bdc5112c" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.919094 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.919271 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.921674 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73fc2a59a00e4ea6a3b63c28c6f58512" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.903517 24141 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.922500 24242 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9a75b1a807b49b791d2de5abd8f8ca1" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.906023 30780 consensus_queue.cc:1048] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.014s
W20260709 12:20:24.934353 24140 consensus_peers.cc:597] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:24.935596 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "683c964dc5814af698a7b4af6649e9ed" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:24.937996 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07fcc70b8c0d43ae8334ea802c9a9924" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:24.938650 24249 raft_consensus.cc:3060] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:24.927394 24779 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.936168 24141 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.940474 30830 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:24.931797 30829 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:24.942646 30664 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:24.943066 22903 raft_consensus.cc:2243] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:20:24.947152 24214 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.957595 24214 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:24.939708 24779 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:24.907864 30787 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:24.912925 30527 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:24.926353 30779 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:20:24.961534 24214 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.963064 24214 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:24.962498 30754 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:24.965020 30754 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:24.963182 24780 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:24.967465 24214 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.968685 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:24.963712 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.937002 30645 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:24.957067 30670 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:24.988912 24214 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:24.970466 24780 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.965092 23998 catalog_manager.cc:5697] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 9 to 11, now has a pending config: VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194), VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195), VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:24.978237 30765 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:24.984543 24140 consensus_peers.cc:597] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:24.969025 24779 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.995229 24779 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:24.997488 24249 raft_consensus.cc:2468] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 17.
W20260709 12:20:24.998260 24779 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.004927 23998 catalog_manager.cc:5697] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:25.006134 24067 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 140404us
I20260709 12:20:25.011816 24780 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.012144 24067 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:25.013849 24140 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:24.977617 30641 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.014729 24140 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:20:25.013160 24214 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.019356 24780 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.017560 24214 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:25.018344 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:24.988850 30644 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:25.026352 24140 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.026566 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:25.028666 24214 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.028656 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.029217 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:25.030195 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
W20260709 12:20:25.030699 24140 leader_election.cc:336] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.031328 24140 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.008471 30622 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.007232 30773 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:25.033643 24214 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.014400 30631 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:25.033753 24780 leader_election.cc:304] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:25.035559 30663 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:25.025409 30501 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:20:25.037643 30770 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:20:25.058051 30824 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:25.073843 30641 raft_consensus.cc:2804] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:25.073678 30770 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:25.074529 30770 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:20:25.055006 30833 log.cc:927] Time spent T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:20:25.056556 30704 leader_election.cc:290] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:25.027772 30765 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:25.059947 30780 consensus_queue.cc:1048] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:25.023237 30645 consensus_queue.cc:1059] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260709 12:20:25.035642 30754 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.062847 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:25.038574 24140 leader_election.cc:336] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.020110 30664 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.040580 30742 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:25.039873 24214 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.091303 24214 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:25.092327 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 52491.7us
W20260709 12:20:25.093045 24214 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.093448 24214 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:25.027496 30749 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:25.031206 30769 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.072225 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:25.074544 30641 raft_consensus.cc:697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 17 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:25.037973 30610 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:25.060097 30787 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:25.053328 22903 raft_consensus.cc:2272] T 25a02c46886249619a17c69df6ded3b4 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:25.080705 24247 raft_consensus.cc:1275] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
W20260709 12:20:25.081265 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 80661.5us
I20260709 12:20:25.081393 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc5bc9605e64854a78054b02b3da6dd" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:25.107261 24241 raft_consensus.cc:3060] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:25.084173 23998 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 12 to 13, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 13 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:25.087401 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:20:25.110405 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 71867.1us
W20260709 12:20:25.111186 24140 leader_election.cc:336] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.111613 24140 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:25.114632 24140 consensus_peers.cc:597] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:25.035678 30549 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.115896 30663 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.116741 30641 consensus_queue.cc:237] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:25.097541 24214 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.096300 30754 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:25.118603 24214 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:25.123373 24214 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.123644 30754 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:25.123867 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:25.124732 30774 consensus_queue.cc:1048] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:25.130721 30549 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:25.132238 24214 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.132701 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:25.134473 30824 raft_consensus.cc:3055] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:20:25.144812 24214 consensus_peers.cc:597] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:25.152926 24140 consensus_peers.cc:597] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:25.155539 23998 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 15 to 17, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 17 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:25.158720 24214 leader_election.cc:336] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.098694 30379 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:25.162253 24140 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:25.167168 24140 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.167773 24140 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.167011 23998 catalog_manager.cc:5697] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:25.139444 30824 raft_consensus.cc:740] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 729aa4b1ccec48b588c14e67652c61e1, State: Running, Role: LEADER
I20260709 12:20:25.164363 24214 leader_election.cc:304] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
W20260709 12:20:25.170686 24140 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.147639 30747 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.113443 30750 raft_consensus.cc:2749] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:25.172386 24140 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:25.176868 24140 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.177214 24176 raft_consensus.cc:2410] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:20:25.173511 29909 raft_consensus.cc:2749] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:25.177448 24140 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:25.179522 24214 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:25.181200 24140 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.181780 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.179631 23998 catalog_manager.cc:5697] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 12 to 16, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 16 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:25.183084 24140 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:25.184582 24140 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.185130 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:25.173331 30670 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:25.189817 23998 catalog_manager.cc:5697] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 15 to 16, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 16 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:20:25.188077 24140 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.191692 24140 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.180661 30603 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:25.194238 24167 raft_consensus.cc:1275] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 12:20:25.195953 24167 pending_rounds.cc:85] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting all ops after (but not including) 10
I20260709 12:20:25.196218 24167 pending_rounds.cc:107] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:20:25.196527 24167 raft_consensus.cc:2889] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:20:25.198045 23998 catalog_manager.cc:5697] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 15 to 16, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 16 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:20:25.187291 30663 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:25.191370 30782 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.202059 24176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:59344 (request call id 3444) took 1650 ms. Trace:
I20260709 12:20:25.184365 30742 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.203521 24176 rpcz_store.cc:276] 0709 12:20:23.543503 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:23.543649 (+   146us) service_pool.cc:224] Handling call
0709 12:20:25.193411 (+1649762us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b540016e9d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e4571 00007f4c0557f2fa 00007f4c0a540b17 00007f4c03abb6d4 00007f4c03abb662 00007f4c03abb591 00007f4c03abb50c 00007f4c03aba7c2 00007f4c038b648c 00007f4c038b58c6 00007f4c038b526f
0709 12:20:25.193615 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3737175808}
I20260709 12:20:25.207008 23998 catalog_manager.cc:5697] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 13 to 14, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 14 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:20:25.195190 30664 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:25.219010 24214 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:25.217708 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 165805us
W20260709 12:20:25.234520 24779 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.235140 24779 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.236061 30501 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:25.239357 30838 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.134s	user 0.000s	sys 0.001s
I20260709 12:20:25.243495 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "882bb02a9e9e423bbbc4df3dd0c55540" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 20 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:25.244761 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30d4ada45d4b4872986993abc4470158" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:25.247442 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "637c5886d38642daacb9b3dac3e4e9d2" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:25.251317 24168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b55ff2c6fc804b36ae275790f8dfe310" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:25.252306 22903 tablet_replica.cc:333] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:25.253371 22903 raft_consensus.cc:2243] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:25.254009 22903 raft_consensus.cc:2272] T 4e320f288fdb4be0ada8bfff79b41a9a P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:25.263859 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67948aed495f4bd9b04d87c9adbfe164" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:25.273391 24241 raft_consensus.cc:2468] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 15.
I20260709 12:20:25.225744 30603 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.295825 24169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:25.296321 24170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:25.311054 24067 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:25.311295 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:25.314195 24140 consensus_peers.cc:597] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:25.224952 30779 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:25.213670 30824 consensus_queue.cc:260] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:25.354157 24067 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:25.352535 30831 log.cc:927] Time spent T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:25.365330 24174 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:25.355486 30724 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:25.355991 30644 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:25.358582 30826 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:25.303831 30603 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:25.379630 24067 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.363420 30526 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:20:25.403441 30836 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:25.416962 30845 log.cc:927] Time spent T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 12:20:25.419531 30847 log.cc:927] Time spent T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:20:25.379462 30824 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:25.430516 30603 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:25.385789 30826 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:25.436410 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:25.434831 30770 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:25.449474 30770 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:25.419341 30779 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:25.463927 24779 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.461782 24170 raft_consensus.cc:2468] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
W20260709 12:20:25.462875 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 123545us
I20260709 12:20:25.464422 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:25.516692 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 62625.4us
I20260709 12:20:25.518757 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:25.520026 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:25.525631 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:25.523379 24173 raft_consensus.cc:2468] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 729aa4b1ccec48b588c14e67652c61e1 in term 16.
I20260709 12:20:25.434901 30826 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:25.539455 22903 tablet_replica.cc:333] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:25.540668 22903 raft_consensus.cc:2243] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:25.548048 22903 pending_rounds.cc:70] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 1 pending ops.
I20260709 12:20:25.549660 22903 pending_rounds.cc:77] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 11 index: 9 } timestamp: 7305624000912097280 op_type: NO_OP noop_request { }
I20260709 12:20:25.551651 22903 raft_consensus.cc:2889] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:25.553376 22903 raft_consensus.cc:2272] T 7bea694ade5d4f1daf189ff65fa4a13f P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:25.520975 30704 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:25.561398 30786 consensus_queue.cc:1059] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:25.569512 24067 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1; no voters: fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:25.579363 24140 consensus_peers.cc:597] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:25.585390 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:25.598626 24140 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.603061 24216 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:25.605768 30392 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:25.618886 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 98604.1us
W20260709 12:20:25.630920 30851 log.cc:927] Time spent T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:20:25.637456 30853 log.cc:927] Time spent T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:20:25.621425 30818 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:20:25.618257 30526 raft_consensus.cc:2804] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:25.666954 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:25.667493 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1bb72a9478347d3a00d4ee984094ca3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:25.667873 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:25.668179 24245 raft_consensus.cc:3060] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:20:25.620730 30655 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:25.657187 30849 log.cc:927] Time spent T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260709 12:20:25.675525 24780 leader_election.cc:304] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:25.670636 30526 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:25.673168 30859 consensus_queue.cc:1048] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:20:25.703053 30501 raft_consensus.cc:2804] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:20:25.729250 24245 raft_consensus.cc:2468] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 19.
W20260709 12:20:25.736258 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 107505us
I20260709 12:20:25.734527 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.703658 30526 raft_consensus.cc:3060] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:20:25.739466 30782 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:25.739671 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:25.742620 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 141466us
I20260709 12:20:25.745918 24141 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:25.747956 30639 raft_consensus.cc:2804] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:20:25.748548 30639 raft_consensus.cc:697] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
I20260709 12:20:25.757889 22903 tablet_replica.cc:333] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:25.741582 30501 raft_consensus.cc:697] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:25.749933 30750 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:20:25.776149 22903 raft_consensus.cc:2243] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:25.770689 30639 consensus_queue.cc:237] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:25.788257 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 272155us
W20260709 12:20:25.792608 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 274587us
W20260709 12:20:25.793430 24779 leader_election.cc:336] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:25.794440 24779 leader_election.cc:336] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:25.796324 30501 consensus_queue.cc:237] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:25.775301 30846 log.cc:927] Time spent T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: Append to log took a long time: real 0.395s	user 0.016s	sys 0.000s
I20260709 12:20:25.860666 22903 raft_consensus.cc:2272] T 637c5886d38642daacb9b3dac3e4e9d2 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:25.860034 30379 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:25.873028 30379 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:25.877235 30704 raft_consensus.cc:3055] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:20:25.877790 30704 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:25.878793 30704 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:25.880254 30704 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:25.891373 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:25.892335 24806 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 9.
I20260709 12:20:25.895228 24215 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:25.906862 24174 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Rejecting Update request from peer c090031f610346ed82285cd847bca6d6 for earlier term 9. Current term is 10. Ops: []
I20260709 12:20:25.886574 30379 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:25.915711 24214 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:25.907073 30861 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:25.834939 30526 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:25.953500 24779 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:25.927747 30861 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:25.965912 24245 raft_consensus.cc:1275] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 16. (index mismatch)
I20260709 12:20:25.978513 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:25.968667 30861 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:25.985898 22903 tablet_replica.cc:333] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:25.986765 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:25.986629 24214 consensus_peers.cc:597] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:25.989040 24066 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:25.991736 22903 raft_consensus.cc:2243] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:25.990214 30836 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:20:25.979206 30773 consensus_queue.cc:1048] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.029s
I20260709 12:20:25.988498 30526 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 18 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:26.023357 30787 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.024179 30787 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:26.027323 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:26.031069 30787 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:26.034246 24214 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.036465 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d84a44368371490a8287d9cb8d1620d0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:26.039485 24066 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:26.040284 24779 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:26.042119 24214 consensus_peers.cc:597] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:26.046967 24214 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:26.049443 22903 raft_consensus.cc:2272] T 882bb02a9e9e423bbbc4df3dd0c55540 P 729aa4b1ccec48b588c14e67652c61e1 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.043533 30836 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.040107 30526 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.046692 30787 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:26.062023 30836 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } attrs { replace: true } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:26.068730 30836 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:26.069844 22903 tablet_replica.cc:333] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:26.071209 22903 raft_consensus.cc:2243] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.072036 22903 raft_consensus.cc:2272] T ba2b8234ad7d402bb1de3ebc3a408c0f P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.075418 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:26.075889 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:26.079586 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e016416bdc742068f5568ff2bebabd1" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:26.086745 24066 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:26.090348 30787 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:20:26.097925 22903 tablet_replica.cc:333] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:26.101861 22903 raft_consensus.cc:2243] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.074005 30526 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:26.113812 30526 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:26.121239 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:26.131982 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6f5cb153ce4e4ac387672e2345a08fa5" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:26.135251 24066 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:26.136333 30526 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:26.056980 30861 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:26.143452 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b5b70d71470484d8fc5f942623adb98" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:26.145046 24814 raft_consensus.cc:3060] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:26.150779 22903 pending_rounds.cc:70] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 1 pending ops.
I20260709 12:20:26.151147 30861 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:26.151291 22903 pending_rounds.cc:77] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 14 index: 11 } timestamp: 7305623989942206464 op_type: NO_OP noop_request { }
I20260709 12:20:26.151785 22903 raft_consensus.cc:2889] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:26.152275 22903 raft_consensus.cc:2272] T b29f161fe0e24b51ad5c1903bdc5112c P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:26.155488 24214 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:26.164844 24814 raft_consensus.cc:2468] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:20:26.166407 24215 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:26.175339 30861 raft_consensus.cc:2804] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:26.175998 30861 raft_consensus.cc:697] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:26.182610 22903 tablet_replica.cc:333] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:26.211805 22903 raft_consensus.cc:2243] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.183878 30861 consensus_queue.cc:237] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:26.235620 22903 raft_consensus.cc:2272] T 2152258f0d654836a042cc0cf00d66a3 P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:26.241675 24140 consensus_peers.cc:597] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:26.245299 24245 raft_consensus.cc:1275] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:20:26.248255 30770 consensus_queue.cc:1048] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:20:26.240280 22903 tablet_replica.cc:333] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
W20260709 12:20:26.270438 24214 consensus_peers.cc:597] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:26.296247 24779 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:26.299829 24140 consensus_peers.cc:597] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.301139 22903 raft_consensus.cc:2243] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.306349 22903 raft_consensus.cc:2272] T 6f5cb153ce4e4ac387672e2345a08fa5 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:26.351848 24140 consensus_peers.cc:597] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.339641 22903 tablet_replica.cc:333] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:26.365695 22903 raft_consensus.cc:2243] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.373283 22903 raft_consensus.cc:2272] T 1388d59244114d37a482e6205f04c237 P 729aa4b1ccec48b588c14e67652c61e1 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:26.403273 24214 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:26.407327 23998 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 274) took 9278 ms. Trace:
I20260709 12:20:26.422425 30526 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.423153 30526 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:26.416424 23995 catalog_manager.cc:5697] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 14, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 14 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:26.426322 23995 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.427109 24245 raft_consensus.cc:1275] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:20:26.428821 23995 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 14, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 14 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:26.431591 24140 consensus_peers.cc:597] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.433656 30765 consensus_queue.cc:1048] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:20:26.420698 22903 tablet_replica.cc:333] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:26.454278 22903 raft_consensus.cc:2243] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.421262 23998 rpcz_store.cc:276] 0709 12:20:17.128623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:17.130669 (+  2046us) service_pool.cc:224] Handling call
0709 12:20:26.407226 (+9276557us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:25.566682 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:25.674700 (+108018us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:25.676833 (+  2133us) write_op.cc:435] Acquired schema lock
0709 12:20:25.676851 (+    18us) tablet.cc:662] Decoding operations
0709 12:20:25.732656 (+ 55805us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:25.732721 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:25.732754 (+    33us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:20:25.733845 (+  1091us) tablet.cc:701] Row locks acquired
0709 12:20:25.733870 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:20:25.734060 (+   190us) write_op.cc:270] Start()
0709 12:20:25.734194 (+   134us) write_op.cc:276] Timestamp: P: 1783599625734001 usec, L: 0
0709 12:20:25.734218 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:20:25.735290 (+  1072us) log.cc:844] Serialized 4658 byte log entry
0709 12:20:25.889640 (+154350us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b4400022b4c. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c023b4c85 00007f4c023b56a2 00007f4c051271db 00007f4c05122aaf 00007f4c024710ac 00007f4c0b2cb9a9 00007f4c0248d69b 00007f4c0248b93f 00007f4c0248dc02 00007f4c0511520b
0709 12:20:26.134822 (+245182us) op_driver.cc:464] REPLICATION: finished
0709 12:20:26.202534 (+ 67712us) write_op.cc:301] APPLY: starting
0709 12:20:26.203406 (+   872us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:26.269946 (+ 66540us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:26.269978 (+    32us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:26.310463 (+ 40485us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:26.311310 (+   847us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:20:26.311363 (+    53us) write_op.cc:312] APPLY: finished
0709 12:20:26.311739 (+   376us) log.cc:844] Serialized 105 byte log entry
0709 12:20:26.314197 (+  2458us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:26.321889 (+  7692us) write_op.cc:454] Released schema lock
0709 12:20:26.344978 (+ 23089us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:26.345736 (+   758us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:26.345768 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":720419,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":63272,"apply.run_cpu_time_us":17291,"apply.run_wall_time_us":143184,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":207259,"prepare.run_cpu_time_us":63443,"prepare.run_wall_time_us":410819,"raft.queue_time_us":127434,"raft.run_cpu_time_us":4528,"raft.run_wall_time_us":33373,"replication_time_us":400404,"spinlock_wait_cycles":3757312,"thread_start_us":493762,"threads_started":4,"wal-append.queue_time_us":269237}]]}
I20260709 12:20:26.522928 30526 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:26.525959 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:26.526919 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:26.540856 24066 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:26.518187 23995 catalog_manager.cc:5697] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 14, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 14 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.543802 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
W20260709 12:20:26.545791 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 78186.8us
I20260709 12:20:26.552033 30526 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:26.551728 24140 consensus_peers.cc:597] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:26.598588 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 47227.3us
I20260709 12:20:26.552886 23995 catalog_manager.cc:5697] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:20:26.549309 24779 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:26.601897 24779 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 52681.6us
W20260709 12:20:26.603367 24140 consensus_peers.cc:597] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:26.604249 24140 consensus_peers.cc:597] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:26.604926 24140 consensus_peers.cc:597] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.609599 22903 raft_consensus.cc:2272] T 290d272848834ed2813ddb5e16609dba P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.606830 23995 catalog_manager.cc:5697] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 9 to 11, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 11 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:26.616961 24140 consensus_peers.cc:597] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.618763 23995 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 11 to 12, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 12 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:26.620688 23995 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:20:26.623262 24814 raft_consensus.cc:1275] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:20:26.622941 23995 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 15 to 16, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 16 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:20:26.625082 23995 catalog_manager.cc:5697] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:20:26.649312 24140 consensus_peers.cc:597] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:26.650171 24140 consensus_peers.cc:597] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.627818 30861 consensus_queue.cc:1048] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 12:20:26.656893 30501 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:26.676117 30645 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.681160 30645 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:26.689026 22903 tablet_replica.cc:333] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:26.690740 22903 raft_consensus.cc:2243] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:26.692303 22903 raft_consensus.cc:2272] T 39ed3ba506b24217972fa63093a56c52 P 729aa4b1ccec48b588c14e67652c61e1 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.670117 30501 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:26.677893 30787 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:26.700346 30787 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:26.729521 30787 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:26.733035 24214 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.733425 30645 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:26.737941 30501 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:26.743078 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:26.747094 22903 tablet_replica.cc:333] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:26.763556 24814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:26.762053 24214 consensus_peers.cc:597] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.766100 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:26.775969 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:26.754246 30879 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:26.785925 30879 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:26.788523 30879 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:26.793617 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:26.794593 24173 raft_consensus.cc:2393] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 17: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:26.796319 30742 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:26.796969 30742 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:26.800098 24140 consensus_peers.cc:597] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:26.801035 24066 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
W20260709 12:20:26.807232 24214 consensus_peers.cc:597] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:26.808579 24067 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:26.811659 24779 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:26.815747 24779 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:26.816256 24779 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:26.814973 22903 raft_consensus.cc:2243] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:26.816639 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:26.810389 30645 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:26.819298 30742 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:26.820645 30881 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:26.813959 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 58617.5us
I20260709 12:20:26.817472 24172 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 20.
I20260709 12:20:26.847623 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:26.848466 24249 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 20.
I20260709 12:20:26.815205 30787 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:26.861600 24214 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:26.864486 22903 raft_consensus.cc:2272] T 9e016416bdc742068f5568ff2bebabd1 P 729aa4b1ccec48b588c14e67652c61e1 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:26.912039 22903 tablet_replica.cc:333] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
W20260709 12:20:26.912633 24779 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:26.913079 22903 raft_consensus.cc:2243] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:26.914211 22903 raft_consensus.cc:2272] T 45016a37c2d9462798b1991f8cb78e65 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:26.948472 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 88705.7us
W20260709 12:20:26.955977 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 105166us
W20260709 12:20:26.971637 24140 consensus_peers.cc:597] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:26.987212 24140 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:26.994203 30881 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:27.005672 24140 consensus_peers.cc:597] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:27.003732 22903 tablet_replica.cc:333] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
W20260709 12:20:27.024003 24214 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:27.033497 22903 raft_consensus.cc:2243] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.047390 22903 raft_consensus.cc:2272] T a6831162b73f4c16a41519abb392404b P 729aa4b1ccec48b588c14e67652c61e1 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:27.051874 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 69614.2us
W20260709 12:20:27.073674 24779 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 224 similar messages]
W20260709 12:20:27.095975 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 245652us
I20260709 12:20:27.097026 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:27.107698 24214 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:27.105268 22903 tablet_replica.cc:333] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
W20260709 12:20:27.118268 24214 consensus_peers.cc:597] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:27.122231 22903 raft_consensus.cc:2243] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:27.121002 30549 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:20:27.133419 30549 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:27.133932 30549 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:27.148512 30549 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:27.158861 24214 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:27.157397 30549 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 21 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:27.166005 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:27.168826 24172 raft_consensus.cc:3060] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:20:27.170689 22903 raft_consensus.cc:2272] T 3fc81ca349024898b0af873713a28fcb P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.179483 24172 raft_consensus.cc:2468] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 21.
W20260709 12:20:27.184474 24140 consensus_peers.cc:597] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:27.186455 24216 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:27.188118 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 104678us
I20260709 12:20:27.195942 24141 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:27.193539 30379 raft_consensus.cc:2804] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:20:27.199728 30379 raft_consensus.cc:697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 21 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:27.200729 30379 consensus_queue.cc:237] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:27.202589 30886 raft_consensus.cc:2764] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:20:27.213711 30645 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.216364 30645 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:27.219755 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:27.220117 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e37f672475a541c4b15e807dbe8bcd7d" candidate_uuid: "729aa4b1ccec48b588c14e67652c61e1" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:27.221900 24066 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 729aa4b1ccec48b588c14e67652c61e1; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6
I20260709 12:20:27.222795 30787 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:27.223632 30645 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:27.225919 22903 tablet_replica.cc:333] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:27.240965 22903 raft_consensus.cc:2243] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.241823 22903 raft_consensus.cc:2272] T 272fa86b9b194257adecb1c4f372fde9 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.290099 30859 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:27.290800 30859 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:27.292333 22903 tablet_replica.cc:333] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:27.293147 30859 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:27.293454 22903 raft_consensus.cc:2243] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.294194 22903 raft_consensus.cc:2272] T e33dc2dd26074c7d8437ce5a91c0f8bf P 729aa4b1ccec48b588c14e67652c61e1 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.297025 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:27.297833 24808 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:20:27.297189 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:27.298974 24175 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:27.303300 24215 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:27.304708 30549 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:20:27.305088 30549 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Starting leader election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:27.305457 30549 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:20:27.316521 22903 tablet_replica.cc:333] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:27.317603 22903 raft_consensus.cc:2243] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.318178 22903 raft_consensus.cc:2272] T 4f40c9d3e625486382331d48f50901e2 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.332422 30549 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:27.336577 24214 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:27.336894 24175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:27.337805 24175 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 10: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:27.339843 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:27.351390 22903 tablet_replica.cc:333] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:27.352380 22903 raft_consensus.cc:2243] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.352975 22903 pending_rounds.cc:70] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 1 pending ops.
I20260709 12:20:27.353219 22903 pending_rounds.cc:77] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 14 index: 13 } timestamp: 7305624027652341760 op_type: NO_OP noop_request { }
I20260709 12:20:27.353979 22903 raft_consensus.cc:2889] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:27.354351 22903 raft_consensus.cc:2272] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 729aa4b1ccec48b588c14e67652c61e1 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.363456 22903 tablet_replica.cc:333] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:27.368100 22903 raft_consensus.cc:2243] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.371282 30549 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:27.387532 23996 catalog_manager.cc:5697] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 7 to 8, VOTER 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) evicted, no longer has a pending config: VOTER 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194), VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195), VOTER c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 11 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.389948 23996 catalog_manager.cc:5697] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.391426 24806 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 10.
I20260709 12:20:27.391598 23996 catalog_manager.cc:5697] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.393378 23996 catalog_manager.cc:5697] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 12 to 15, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 15 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.394706 24215 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:27.396008 30549 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:20:27.396535 30549 raft_consensus.cc:697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:27.397590 30549 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:27.398326 22903 pending_rounds.cc:70] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 1 pending ops.
I20260709 12:20:27.398649 22903 pending_rounds.cc:77] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 19 index: 14 } timestamp: 7305624012152754176 op_type: NO_OP noop_request { }
I20260709 12:20:27.399047 22903 raft_consensus.cc:2889] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:27.399462 22903 raft_consensus.cc:2272] T d84a44368371490a8287d9cb8d1620d0 P 729aa4b1ccec48b588c14e67652c61e1 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.399106 23996 catalog_manager.cc:5697] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 16 to 17, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 17 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.403924 23996 catalog_manager.cc:5697] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 12 to 15, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 15 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.402758 22903 tablet_replica.cc:333] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:27.406502 23995 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47160 (request call id 311) took 8174 ms. Trace:
I20260709 12:20:27.413231 22903 raft_consensus.cc:2243] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.414053 22903 raft_consensus.cc:2272] T b55ff2c6fc804b36ae275790f8dfe310 P 729aa4b1ccec48b588c14e67652c61e1 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.412799 23995 rpcz_store.cc:276] 0709 12:20:19.232190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:19.232418 (+   228us) service_pool.cc:224] Handling call
0709 12:20:19.243619 (+ 11201us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b5400270010. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c024570b2 00007f4c0b3d0759 00007f4c0b368a76 00007f4c0b339d58 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc
0709 12:20:27.406396 (+8162777us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:26.904650 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:26.905327 (+   677us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:26.905367 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:20:26.905386 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:26.906465 (+  1079us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:26.906542 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:26.906579 (+    37us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:20:26.920667 (+ 14088us) tablet.cc:701] Row locks acquired
0709 12:20:26.920693 (+    26us) write_op.cc:260] PREPARE: finished
0709 12:20:26.920871 (+   178us) write_op.cc:270] Start()
0709 12:20:26.921019 (+   148us) write_op.cc:276] Timestamp: P: 1783599626920810 usec, L: 0
0709 12:20:26.921043 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:20:26.921970 (+   927us) log.cc:844] Serialized 4004 byte log entry
0709 12:20:27.012364 (+ 90394us) op_driver.cc:464] REPLICATION: finished
0709 12:20:27.218629 (+206265us) write_op.cc:301] APPLY: starting
0709 12:20:27.218739 (+   110us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:27.258305 (+ 39566us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:27.258481 (+   176us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:27.332813 (+ 74332us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:27.333264 (+   451us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 12:20:27.333319 (+    55us) write_op.cc:312] APPLY: finished
0709 12:20:27.339092 (+  5773us) log.cc:844] Serialized 97 byte log entry
0709 12:20:27.340016 (+   924us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:27.341911 (+  1895us) write_op.cc:454] Released schema lock
0709 12:20:27.342662 (+   751us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:27.343232 (+   570us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:27.343266 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":12880,"reported_tablets":41,"spinlock_wait_cycles":9087872,"child_traces":[["op",{"apply.queue_time_us":185278,"apply.run_cpu_time_us":16591,"apply.run_wall_time_us":124572,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45947,"num_ops":10,"prepare.queue_time_us":235031,"prepare.run_cpu_time_us":4685,"prepare.run_wall_time_us":34365,"replication_time_us":67473,"thread_start_us":248390,"threads_started":2}]]}
I20260709 12:20:27.411814 23996 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.421134 23996 catalog_manager.cc:5697] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 12 to 13, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 13 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.422914 23996 catalog_manager.cc:5697] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.424608 23996 catalog_manager.cc:5697] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 14 to 15, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 15 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.426169 23996 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.427531 23996 catalog_manager.cc:5697] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 12 to 13, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 13 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.429529 23996 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.430891 23996 catalog_manager.cc:5697] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.432500 23996 catalog_manager.cc:5697] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 14 to 17, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 17 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.434562 23996 catalog_manager.cc:5697] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.435906 23996 catalog_manager.cc:5697] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 9 to 13, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 13 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.439132 23996 catalog_manager.cc:5697] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 12 to 14, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 14 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.441442 23996 catalog_manager.cc:5697] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 15 to 16, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 16 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:27.417665 22903 tablet_replica.cc:333] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:27.452926 22903 raft_consensus.cc:2243] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.453924 22903 pending_rounds.cc:70] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: Trying to abort 1 pending ops.
I20260709 12:20:27.454198 22903 pending_rounds.cc:77] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1: Aborting op as it isn't in flight: id { term: 14 index: 10 } timestamp: 7305623990918569984 op_type: NO_OP noop_request { }
I20260709 12:20:27.454591 22903 raft_consensus.cc:2889] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:20:27.454972 22903 raft_consensus.cc:2272] T 44755249cf394d0aa1ea6b45f82eb521 P 729aa4b1ccec48b588c14e67652c61e1 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:27.489938 22903 tablet_replica.cc:333] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1: stopping tablet replica
I20260709 12:20:27.499629 22903 raft_consensus.cc:2243] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:27.501781 22903 raft_consensus.cc:2272] T e37f672475a541c4b15e807dbe8bcd7d P 729aa4b1ccec48b588c14e67652c61e1 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:27.504407 24140 consensus_peers.cc:597] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:27.535316 24140 consensus_peers.cc:597] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:27.623308 24140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 70093.4us
W20260709 12:20:27.625696 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 44714us
I20260709 12:20:27.636121 30895 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.636861 30895 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:27.641414 30895 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:27.657752 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:27.659052 24813 raft_consensus.cc:2410] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
W20260709 12:20:27.683504 24140 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:27.683969 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:27.684775 30895 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:27.736630 23995 catalog_manager.cc:5697] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:20:27.770581 30878 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:27.799819 30878 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:27.788087 30899 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:27.803673 30899 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:27.831424 30899 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:27.832530 30878 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:27.844610 24172 raft_consensus.cc:1275] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 21 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:20:27.843694 23995 catalog_manager.cc:5697] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 14 to 17, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 17 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.845338 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:27.846598 24808 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 10.
I20260709 12:20:27.861001 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 
I20260709 12:20:27.862778 30897 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:27.863413 30897 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:27.863905 30897 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:27.848212 23995 catalog_manager.cc:5697] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 14 to 16, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 16 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.885684 23995 catalog_manager.cc:5697] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 12 to 15, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193). New cstate: current_term: 15 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:20:27.888749 23995 catalog_manager.cc:5697] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 18 to 19, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 19 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.854660 23996 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:43784 (request call id 190) took 1713 ms. Trace:
W20260709 12:20:27.909211 24140 consensus_peers.cc:597] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:27.911356 24140 consensus_peers.cc:597] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:27.915175 30895 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:27.916115 30895 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:27.891268 23996 rpcz_store.cc:276] 0709 12:20:26.140924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:26.142098 (+  1174us) service_pool.cc:224] Handling call
0709 12:20:26.172997 (+ 30899us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:20:27.854344 (+1681347us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:27.472454 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:27.473077 (+   623us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:27.473113 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:20:27.473132 (+    19us) tablet.cc:662] Decoding operations
0709 12:20:27.474793 (+  1661us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:27.474896 (+   103us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:27.474931 (+    35us) tablet.cc:685] Acquiring locks for 19 operations
0709 12:20:27.476621 (+  1690us) tablet.cc:701] Row locks acquired
0709 12:20:27.476640 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:20:27.476863 (+   223us) write_op.cc:270] Start()
0709 12:20:27.477012 (+   149us) write_op.cc:276] Timestamp: P: 1783599627476778 usec, L: 0
0709 12:20:27.477036 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:20:27.477920 (+   884us) log.cc:844] Serialized 7549 byte log entry
0709 12:20:27.481225 (+  3305us) op_driver.cc:464] REPLICATION: finished
0709 12:20:27.481758 (+   533us) write_op.cc:301] APPLY: starting
0709 12:20:27.481842 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:27.492413 (+ 10571us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:27.492513 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:27.631381 (+138868us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:27.631680 (+   299us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=38,key_file_lookups=38,delta_file_lookups=38,mrs_lookups=0
0709 12:20:27.631726 (+    46us) write_op.cc:312] APPLY: finished
0709 12:20:27.632240 (+   514us) log.cc:844] Serialized 172 byte log entry
0709 12:20:27.632477 (+   237us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:27.632714 (+   237us) write_op.cc:454] Released schema lock
0709 12:20:27.632773 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:27.644924 (+ 12151us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:27.644957 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":13098,"reported_tablets":29,"spinlock_wait_cycles":58208512,"child_traces":[["op",{"apply.queue_time_us":304,"apply.run_cpu_time_us":25901,"apply.run_wall_time_us":163114,"cfile_cache_hit":76,"cfile_cache_hit_bytes":79458,"num_ops":19,"prepare.queue_time_us":23044,"prepare.run_cpu_time_us":5864,"prepare.run_wall_time_us":18749,"replication_time_us":4016,"spinlock_wait_cycles":80768,"thread_start_us":18050,"threads_started":1}]]}
I20260709 12:20:27.908958 23995 catalog_manager.cc:5697] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 17 to 19, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 19 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:27.935441 30895 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:27.945761 23984 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 95473.4us
I20260709 12:20:27.945402 23995 catalog_manager.cc:5697] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 15 to 18, leader changed from 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 18 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
I20260709 12:20:27.958739 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:27.970453 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:27.971623 24241 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 14.
I20260709 12:20:27.993141 30897 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:28.003240 24214 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:28.004148 24214 consensus_peers.cc:597] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:28.010524 23984 catalog_manager.cc:4755] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e016416bdc742068f5568ff2bebabd1: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20260709 12:20:28.012632 24808 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:20:28.016425 30379 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:20:28.016654 24172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:28.018635 24172 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 14.
I20260709 12:20:28.024288 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6"
I20260709 12:20:28.031154 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:28.032176 30878 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:28.032579 30878 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:28.032989 30878 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:28.034426 24172 raft_consensus.cc:1240] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Rejecting Update request from peer fa8cfbff90bf4881a56772b05008aadb for earlier term 10. Current term is 11. Ops: []
W20260709 12:20:28.044220 24140 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:20:28.045787 24140 consensus_peers.cc:597] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:28.051077 30897 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Requested vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:28.051404 24214 consensus_peers.cc:597] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:28.068564 30878 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:28.080017 30859 consensus_queue.cc:1048] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:20:28.119894 24140 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:28.124115 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:28.119805 30897 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:28.127791 30897 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:28.134907 30913 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:20:28.135550 30913 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:28.135967 30913 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:20:28.141868 23998 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "729aa4b1ccec48b588c14e67652c61e1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:20:28.143201 24214 consensus_peers.cc:597] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:28.130931 30897 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:28.146744 23998 catalog_manager.cc:5697] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 9 to 10, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 10 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.152324 30859 consensus_queue.cc:1059] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:20:28.153398 30859 raft_consensus.cc:3055] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:20:28.153759 30859 raft_consensus.cc:740] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Becoming Follower/Learner. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:28.116788 30878 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:28.155016 30859 consensus_queue.cc:260] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:28.156672 30859 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:20:28.167204 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:28.168676 24248 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:28.169555 24248 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
I20260709 12:20:28.173573 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
W20260709 12:20:28.192764 24140 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:28.196452 30913 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:28.198395 24249 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a in current term 15: Already voted for candidate fa8cfbff90bf4881a56772b05008aadb in this term.
I20260709 12:20:28.199728 30913 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:28.202889 24245 raft_consensus.cc:2410] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 5d0f174a97494d0cbf08ae81ec4c807a for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:20:28.204638 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:28.218868 30639 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:20:28.219475 30639 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:28.219908 30639 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:20:28.233840 24214 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:28.240466 23995 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 9 to 10, leader changed from c090031f610346ed82285cd847bca6d6 (127.22.93.196) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 10 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
W20260709 12:20:28.242484 24214 consensus_peers.cc:597] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:28.263295 23998 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:47164 (request call id 275) took 1089 ms. Trace:
I20260709 12:20:28.263859 23998 rpcz_store.cc:276] 0709 12:20:27.173816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:27.173989 (+   173us) service_pool.cc:224] Handling call
0709 12:20:27.209163 (+ 35174us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b54002701d4. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c054e5090 00007f4c05583f3a 00007f4c0b339e9c 00007f4c0b43804e 00007f4c098f92a4 00007f4c098f9232 00007f4c098f9161 00007f4c098f90dc 00007f4c098f8392 00007f4c038b648c 00007f4c038b58c6
0709 12:20:28.263196 (+1054033us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:20:28.162821 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:20:28.163616 (+   795us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:20:28.163667 (+    51us) write_op.cc:435] Acquired schema lock
0709 12:20:28.163693 (+    26us) tablet.cc:662] Decoding operations
0709 12:20:28.164266 (+   573us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:20:28.164336 (+    70us) write_op.cc:641] Partition lock acquired for write op
0709 12:20:28.164376 (+    40us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:20:28.164896 (+   520us) tablet.cc:701] Row locks acquired
0709 12:20:28.164920 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:20:28.165147 (+   227us) write_op.cc:270] Start()
0709 12:20:28.165298 (+   151us) write_op.cc:276] Timestamp: P: 1783599628165083 usec, L: 0
0709 12:20:28.165329 (+    31us) op_driver.cc:348] REPLICATION: starting
0709 12:20:28.166581 (+  1252us) log.cc:844] Serialized 924 byte log entry
0709 12:20:28.169172 (+  2591us) op_driver.cc:464] REPLICATION: finished
0709 12:20:28.171389 (+  2217us) write_op.cc:301] APPLY: starting
0709 12:20:28.171512 (+   123us) tablet.cc:1367] starting BulkCheckPresence
0709 12:20:28.173147 (+  1635us) tablet.cc:1370] finished BulkCheckPresence
0709 12:20:28.173250 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:20:28.174750 (+  1500us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:20:28.174959 (+   209us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0709 12:20:28.175061 (+   102us) write_op.cc:312] APPLY: finished
0709 12:20:28.175342 (+   281us) log.cc:844] Serialized 33 byte log entry
0709 12:20:28.176269 (+   927us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:28.176685 (+   416us) write_op.cc:454] Released schema lock
0709 12:20:28.176746 (+    61us) write_op.cc:341] FINISH: Updating metrics
0709 12:20:28.177185 (+   439us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:20:28.177224 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":33,"spinlock_wait_cycles":26579200,"child_traces":[["op",{"apply.queue_time_us":154,"apply.run_cpu_time_us":4781,"apply.run_wall_time_us":5775,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8364,"num_ops":2,"prepare.queue_time_us":2224,"prepare.run_cpu_time_us":4008,"prepare.run_wall_time_us":4182,"replication_time_us":3674,"spinlock_wait_cycles":821504}]]}
I20260709 12:20:28.274566 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:28.274142 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:28.276674 24173 raft_consensus.cc:2393] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate fa8cfbff90bf4881a56772b05008aadb in current term 15: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:28.269564 30639 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:28.289397 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:28.282773 30878 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:28.298470 30549 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:20:28.292290 23998 catalog_manager.cc:5697] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 20 to 21, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 21 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } }
W20260709 12:20:28.307301 24214 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:28.308609 30887 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:28.309319 30887 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:28.315730 30887 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:28.319483 24779 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:28.322083 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:28.327369 30897 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:20:28.351936 24173 consensus_queue.cc:237] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:28.361100 30639 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:28.376863 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 75035.5us
I20260709 12:20:28.404772 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:28.405498 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fc81ca349024898b0af873713a28fcb" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:28.406311 24245 raft_consensus.cc:3060] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:20:28.407673 24813 raft_consensus.cc:1275] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:20:28.410373 30895 consensus_queue.cc:1048] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:20:28.440765 24140 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:28.441471 24140 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:28.442507 30895 raft_consensus.cc:2749] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:28.456743 24245 raft_consensus.cc:2468] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 17.
I20260709 12:20:28.459583 30895 raft_consensus.cc:2955] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 LEADER]: Committing config change with OpId 20.17: config changed from index 14 to 17, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:28.472604 24141 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:28.473601 30897 raft_consensus.cc:2804] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:20:28.474212 30897 raft_consensus.cc:697] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:28.474289 24140 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:28.475448 30897 consensus_queue.cc:237] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:28.476518 24140 consensus_peers.cc:597] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:28.480744 30899 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:28.481868 30899 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:28.484689 30899 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:28.485878 24813 raft_consensus.cc:2955] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Committing config change with OpId 20.17: config changed from index 14 to 17, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:28.501533 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:28.502349 24173 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 15.
W20260709 12:20:28.503085 24214 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:28.503728 24216 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:28.504671 30913 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:28.505120 30913 raft_consensus.cc:493] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Starting leader election (detected failure of leader 729aa4b1ccec48b588c14e67652c61e1)
I20260709 12:20:28.505555 30913 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:28.517336 23986 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 290d272848834ed2813ddb5e16609dba with cas_config_opid_index 14: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
I20260709 12:20:28.519933 30913 raft_consensus.cc:515] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:28.535362 24214 leader_election.cc:336] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:28.536231 23998 catalog_manager.cc:5697] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 reported cstate change: config changed from index 14 to 17, VOTER fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) evicted. New cstate: current_term: 20 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } } }
I20260709 12:20:28.541649 30913 leader_election.cc:290] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:28.543290 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45016a37c2d9462798b1991f8cb78e65" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:28.543977 24173 raft_consensus.cc:3060] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:28.560997 24236 tablet_service.cc:1558] Processing DeleteTablet for tablet 290d272848834ed2813ddb5e16609dba with delete_type TABLET_DATA_TOMBSTONED (TS fa8cfbff90bf4881a56772b05008aadb not found in new config with opid_index 17) from {username='slave'} at 127.0.0.1:40964
I20260709 12:20:28.563753 24173 raft_consensus.cc:2468] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
W20260709 12:20:28.568933 24779 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:28.571476 23998 catalog_manager.cc:5697] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 16 to 17, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 17 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:28.587510 24216 leader_election.cc:304] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:28.589143 30913 raft_consensus.cc:2804] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:28.589773 30913 raft_consensus.cc:697] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Becoming Leader. State: Replica: fa8cfbff90bf4881a56772b05008aadb, State: Running, Role: LEADER
I20260709 12:20:28.589985 30922 tablet_replica.cc:333] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:28.590883 30913 consensus_queue.cc:237] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:28.591638 30922 raft_consensus.cc:2243] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:28.608354 30922 raft_consensus.cc:2272] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:28.613716 30922 ts_tablet_manager.cc:1916] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:20:28.620078 24214 consensus_peers.cc:597] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:28.652494 23998 catalog_manager.cc:5697] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb reported cstate change: term changed from 15 to 16, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to fa8cfbff90bf4881a56772b05008aadb (127.22.93.195). New cstate: current_term: 16 leader_uuid: "fa8cfbff90bf4881a56772b05008aadb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:28.682220 24779 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:28.688563 24140 consensus_peers.cc:597] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:28.689724 24214 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:28.711274 30922 ts_tablet_manager.cc:1929] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.16
I20260709 12:20:28.712034 30922 log.cc:1199] T 290d272848834ed2813ddb5e16609dba P fa8cfbff90bf4881a56772b05008aadb: Deleting WAL directory at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/wals/290d272848834ed2813ddb5e16609dba
I20260709 12:20:28.714596 23985 catalog_manager.cc:5028] TS fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): tablet 290d272848834ed2813ddb5e16609dba (table test-workload [id=284b02a75f9442be882da483bd34afd6]) successfully deleted
I20260709 12:20:28.862819 30765 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:28.865847 30765 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:28.869513 30765 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:28.905752 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:28.906618 24176 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 17.
W20260709 12:20:28.908942 24214 consensus_peers.cc:597] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:28.916435 24779 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:28.925765 24781 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:28.927799 30890 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:20:28.928288 30890 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:28.928664 30890 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:28.985384 24140 consensus_peers.cc:597] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:28.989616 24140 consensus_peers.cc:597] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:28.993582 30890 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:29.011332 24779 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:29.015120 30890 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:28.996136 24140 consensus_peers.cc:597] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:29.021242 24176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:29.021910 24176 raft_consensus.cc:3060] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:20:29.032459 24140 consensus_peers.cc:597] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:29.039718 24779 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:29.050005 24245 raft_consensus.cc:1275] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:20:29.058462 30895 consensus_queue.cc:1048] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:20:29.086567 24140 consensus_peers.cc:597] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:29.097599 24176 raft_consensus.cc:2468] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 18.
W20260709 12:20:29.108880 24140 consensus_peers.cc:597] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:29.119789 24781 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:29.121704 30890 raft_consensus.cc:2804] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:20:29.122650 30890 raft_consensus.cc:697] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 18 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:29.123862 30890 consensus_queue.cc:237] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:29.130723 24140 consensus_peers.cc:597] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:29.149353 24176 raft_consensus.cc:1275] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Refusing update from remote peer fa8cfbff90bf4881a56772b05008aadb: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:20:29.179322 30899 consensus_queue.cc:1048] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
W20260709 12:20:29.257467 24140 consensus_peers.cc:597] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:29.259728 24214 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:29.258315 24140 consensus_peers.cc:597] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:29.266582 24140 consensus_peers.cc:597] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:29.308243 24214 consensus_peers.cc:597] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:29.311421 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 120016us
W20260709 12:20:29.329180 24779 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:29.349761 23998 catalog_manager.cc:5697] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 16 to 18, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 18 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:29.375566 24140 consensus_peers.cc:597] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:29.376255 24140 consensus_peers.cc:597] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:29.374033 24214 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:29.413736 23984 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 57541.1us
W20260709 12:20:29.459630 23984 catalog_manager.cc:4755] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e016416bdc742068f5568ff2bebabd1: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:29.471203 24779 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:29.478420 24214 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:29.485117 24140 consensus_peers.cc:597] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:29.485834 24140 consensus_peers.cc:597] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:29.487967 24216 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 72043.5us
W20260709 12:20:29.506150 24214 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:29.516820 24214 consensus_peers.cc:597] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:29.520303 24173 raft_consensus.cc:1275] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:20:29.522589 30890 consensus_queue.cc:1048] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:20:29.523550 30934 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:29.524220 30934 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:29.530824 30934 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:29.536363 24171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" is_pre_election: true
I20260709 12:20:29.537474 24171 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:29.550623 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:29.551772 24241 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:20:29.564939 24780 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:29.573181 30890 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:20:29.573726 30890 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting leader election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:29.574170 30890 raft_consensus.cc:3060] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:20:29.632135 24779 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:29.619935 24141 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 75731.7us
I20260709 12:20:29.634667 30890 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:29.676481 24214 consensus_peers.cc:597] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:29.679446 24173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5d0f174a97494d0cbf08ae81ec4c807a"
I20260709 12:20:29.680418 24173 raft_consensus.cc:2393] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c090031f610346ed82285cd847bca6d6 in current term 11: Already voted for candidate 5d0f174a97494d0cbf08ae81ec4c807a in this term.
I20260709 12:20:29.682556 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:29.678722 30890 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Requested vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:29.726526 24241 raft_consensus.cc:2468] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 11.
I20260709 12:20:29.729355 24780 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a
I20260709 12:20:29.730782 30908 raft_consensus.cc:2804] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:20:29.731384 30908 raft_consensus.cc:697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Becoming Leader. State: Replica: c090031f610346ed82285cd847bca6d6, State: Running, Role: LEADER
I20260709 12:20:29.732359 30908 consensus_queue.cc:237] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:29.764533 23995 catalog_manager.cc:5697] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 reported cstate change: term changed from 10 to 11, leader changed from fa8cfbff90bf4881a56772b05008aadb (127.22.93.195) to c090031f610346ed82285cd847bca6d6 (127.22.93.196). New cstate: current_term: 11 leader_uuid: "c090031f610346ed82285cd847bca6d6" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:20:29.808969 24214 consensus_peers.cc:597] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:29.851331 30878 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:29.852066 30878 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:29.854597 30878 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:29.860599 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:29.861310 24241 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 15.
I20260709 12:20:29.866693 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:29.868721 30945 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:20:29.869169 30945 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:29.869525 30945 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:20:29.875963 24140 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:29.889623 30945 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:29.907150 30945 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Requested vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:29.908967 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39ed3ba506b24217972fa63093a56c52" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb"
I20260709 12:20:29.909752 24245 raft_consensus.cc:3060] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:20:29.927181 24245 raft_consensus.cc:2468] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5d0f174a97494d0cbf08ae81ec4c807a in term 16.
I20260709 12:20:29.928486 24141 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb; no voters: 
I20260709 12:20:29.932001 30878 raft_consensus.cc:2804] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:20:29.932585 30878 raft_consensus.cc:697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Becoming Leader. State: Replica: 5d0f174a97494d0cbf08ae81ec4c807a, State: Running, Role: LEADER
W20260709 12:20:29.933957 24140 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:29.933614 30878 consensus_queue.cc:237] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:29.974721 23995 catalog_manager.cc:5697] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a reported cstate change: term changed from 14 to 16, leader changed from 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193) to 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194). New cstate: current_term: 16 leader_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:30.095582 24140 consensus_peers.cc:597] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:30.102236 24214 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:30.119699 24245 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:20:30.133133 30890 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:20:30.146296 24214 consensus_peers.cc:597] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:30.217947 24176 raft_consensus.cc:1275] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Refusing update from remote peer c090031f610346ed82285cd847bca6d6: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 12:20:30.219326 24214 consensus_peers.cc:597] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:30.219965 30890 consensus_queue.cc:1048] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:20:30.284461 24140 consensus_peers.cc:597] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:30.350699 24140 consensus_peers.cc:597] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:30.369266 24140 consensus_peers.cc:597] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:30.444901 24244 raft_consensus.cc:1275] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Refusing update from remote peer 5d0f174a97494d0cbf08ae81ec4c807a: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:20:30.457026 30945 consensus_queue.cc:1048] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:20:30.463105 24140 consensus_peers.cc:597] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:30.499528 24140 consensus_peers.cc:597] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:30.547171 24779 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:30.550498 24214 consensus_peers.cc:597] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:30.574730 24214 consensus_peers.cc:597] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:30.632380 23984 catalog_manager.cc:4755] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e016416bdc742068f5568ff2bebabd1: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:30.806269 24214 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:30.855345 24140 consensus_peers.cc:597] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:30.880416 22903 tablet_server.cc:196] TabletServer@127.22.93.193:0 shutdown complete.
W20260709 12:20:30.951450 24779 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:31.064236 24214 consensus_peers.cc:597] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.082631 24140 consensus_peers.cc:597] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:31.219938 24140 consensus_peers.cc:597] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.248226 24140 consensus_peers.cc:597] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.280373 24214 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:31.409825 24779 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:31.426366 24140 consensus_peers.cc:597] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.528564 24140 consensus_peers.cc:597] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.549001 24140 consensus_peers.cc:597] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.550522 24214 consensus_peers.cc:597] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.572762 24214 consensus_peers.cc:597] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:31.598495 22903 tablet_server.cc:179] TabletServer@127.22.93.194:0 shutting down...
W20260709 12:20:31.603470 24779 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:31.608548 24140 consensus_peers.cc:597] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.622334 24781 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.628268 24140 consensus_peers.cc:597] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.651106 24781 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.658747 24140 consensus_peers.cc:597] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.668751 24216 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.690171 24214 consensus_peers.cc:597] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.714003 24140 consensus_peers.cc:597] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.735610 24779 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:31.735730 24781 consensus_peers.cc:597] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.737136 24781 consensus_peers.cc:597] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.740958 24140 consensus_peers.cc:597] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:31.742035 24216 consensus_peers.cc:597] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.744196 24781 consensus_peers.cc:597] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.764108 24216 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.768055 24140 consensus_peers.cc:597] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:31.806471 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 49813.7us
W20260709 12:20:31.807313 24781 consensus_peers.cc:597] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.823295 24140 consensus_peers.cc:597] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.829197 24214 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.847745 24216 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.854708 24216 consensus_peers.cc:597] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.873543 24216 consensus_peers.cc:597] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.880546 24214 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:31.888176 24781 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.900604 24216 consensus_peers.cc:597] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.914480 24216 consensus_peers.cc:597] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.933013 24781 consensus_peers.cc:597] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.960450 24140 consensus_peers.cc:597] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:31.965180 24216 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.974615 24216 consensus_peers.cc:597] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:31.989001 24216 consensus_peers.cc:597] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:32.006585 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:32.010650 22903 tablet_replica.cc:333] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.015975 22903 raft_consensus.cc:2243] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:20:32.019765 24214 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:32.022629 24216 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:32.041218 24781 consensus_peers.cc:597] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:32.047444 24216 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:32.048623 22903 raft_consensus.cc:2272] T 07add62ce67548c3bdb714821b78d1d1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:32.064594 24781 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:32.075873 24781 consensus_peers.cc:597] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:32.082671 24140 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111) [suppressed 484 similar messages]
W20260709 12:20:32.094166 24214 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:32.173133 24140 consensus_peers.cc:597] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:32.192843 24779 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:32.190883 22903 tablet_replica.cc:333] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.209194 22903 raft_consensus.cc:2243] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:32.211627 22903 raft_consensus.cc:2272] T 67948aed495f4bd9b04d87c9adbfe164 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.235270 22903 tablet_replica.cc:333] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
W20260709 12:20:32.247289 24216 consensus_peers.cc:597] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:32.260244 24214 consensus_peers.cc:597] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:32.285199 22903 raft_consensus.cc:2243] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:20:32.300988 22903 raft_consensus.cc:2272] T 9dd67e018d26493bae6d921a57dfc306 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.379030 22903 tablet_replica.cc:333] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.386595 22903 raft_consensus.cc:2243] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:20:32.419900 22903 raft_consensus.cc:2272] T 46a4dd5f831f4ddca30827249660c52a P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:32.396656 24214 consensus_peers.cc:597] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:32.442631 24779 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:32.497920 24214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 101339us
I20260709 12:20:32.545164 22903 tablet_replica.cc:333] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.548666 22903 raft_consensus.cc:2243] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:32.566634 30957 raft_consensus.cc:670] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 12:20:32.575129 22903 raft_consensus.cc:2272] T c29a1bdc82674a4ab1ad6c3b54c69e25 P 5d0f174a97494d0cbf08ae81ec4c807a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.578696 22903 tablet_replica.cc:333] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.602211 22903 raft_consensus.cc:2243] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:32.628602 22903 raft_consensus.cc:2272] T 0996a24d22664e97aa7ba765bb20ef47 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.635327 30927 raft_consensus.cc:493] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:32.635988 30927 raft_consensus.cc:515] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:32.638661 30927 leader_election.cc:290] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:32.642262 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1388d59244114d37a482e6205f04c237" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:32.645509 22903 tablet_replica.cc:333] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.646697 22903 raft_consensus.cc:2243] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:32.647615 22903 raft_consensus.cc:2272] T 683c964dc5814af698a7b4af6649e9ed P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:32.678292 24140 consensus_peers.cc:597] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:32.687814 30963 raft_consensus.cc:493] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:32.688503 30963 raft_consensus.cc:515] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:32.689055 22903 tablet_replica.cc:333] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.692960 30927 raft_consensus.cc:493] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:32.693557 30927 raft_consensus.cc:515] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:32.695758 30927 leader_election.cc:290] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:32.697011 30963 leader_election.cc:290] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:32.698197 30963 raft_consensus.cc:493] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:32.690315 22903 raft_consensus.cc:2243] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:32.699653 22903 raft_consensus.cc:2272] T 45016a37c2d9462798b1991f8cb78e65 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:32.700757 24140 leader_election.cc:336] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:32.709108 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:32.701248 24140 leader_election.cc:304] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:32.710388 30927 raft_consensus.cc:2749] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:32.698735 30963 raft_consensus.cc:515] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:32.719269 30927 raft_consensus.cc:493] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:32.719889 30927 raft_consensus.cc:515] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:32.723399 30927 leader_election.cc:290] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:32.709434 22903 tablet_replica.cc:333] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
W20260709 12:20:32.725358 24214 consensus_peers.cc:597] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:32.725382 22903 raft_consensus.cc:2243] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:32.727566 22903 raft_consensus.cc:2272] T 9e016416bdc742068f5568ff2bebabd1 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.736691 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2391737d1a8643bd885a4db57ceba96c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:32.739236 24140 leader_election.cc:336] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:32.739967 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ab5a3f1f43046a9860089fc73f7efff" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:32.745594 24214 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:32.746659 22903 tablet_replica.cc:333] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.746944 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:32.748909 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51d85bfbe5fb4a4ba1caf713a20ce874" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:32.753732 24141 leader_election.cc:304] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:32.754120 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "988ca15bb1fd49b7822eef733e4a24a3" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:32.755167 24141 leader_election.cc:304] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:32.756461 30878 raft_consensus.cc:2749] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:20:32.756839 30957 raft_consensus.cc:2749] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:32.765357 22903 raft_consensus.cc:2243] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:32.765178 24141 leader_election.cc:304] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:32.766275 22903 raft_consensus.cc:2272] T 93e303f1b8c84a32a8a6522ee6c6fb27 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.767252 30927 raft_consensus.cc:2749] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:32.772385 30963 leader_election.cc:290] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:32.787387 30927 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
W20260709 12:20:32.787844 24214 consensus_peers.cc:597] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:32.788019 30927 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:32.813473 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:32.813782 24140 leader_election.cc:336] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:32.814278 24140 leader_election.cc:304] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:32.811736 30878 raft_consensus.cc:493] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 21 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:32.818550 30878 raft_consensus.cc:515] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:32.824015 30957 raft_consensus.cc:2749] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:32.824856 30957 raft_consensus.cc:493] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:32.825459 30878 leader_election.cc:290] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:32.825381 30957 raft_consensus.cc:515] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:32.826318 30927 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:32.827948 30957 leader_election.cc:290] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:32.818647 22903 tablet_replica.cc:333] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.839778 22903 raft_consensus.cc:2243] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:32.856130 22903 raft_consensus.cc:2272] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.849737 30967 raft_consensus.cc:493] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:32.860250 30967 raft_consensus.cc:515] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:32.862700 30967 leader_election.cc:290] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:32.870949 22903 tablet_replica.cc:333] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.876657 22903 raft_consensus.cc:2243] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:32.876816 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25a02c46886249619a17c69df6ded3b4" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:32.879432 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c617be9ee61e4bb583e2fecf7f8cd9b2" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:32.880872 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c07ef51fde0145f3ab7d32fa63626a55" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:32.885766 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:32.885879 23984 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.22.93.193:44043, user_credentials={real_user=slave}} blocked reactor thread for 52995.2us
I20260709 12:20:32.888741 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4ba8a9e171042a4a56a0f731bf431cc" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:32.890971 23984 catalog_manager.cc:4755] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e016416bdc742068f5568ff2bebabd1: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:32.895855 24141 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:32.896801 30963 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:32.899379 24141 leader_election.cc:304] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:32.900239 30963 raft_consensus.cc:2749] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:32.908577 24140 consensus_peers.cc:597] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:32.914305 24779 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:32.915377 30963 raft_consensus.cc:493] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:32.916041 30963 raft_consensus.cc:515] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:32.917629 22903 raft_consensus.cc:2272] T 30d4ada45d4b4872986993abc4470158 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.918370 30963 leader_election.cc:290] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:32.948280 30963 raft_consensus.cc:493] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:32.948945 30963 raft_consensus.cc:515] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:32.950953 24214 consensus_peers.cc:597] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:32.951448 30963 leader_election.cc:290] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:32.953498 22903 tablet_replica.cc:333] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.954504 22903 raft_consensus.cc:2243] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:20:32.955196 30967 raft_consensus.cc:493] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:32.955773 30967 raft_consensus.cc:515] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:32.956306 30968 raft_consensus.cc:493] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:32.956915 30968 raft_consensus.cc:515] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:32.957953 30967 leader_election.cc:290] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:32.959280 30968 leader_election.cc:290] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:32.960093 24140 leader_election.cc:336] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:32.960660 24140 leader_election.cc:304] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:32.961411 30968 raft_consensus.cc:2749] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:20:32.964149 22903 raft_consensus.cc:2272] T 66b5cb14ed8f4b58a27e168bcac560d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.973171 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bea694ade5d4f1daf189ff65fa4a13f" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
W20260709 12:20:32.973555 24780 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37157, user_credentials={real_user=slave}} blocked reactor thread for 54880us
I20260709 12:20:32.975492 22903 tablet_replica.cc:333] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:32.976513 22903 raft_consensus.cc:2243] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:32.977289 22903 raft_consensus.cc:2272] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:32.961659 24140 leader_election.cc:336] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:32.983480 24140 leader_election.cc:304] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:32.983938 22903 tablet_replica.cc:333] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
W20260709 12:20:32.984197 24140 raft_consensus.cc:2686] T c07ef51fde0145f3ab7d32fa63626a55 P 5d0f174a97494d0cbf08ae81ec4c807a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:32.985061 22903 raft_consensus.cc:2243] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:32.986299 22903 raft_consensus.cc:2272] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:32.986423 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:32.993049 30968 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:32.993644 30968 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:32.995347 24140 consensus_peers.cc:597] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:32.995630 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
W20260709 12:20:32.995882 24140 leader_election.cc:336] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:32.995995 30968 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:33.001798 30968 raft_consensus.cc:493] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:33.002388 30968 raft_consensus.cc:515] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:33.003057 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "680463fca31f47d494316f240f1df66a" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:33.005256 30968 leader_election.cc:290] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:33.007112 30968 raft_consensus.cc:493] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:33.007659 30968 raft_consensus.cc:515] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:33.009733 30963 raft_consensus.cc:493] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:33.010471 30968 leader_election.cc:290] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:33.010385 30963 raft_consensus.cc:515] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:33.011834 22903 tablet_replica.cc:333] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.013113 22903 raft_consensus.cc:2243] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.011261 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:33.013947 30963 leader_election.cc:290] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:33.015939 22903 raft_consensus.cc:2272] T 984475bb8f024d469921acdc98196b93 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.019209 22903 tablet_replica.cc:333] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
W20260709 12:20:33.019716 24140 leader_election.cc:336] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:33.020965 30963 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:33.021803 30963 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:33.024099 30963 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:33.028733 22903 raft_consensus.cc:2243] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.029543 22903 raft_consensus.cc:2272] T 988ca15bb1fd49b7822eef733e4a24a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:33.031291 24140 leader_election.cc:336] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:33.031879 24140 leader_election.cc:336] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:33.035327 24806 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bcb2b2e4d1146f7a8201d801a112ca0" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:33.035653 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:33.035897 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:33.037388 22903 tablet_replica.cc:333] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.037411 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8665b055009a4659b6d86621874dddbd" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:33.039428 22903 raft_consensus.cc:2243] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.041018 22903 raft_consensus.cc:2272] T ee66a7413b024d4b8e542242a567c0cf P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.049094 22903 tablet_replica.cc:333] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.050135 22903 raft_consensus.cc:2243] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.051049 22903 raft_consensus.cc:2272] T d4ba8a9e171042a4a56a0f731bf431cc P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.053467 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "010e8fce74be491b8432c9ea63b75515" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:33.054425 22903 tablet_replica.cc:333] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.055478 22903 raft_consensus.cc:2243] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.056166 22903 raft_consensus.cc:2272] T 0ab5a3f1f43046a9860089fc73f7efff P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.059418 22903 tablet_replica.cc:333] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.060535 24247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c552e5996384fef9c032a7fda531298" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:33.060758 30968 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:33.061412 30968 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:33.063876 30968 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
W20260709 12:20:33.064785 24214 consensus_peers.cc:597] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:33.065011 22903 raft_consensus.cc:2243] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.067101 24241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "272fa86b9b194257adecb1c4f372fde9" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:33.067868 24245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6831162b73f4c16a41519abb392404b" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:33.068420 24249 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:33.068580 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b5c00e5364f4911a535f428ee9a0f9c" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:33.069988 24141 leader_election.cc:304] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:33.084648 22903 raft_consensus.cc:2272] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.087196 30967 raft_consensus.cc:2749] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:33.087604 24141 leader_election.cc:304] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, c090031f610346ed82285cd847bca6d6
I20260709 12:20:33.088970 22903 tablet_replica.cc:333] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.089144 30967 raft_consensus.cc:2749] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:33.089936 22903 raft_consensus.cc:2243] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.090767 24141 leader_election.cc:304] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:33.092070 24141 raft_consensus.cc:2686] T 680463fca31f47d494316f240f1df66a P 5d0f174a97494d0cbf08ae81ec4c807a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:33.092206 22903 raft_consensus.cc:2272] T e1bb72a9478347d3a00d4ee984094ca3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.094000 24141 leader_election.cc:304] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:33.094631 24141 raft_consensus.cc:2686] T 8665b055009a4659b6d86621874dddbd P 5d0f174a97494d0cbf08ae81ec4c807a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:33.095252 22903 tablet_replica.cc:333] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.095497 24141 leader_election.cc:304] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:33.096146 22903 raft_consensus.cc:2243] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.096933 22903 raft_consensus.cc:2272] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:33.096190 24141 raft_consensus.cc:2686] T 010e8fce74be491b8432c9ea63b75515 P 5d0f174a97494d0cbf08ae81ec4c807a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:33.105767 30967 raft_consensus.cc:493] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c090031f610346ed82285cd847bca6d6)
I20260709 12:20:33.106334 30967 raft_consensus.cc:515] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:33.108481 30967 leader_election.cc:290] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:33.110345 22903 tablet_replica.cc:333] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.113893 22903 raft_consensus.cc:2243] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.114539 22903 raft_consensus.cc:2272] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.117671 22903 tablet_replica.cc:333] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.118563 22903 raft_consensus.cc:2243] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.119195 22903 raft_consensus.cc:2272] T 2391737d1a8643bd885a4db57ceba96c P 5d0f174a97494d0cbf08ae81ec4c807a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.121873 22903 tablet_replica.cc:333] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.122004 24141 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:33.122480 22903 raft_consensus.cc:2243] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.122974 30967 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:33.123329 22903 raft_consensus.cc:2272] T 25a02c46886249619a17c69df6ded3b4 P 5d0f174a97494d0cbf08ae81ec4c807a [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.125715 22903 tablet_replica.cc:333] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.126514 22903 raft_consensus.cc:2243] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.127138 22903 raft_consensus.cc:2272] T 51d85bfbe5fb4a4ba1caf713a20ce874 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.130115 22903 tablet_replica.cc:333] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.130947 22903 raft_consensus.cc:2243] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.131577 22903 raft_consensus.cc:2272] T 7bea694ade5d4f1daf189ff65fa4a13f P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.134495 22903 tablet_replica.cc:333] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.135347 22903 raft_consensus.cc:2243] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.136693 22903 raft_consensus.cc:2272] T 882bb02a9e9e423bbbc4df3dd0c55540 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.139737 22903 tablet_replica.cc:333] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.140564 22903 raft_consensus.cc:2243] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.141665 22903 raft_consensus.cc:2272] T 637c5886d38642daacb9b3dac3e4e9d2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.141477 24141 leader_election.cc:304] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:33.143604 30967 raft_consensus.cc:2749] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:33.144840 22903 tablet_replica.cc:333] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.145202 24141 leader_election.cc:304] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:33.145768 22903 raft_consensus.cc:2243] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.146119 30967 raft_consensus.cc:2749] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:33.147388 22903 raft_consensus.cc:2272] T ba2b8234ad7d402bb1de3ebc3a408c0f P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.148005 24141 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:33.150226 22903 tablet_replica.cc:333] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.151245 22903 raft_consensus.cc:2243] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.152390 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:33.151849 22903 raft_consensus.cc:2272] T 7c552e5996384fef9c032a7fda531298 P 5d0f174a97494d0cbf08ae81ec4c807a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.158877 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5f8a25e7c97459c955d7ca7accd826d" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:33.163687 22903 tablet_replica.cc:333] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.164556 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a36a91a0b5548f28dd004a49f5cac15" candidate_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:33.164966 22903 raft_consensus.cc:2243] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.166074 22903 raft_consensus.cc:2272] T c617be9ee61e4bb583e2fecf7f8cd9b2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.169160 22903 tablet_replica.cc:333] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.170068 22903 raft_consensus.cc:2243] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:20:33.171296 24141 raft_consensus.cc:2686] T 4b5c00e5364f4911a535f428ee9a0f9c P 5d0f174a97494d0cbf08ae81ec4c807a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:33.171422 22903 raft_consensus.cc:2272] T 2152258f0d654836a042cc0cf00d66a3 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.174886 22903 tablet_replica.cc:333] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.175869 22903 raft_consensus.cc:2243] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.181113 22903 raft_consensus.cc:2272] T 1388d59244114d37a482e6205f04c237 P 5d0f174a97494d0cbf08ae81ec4c807a [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.184229 22903 tablet_replica.cc:333] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.185153 22903 raft_consensus.cc:2243] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.185636 24141 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:33.186474 22903 raft_consensus.cc:2272] T e33dc2dd26074c7d8437ce5a91c0f8bf P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.189883 22903 tablet_replica.cc:333] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.191030 22903 raft_consensus.cc:2243] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.191743 22903 raft_consensus.cc:2272] T 272fa86b9b194257adecb1c4f372fde9 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.194948 22903 tablet_replica.cc:333] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.197093 22903 raft_consensus.cc:2243] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.198894 22903 raft_consensus.cc:2272] T 44755249cf394d0aa1ea6b45f82eb521 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.202239 22903 tablet_replica.cc:333] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.203153 22903 raft_consensus.cc:2243] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.204537 22903 raft_consensus.cc:2272] T b55ff2c6fc804b36ae275790f8dfe310 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:33.186479 24141 raft_consensus.cc:2686] T b5f8a25e7c97459c955d7ca7accd826d P 5d0f174a97494d0cbf08ae81ec4c807a: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:20:33.207671 22903 tablet_replica.cc:333] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.208653 22903 raft_consensus.cc:2243] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.210125 22903 raft_consensus.cc:2272] T 4f40c9d3e625486382331d48f50901e2 P 5d0f174a97494d0cbf08ae81ec4c807a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.213421 22903 tablet_replica.cc:333] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.214354 22903 raft_consensus.cc:2243] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.215039 22903 raft_consensus.cc:2272] T 8bcb2b2e4d1146f7a8201d801a112ca0 P 5d0f174a97494d0cbf08ae81ec4c807a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.218196 22903 tablet_replica.cc:333] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.219132 22903 raft_consensus.cc:2243] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.220847 22903 raft_consensus.cc:2272] T 290d272848834ed2813ddb5e16609dba P 5d0f174a97494d0cbf08ae81ec4c807a [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.235991 24141 leader_election.cc:304] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5d0f174a97494d0cbf08ae81ec4c807a; no voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:33.236986 30967 raft_consensus.cc:2749] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:33.243611 22903 tablet_replica.cc:333] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.244954 22903 raft_consensus.cc:2243] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.246620 22903 raft_consensus.cc:2272] T 39ed3ba506b24217972fa63093a56c52 P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.250113 22903 tablet_replica.cc:333] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.251086 22903 raft_consensus.cc:2243] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.251780 22903 raft_consensus.cc:2272] T 0a36a91a0b5548f28dd004a49f5cac15 P 5d0f174a97494d0cbf08ae81ec4c807a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.266928 22903 tablet_replica.cc:333] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.267915 22903 raft_consensus.cc:2243] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:33.268610 22903 raft_consensus.cc:2272] T a6831162b73f4c16a41519abb392404b P 5d0f174a97494d0cbf08ae81ec4c807a [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.283782 22903 tablet_replica.cc:333] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.284708 22903 raft_consensus.cc:2243] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.286168 22903 raft_consensus.cc:2272] T 3fc81ca349024898b0af873713a28fcb P 5d0f174a97494d0cbf08ae81ec4c807a [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:33.289382 22903 tablet_replica.cc:333] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a: stopping tablet replica
I20260709 12:20:33.290200 22903 raft_consensus.cc:2243] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:20:33.291606 22903 raft_consensus.cc:2272] T e37f672475a541c4b15e807dbe8bcd7d P 5d0f174a97494d0cbf08ae81ec4c807a [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:33.351141 24214 consensus_peers.cc:597] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:33.419767 30941 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:33.420420 30941 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:33.449393 24214 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:33.450865 30941 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:33.465468 24216 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:20:33.466024 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:33.466965 30941 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:33.470553 24216 connection.cc:769] client connection to 127.22.93.194:36209 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:20:33.624759 24779 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:33.627943 30765 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:33.628755 30765 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:33.631577 30765 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:33.638852 24781 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:33.644507 24779 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:33.650583 24779 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:33.651561 30765 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:33.659547 30941 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:33.660161 30941 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:33.662258 30941 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:33.690876 24216 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:33.695214 24214 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:33.698946 24214 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:33.707187 30941 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:33.778829 24214 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:33.947618 30970 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:33.948297 30970 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:33.950860 30970 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:33.961617 24781 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:33.962595 24779 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:33.963157 24779 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:33.964073 30970 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:33.964687 30973 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:33.965322 30973 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:33.967681 30973 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:33.983889 24214 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:33.985773 24216 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:33.986384 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:33.990216 30973 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:33.992147 24214 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:34.018504 30941 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.019212 30941 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.021425 30941 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.028944 24216 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:34.029536 24779 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:34.032616 24214 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.033154 24214 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.039258 30941 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:34.091331 24216 consensus_peers.cc:597] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.098199 24781 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.106775 24781 consensus_peers.cc:597] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:34.126292 30941 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.126963 30941 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.128996 30941 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.138865 24214 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:34.141737 24216 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.142304 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.146061 30941 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:34.168985 24214 consensus_peers.cc:597] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:34.175045 24781 consensus_peers.cc:597] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.177879 24779 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:34.179562 24216 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.195411 24781 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.203199 24216 consensus_peers.cc:597] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.220834 24216 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.243870 24781 consensus_peers.cc:597] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:34.256870 30960 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.257690 30960 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.260459 30960 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.268206 24216 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:34.272743 24214 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.273344 24214 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:34.280503 24214 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:34.280727 30973 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:34.301409 24779 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:34.304714 24214 consensus_peers.cc:597] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:34.307374 24216 consensus_peers.cc:597] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.307960 24216 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.326310 24781 consensus_peers.cc:597] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.366250 24214 consensus_peers.cc:597] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:34.383843 30973 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.384636 30973 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.386497 30970 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.387185 30970 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:34.388554 30973 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:34.391100 30973 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.392944 30973 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.395701 30973 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.398083 24779 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:34.399864 24216 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:34.400235 24781 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.400717 24781 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.401607 30890 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:34.402701 30970 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.405725 24214 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.406298 24214 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:34.407537 24781 consensus_peers.cc:597] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:34.408027 30973 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:34.407083 24216 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:34.415405 24214 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.415923 24214 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.416741 30973 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:34.472437 24216 consensus_peers.cc:597] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:34.475847 30973 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.476536 30973 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.479074 30973 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.485885 24216 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.486297 30970 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.486971 30970 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:34.488436 24214 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.488940 24214 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.489725 30973 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:34.492240 30970 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.497684 24779 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:34.499912 24781 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.500365 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.501188 30890 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.501801 30970 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:34.501684 30890 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:34.503922 30890 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:34.508095 30973 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.508665 30973 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.511059 30973 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.511564 22903 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24197)
W20260709 12:20:34.511798 24781 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:34.512971 24781 consensus_peers.cc:597] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.519922 24216 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:34.520764 24214 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.521224 24214 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.521994 30973 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:34.522782 30974 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.523443 30974 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:34.528255 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:34.533550 30974 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:34.534163 24781 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.534731 24781 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:34.535558 30890 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:34.535562 24781 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.541429 24779 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.541919 24779 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.542752 30890 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:34.542974 24779 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.564635 30890 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.565284 30890 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:34.567524 30890 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:34.577363 30973 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.578099 30973 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.579764 30941 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.580358 30941 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:34.580741 30973 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:34.583360 30941 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:34.586347 24808 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:34.587186 24808 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
W20260709 12:20:34.589617 24216 consensus_peers.cc:597] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.591490 24781 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:34.599414 24779 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.599902 24779 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:34.604440 24214 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:34.605110 24214 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:34.605587 24214 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:34.607213 30890 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:34.613046 24779 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:34.624336 24216 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.624891 24216 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:34.625960 24216 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.626406 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.626531 30973 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:34.627491 30973 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:34.630818 24216 consensus_peers.cc:597] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.631342 24214 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:20:34.655565 30941 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.656173 30941 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.658372 30941 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.666383 24214 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:34.667618 24216 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.668883 24216 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.668061 30974 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.670126 30974 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:34.671116 30941 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:34.672473 30974 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.682757 24779 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:34.684808 24781 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.685307 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.686141 30890 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:34.706851 24216 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.710227 24781 consensus_peers.cc:597] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.711773 24216 consensus_peers.cc:597] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.729204 24781 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:34.734282 30974 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.734901 30974 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:34.745518 24216 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.749722 24779 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:34.750661 24781 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.751142 24781 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.751998 30974 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:34.752622 30890 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:34.763006 30941 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:34.763602 30941 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:34.772680 30941 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:34.780524 24214 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:34.798570 24214 consensus_peers.cc:597] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:34.811336 24214 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:34.812291 24216 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:34.812865 24216 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:34.813612 30941 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:34.841871 24216 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:34.849640 24216 consensus_peers.cc:597] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:35.015638 24779 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:35.086815 24214 consensus_peers.cc:597] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:35.090793 24214 consensus_peers.cc:597] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:35.223992 24214 consensus_peers.cc:597] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:20:35.289935 30974 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:35.290654 30974 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:35.309623 24781 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:35.312139 24779 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:35.312717 24779 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:35.313689 30974 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:35.314594 30974 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:35.321115 24214 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:35.367578 24779 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:35.449791 30941 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:35.450408 30941 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:35.452471 30941 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:35.457845 24214 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:35.463487 24216 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:35.464291 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:35.465579 30941 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:35.512055 22903 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 24197)
I20260709 12:20:35.519104 30973 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:35.519799 30973 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:35.522114 30973 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:35.529276 24214 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:35.532027 24216 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:35.532545 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:35.533363 30973 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:35.553512 24214 consensus_peers.cc:597] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:35.643829 24214 consensus_peers.cc:597] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:35.739886 24214 consensus_peers.cc:597] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:20:35.800319 30941 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:35.800981 30941 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:35.803202 30941 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:35.810770 24214 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:35.811561 24216 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:35.812022 24216 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:35.812798 30973 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:35.881808 30941 raft_consensus.cc:493] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:35.882449 30941 raft_consensus.cc:515] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:35.887391 30941 leader_election.cc:290] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:35.893031 24216 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:35.894307 24214 leader_election.cc:336] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:35.894794 24214 leader_election.cc:304] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:35.895632 30941 raft_consensus.cc:2749] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:20:35.957311 30890 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:35.957983 30890 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:35.960376 30890 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:35.979866 24781 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:35.981559 24779 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:35.982100 24779 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:35.985535 30890 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:36.053771 30976 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.054477 30976 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:36.056922 30976 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.070464 24781 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:36.071729 24779 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.072196 24779 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.073577 30890 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:36.091338 30973 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.092022 30973 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:36.094404 30973 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.101999 24214 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:36.107549 24216 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:36.109447 24779 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:36.109905 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.110808 30941 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:36.114586 24214 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:36.155704 30973 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.156522 30973 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:36.164069 24214 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.166047 30973 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.175436 24216 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.176056 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.178659 30973 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:20:36.216596 30941 raft_consensus.cc:493] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.217222 30941 raft_consensus.cc:515] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:36.220127 30941 leader_election.cc:290] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:36.222424 30890 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.223160 30890 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:36.225597 30890 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.231503 24216 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:36.232506 24781 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:36.247887 24779 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.248490 24779 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.251243 30890 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:36.255550 30973 raft_consensus.cc:493] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.256279 30973 raft_consensus.cc:515] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:36.258671 30973 leader_election.cc:290] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.271121 24214 leader_election.cc:336] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.275851 24214 leader_election.cc:304] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.277742 30973 raft_consensus.cc:2749] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:36.286234 24214 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.314074 30890 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.314810 30890 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:36.319202 30890 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.321419 24216 leader_election.cc:336] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.327862 24216 leader_election.cc:304] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.336901 30973 raft_consensus.cc:2749] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:36.341382 24779 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.351802 30973 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.352552 30973 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:36.366637 24781 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.367316 24781 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.367945 30973 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.372622 24214 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.373620 30941 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.378765 30941 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:36.380963 30941 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:36.369450 30890 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:36.392877 30941 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.393483 30941 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:36.395529 30941 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.397068 24214 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.404531 30976 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.405175 30976 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:36.411857 30976 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.414484 24779 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:36.418594 24781 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.419127 24781 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.420519 30976 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:36.445086 24216 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:36.447168 24214 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.448136 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.451164 30941 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:36.450795 24216 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.455576 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.457926 30941 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:36.477087 30941 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.477774 30941 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:36.483114 24216 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.490319 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.493871 30973 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:36.492590 24214 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:20:36.492758 24813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "fa8cfbff90bf4881a56772b05008aadb" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c090031f610346ed82285cd847bca6d6" is_pre_election: true
I20260709 12:20:36.493085 30941 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), c090031f610346ed82285cd847bca6d6 (127.22.93.196:44187)
I20260709 12:20:36.496003 24813 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa8cfbff90bf4881a56772b05008aadb in term 16.
W20260709 12:20:36.512017 24214 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:36.512646 22903 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 24197)
W20260709 12:20:36.525857 24216 consensus_peers.cc:597] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.550675 24779 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:36.552328 24216 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.553894 24216 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6, fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.555004 30941 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:36.562139 24216 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.585892 24214 consensus_peers.cc:597] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:36.595644 24216 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.614924 24781 consensus_peers.cc:597] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:36.618595 30976 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.619211 30976 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:36.627681 24214 consensus_peers.cc:597] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:36.643008 24779 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.647750 30976 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.687121 24781 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.688154 24781 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.690694 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:36.707633 24214 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:36.702406 24779 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:36.709286 30890 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:36.718351 24216 consensus_peers.cc:597] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.748319 24216 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.775072 24781 consensus_peers.cc:597] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.817564 24781 consensus_peers.cc:597] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.828464 24779 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:36.871364 24781 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.887468 24214 consensus_peers.cc:597] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:20:36.914314 30973 raft_consensus.cc:493] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.915177 30973 raft_consensus.cc:515] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
W20260709 12:20:36.935557 24216 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.939460 30973 leader_election.cc:290] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:36.942231 30977 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:36.945950 30977 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:36.954005 24779 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:36.944770 24214 leader_election.cc:336] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:36.958622 24214 leader_election.cc:304] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:36.963992 30941 raft_consensus.cc:2749] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:36.966739 24781 consensus_peers.cc:597] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:36.968494 30977 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:36.988407 24214 consensus_peers.cc:597] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:36.986763 24781 consensus_peers.cc:597] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:36.999212 24781 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:36.999835 24781 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:37.000811 30977 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:37.011570 24779 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:37.010576 30973 raft_consensus.cc:493] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:37.013728 30973 raft_consensus.cc:515] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:37.016032 30973 leader_election.cc:290] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:37.028106 24216 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:37.031024 24214 leader_election.cc:336] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:37.031498 24214 leader_election.cc:304] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:37.033277 30973 raft_consensus.cc:2749] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:37.057490 23984 catalog_manager.cc:4755] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e016416bdc742068f5568ff2bebabd1: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:37.074469 24214 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:37.095389 24216 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111) [suppressed 612 similar messages]
W20260709 12:20:37.106130 24214 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:37.125860 24781 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.126026 24216 consensus_peers.cc:597] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.151440 24781 consensus_peers.cc:597] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.169675 24216 consensus_peers.cc:597] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.209467 24214 consensus_peers.cc:597] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:37.210707 24216 consensus_peers.cc:597] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.222821 24216 consensus_peers.cc:597] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.235948 24216 consensus_peers.cc:597] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.288313 24216 consensus_peers.cc:597] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.373294 24836 debug-util.cc:398] Leaking SignalData structure 0x7b080008d9c0 after lost signal to thread 22906
W20260709 12:20:37.374826 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7ea0 after lost signal to thread 24033
W20260709 12:20:37.376540 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08003bcd40 after lost signal to thread 24274
W20260709 12:20:37.378014 24836 debug-util.cc:398] Leaking SignalData structure 0x7b08003fe620 after lost signal to thread 24839
W20260709 12:20:37.393513 24216 consensus_peers.cc:597] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.408524 24216 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.506626 24781 consensus_peers.cc:597] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:20:37.508726 30890 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:37.509358 30890 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:37.511816 30890 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:37.517484 24779 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:37.533388 24781 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:37.533926 24781 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:37.535070 30977 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:37.547216 24781 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.591751 24779 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:37.609689 24214 consensus_peers.cc:597] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:37.620160 24216 consensus_peers.cc:597] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:20:37.627818 24779 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:37.648633 24214 consensus_peers.cc:597] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:20:37.650095 22903 tablet_server.cc:196] TabletServer@127.22.93.194:0 shutdown complete.
W20260709 12:20:37.670339 24214 consensus_peers.cc:597] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:37.854075 24215 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:44187, user_credentials={real_user=slave}} blocked reactor thread for 53031.9us
I20260709 12:20:37.857311 30973 raft_consensus.cc:493] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:37.858011 30973 raft_consensus.cc:515] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:37.863202 30973 leader_election.cc:290] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:37.866382 24214 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:37.871146 24216 leader_election.cc:336] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:37.873741 24216 leader_election.cc:304] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:37.877494 30973 raft_consensus.cc:2749] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:37.987602 30981 raft_consensus.cc:493] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:37.989455 30981 raft_consensus.cc:515] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:38.001078 30981 leader_election.cc:290] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:38.017778 30984 raft_consensus.cc:493] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:38.018810 30984 raft_consensus.cc:515] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:38.021981 30984 leader_election.cc:290] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:38.060807 30985 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:38.062130 30985 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:38.084218 30985 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:38.089164 30987 raft_consensus.cc:493] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:38.090106 30987 raft_consensus.cc:515] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:38.092991 30987 leader_election.cc:290] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:38.094619 24779 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:38.105122 24244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "44755249cf394d0aa1ea6b45f82eb521" candidate_uuid: "c090031f610346ed82285cd847bca6d6" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "fa8cfbff90bf4881a56772b05008aadb" is_pre_election: true
I20260709 12:20:38.106431 24244 raft_consensus.cc:2468] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c090031f610346ed82285cd847bca6d6 in term 16.
W20260709 12:20:38.112365 24781 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:38.112825 24214 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:38.113137 24781 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:38.115157 24214 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:20:38.115729 30890 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:38.115935 24214 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:38.115741 24216 leader_election.cc:336] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:38.117295 24216 leader_election.cc:304] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:38.118235 30973 raft_consensus.cc:2749] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:38.119444 24216 leader_election.cc:336] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:38.122362 24216 leader_election.cc:304] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:38.131222 30973 raft_consensus.cc:2749] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:38.136125 24214 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:38.141419 24214 consensus_peers.cc:597] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:38.146581 24216 leader_election.cc:336] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:38.150074 24216 leader_election.cc:304] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:38.154870 30984 raft_consensus.cc:2749] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:38.247587 30973 raft_consensus.cc:493] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:38.248312 30973 raft_consensus.cc:515] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:38.252458 30973 leader_election.cc:290] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:38.256412 24214 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:38.258617 30890 raft_consensus.cc:493] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:38.259732 30890 raft_consensus.cc:515] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:38.261471 24216 leader_election.cc:336] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:38.262131 24216 leader_election.cc:304] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:38.262912 30973 raft_consensus.cc:2749] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:38.266397 30890 leader_election.cc:290] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:38.281306 24779 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:38.285351 24781 leader_election.cc:336] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:38.291149 24781 leader_election.cc:304] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:38.292853 30890 raft_consensus.cc:2749] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:38.292984 24214 consensus_peers.cc:597] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:20:38.418414 22903 tablet_server.cc:179] TabletServer@127.22.93.195:0 shutting down...
I20260709 12:20:38.514792 30984 raft_consensus.cc:493] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:38.516220 30973 raft_consensus.cc:493] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:38.517778 30973 raft_consensus.cc:515] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:38.520069 30973 leader_election.cc:290] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:38.523087 30984 raft_consensus.cc:515] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:38.529034 30984 leader_election.cc:290] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:38.531415 24214 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:38.535233 24214 consensus_peers.cc:597] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:38.536974 24216 leader_election.cc:336] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:38.537546 24216 leader_election.cc:304] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:38.548059 24216 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:38.550055 30984 raft_consensus.cc:2749] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:20:38.557132 24214 leader_election.cc:336] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:38.564736 24214 leader_election.cc:304] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:38.601706 30973 raft_consensus.cc:2749] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:38.657385 24780 consensus_peers.cc:597] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.678112 24780 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.680584 24780 consensus_peers.cc:597] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.681746 24780 consensus_peers.cc:597] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.695860 30985 raft_consensus.cc:493] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:38.696725 30985 raft_consensus.cc:515] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:38.695206 24780 consensus_peers.cc:597] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.704784 30985 leader_election.cc:290] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:38.708249 24779 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:20:38.711087 24779 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:38.713382 24214 consensus_peers.cc:597] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:38.718037 24781 leader_election.cc:336] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:38.718621 24781 leader_election.cc:304] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:38.719648 30985 raft_consensus.cc:2749] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:38.771952 24214 consensus_peers.cc:597] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:20:38.774358 30985 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:38.775158 30985 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:38.782505 30985 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:38.786638 24781 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:38.788821 24779 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:38.789278 24779 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:38.793642 30985 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:38.799082 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:38.801126 22903 tablet_replica.cc:333] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.811224 22903 raft_consensus.cc:2243] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.812592 22903 raft_consensus.cc:2272] T 0996a24d22664e97aa7ba765bb20ef47 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.819698 24780 consensus_peers.cc:597] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.827004 22903 tablet_replica.cc:333] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.828447 22903 raft_consensus.cc:2243] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.829569 22903 raft_consensus.cc:2272] T 67948aed495f4bd9b04d87c9adbfe164 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.833624 22903 tablet_replica.cc:333] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.834720 22903 raft_consensus.cc:2243] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.836707 22903 raft_consensus.cc:2272] T ce278f8a39b344f9a0cd7dcd099a3b66 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.840073 22903 tablet_replica.cc:333] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.841670 22903 raft_consensus.cc:2243] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.842582 22903 raft_consensus.cc:2272] T 07add62ce67548c3bdb714821b78d1d1 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.846375 22903 tablet_replica.cc:333] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.847333 22903 raft_consensus.cc:2243] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.849045 22903 raft_consensus.cc:2272] T 93e303f1b8c84a32a8a6522ee6c6fb27 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.852396 22903 tablet_replica.cc:333] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.853461 22903 raft_consensus.cc:2243] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.854703 22903 raft_consensus.cc:2272] T 30d4ada45d4b4872986993abc4470158 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.855482 24780 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.858300 22903 tablet_replica.cc:333] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.859567 22903 raft_consensus.cc:2243] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.861366 22903 raft_consensus.cc:2272] T 73fc2a59a00e4ea6a3b63c28c6f58512 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.864650 22903 tablet_replica.cc:333] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.865623 22903 raft_consensus.cc:2243] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.866456 22903 raft_consensus.cc:2272] T 07fcc70b8c0d43ae8334ea802c9a9924 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.869691 22903 tablet_replica.cc:333] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.871026 22903 raft_consensus.cc:2243] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.872781 22903 raft_consensus.cc:2272] T f1c672629a7b441f9e55890cd643e03a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.876308 22903 tablet_replica.cc:333] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.877324 22903 raft_consensus.cc:2243] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.878212 22903 raft_consensus.cc:2272] T e1bb72a9478347d3a00d4ee984094ca3 P fa8cfbff90bf4881a56772b05008aadb [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.881776 22903 tablet_replica.cc:333] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.882774 22903 raft_consensus.cc:2243] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.883733 22903 raft_consensus.cc:2272] T 46a4dd5f831f4ddca30827249660c52a P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.887341 22903 tablet_replica.cc:333] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.891366 22903 raft_consensus.cc:2243] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.892374 22903 raft_consensus.cc:2272] T 8665b055009a4659b6d86621874dddbd P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.896173 22903 tablet_replica.cc:333] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.897279 22903 raft_consensus.cc:2243] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.898728 22903 raft_consensus.cc:2272] T 984475bb8f024d469921acdc98196b93 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.902074 22903 tablet_replica.cc:333] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.903110 22903 raft_consensus.cc:2243] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.906422 22903 raft_consensus.cc:2272] T 988ca15bb1fd49b7822eef733e4a24a3 P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.910440 22903 tablet_replica.cc:333] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.911507 22903 raft_consensus.cc:2243] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.913213 22903 raft_consensus.cc:2272] T 7b5b70d71470484d8fc5f942623adb98 P fa8cfbff90bf4881a56772b05008aadb [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.916563 22903 tablet_replica.cc:333] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.917518 22903 raft_consensus.cc:2243] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:38.919354 24780 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.920136 22903 raft_consensus.cc:2272] T 680463fca31f47d494316f240f1df66a P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.923640 22903 tablet_replica.cc:333] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.924703 22903 raft_consensus.cc:2243] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.925475 22903 raft_consensus.cc:2272] T f4b7521a95604ae58fb9e26c98b5e4a6 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.928925 22903 tablet_replica.cc:333] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.929984 22903 raft_consensus.cc:2243] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.930943 22903 raft_consensus.cc:2272] T 010e8fce74be491b8432c9ea63b75515 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.934407 22903 tablet_replica.cc:333] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.935662 22903 raft_consensus.cc:2243] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.936820 22903 raft_consensus.cc:2272] T 5bc5bc9605e64854a78054b02b3da6dd P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.940704 22903 tablet_replica.cc:333] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.941810 22903 raft_consensus.cc:2243] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.945408 22903 raft_consensus.cc:2272] T b29f161fe0e24b51ad5c1903bdc5112c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.949288 22903 tablet_replica.cc:333] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.950213 22903 raft_consensus.cc:2243] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.952950 22903 raft_consensus.cc:2272] T d4ba8a9e171042a4a56a0f731bf431cc P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.956636 22903 tablet_replica.cc:333] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.957640 22903 raft_consensus.cc:2243] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.966543 22903 raft_consensus.cc:2272] T 0ab5a3f1f43046a9860089fc73f7efff P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:38.969614 24780 consensus_peers.cc:597] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:38.973846 24780 consensus_peers.cc:597] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:38.974905 22903 tablet_replica.cc:333] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.976140 22903 raft_consensus.cc:2243] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.977874 22903 raft_consensus.cc:2272] T 4b5c00e5364f4911a535f428ee9a0f9c P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.981302 22903 tablet_replica.cc:333] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.982316 22903 raft_consensus.cc:2243] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.984359 22903 raft_consensus.cc:2272] T f9a75b1a807b49b791d2de5abd8f8ca1 P fa8cfbff90bf4881a56772b05008aadb [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.987946 22903 tablet_replica.cc:333] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.988945 22903 raft_consensus.cc:2243] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:38.990644 22903 raft_consensus.cc:2272] T b5f8a25e7c97459c955d7ca7accd826d P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:38.994529 22903 tablet_replica.cc:333] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:38.995518 22903 raft_consensus.cc:2243] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:38.996565 22903 raft_consensus.cc:2272] T 2391737d1a8643bd885a4db57ceba96c P fa8cfbff90bf4881a56772b05008aadb [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:39.000738 24779 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:20:39.007426 22903 tablet_replica.cc:333] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.008623 22903 raft_consensus.cc:2243] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.010536 22903 raft_consensus.cc:2272] T 25a02c46886249619a17c69df6ded3b4 P fa8cfbff90bf4881a56772b05008aadb [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.014253 22903 tablet_replica.cc:333] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.015233 22903 raft_consensus.cc:2243] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.016970 22903 raft_consensus.cc:2272] T 4e320f288fdb4be0ada8bfff79b41a9a P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.028750 22903 tablet_replica.cc:333] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.029785 22903 raft_consensus.cc:2243] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.031586 22903 raft_consensus.cc:2272] T 51d85bfbe5fb4a4ba1caf713a20ce874 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.035143 22903 tablet_replica.cc:333] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.036121 22903 raft_consensus.cc:2243] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.037051 22903 raft_consensus.cc:2272] T 637c5886d38642daacb9b3dac3e4e9d2 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.038715 30981 raft_consensus.cc:493] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:39.039408 30981 raft_consensus.cc:515] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } }
I20260709 12:20:39.040876 22903 tablet_replica.cc:333] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.042173 30981 leader_election.cc:290] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:39.046509 22903 raft_consensus.cc:2243] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.048312 22903 raft_consensus.cc:2272] T 7bea694ade5d4f1daf189ff65fa4a13f P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:39.049219 24214 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:39.050213 24216 leader_election.cc:336] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:39.050808 24216 leader_election.cc:304] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa8cfbff90bf4881a56772b05008aadb; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:39.051681 22903 tablet_replica.cc:333] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.051704 30981 raft_consensus.cc:2749] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:39.052845 22903 raft_consensus.cc:2243] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.053901 22903 raft_consensus.cc:2272] T ba2b8234ad7d402bb1de3ebc3a408c0f P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.057515 22903 tablet_replica.cc:333] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.058499 22903 raft_consensus.cc:2243] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.060163 22903 raft_consensus.cc:2272] T 7c552e5996384fef9c032a7fda531298 P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.063512 22903 tablet_replica.cc:333] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.064512 22903 raft_consensus.cc:2243] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.066120 22903 raft_consensus.cc:2272] T c617be9ee61e4bb583e2fecf7f8cd9b2 P fa8cfbff90bf4881a56772b05008aadb [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.069742 22903 tablet_replica.cc:333] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.070730 22903 raft_consensus.cc:2243] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.072404 22903 raft_consensus.cc:2272] T 6f5cb153ce4e4ac387672e2345a08fa5 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.076387 22903 tablet_replica.cc:333] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.077411 22903 raft_consensus.cc:2243] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.078405 22903 raft_consensus.cc:2272] T 39ed3ba506b24217972fa63093a56c52 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.081930 22903 tablet_replica.cc:333] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.082839 22903 raft_consensus.cc:2243] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.084578 22903 raft_consensus.cc:2272] T 9e016416bdc742068f5568ff2bebabd1 P fa8cfbff90bf4881a56772b05008aadb [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.088095 22903 tablet_replica.cc:333] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.089088 22903 raft_consensus.cc:2243] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.090873 22903 raft_consensus.cc:2272] T 45016a37c2d9462798b1991f8cb78e65 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.094511 22903 tablet_replica.cc:333] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.095507 22903 raft_consensus.cc:2243] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.097136 22903 raft_consensus.cc:2272] T 683c964dc5814af698a7b4af6649e9ed P fa8cfbff90bf4881a56772b05008aadb [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.100430 22903 tablet_replica.cc:333] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
W20260709 12:20:39.213716 24781 consensus_peers.cc:597] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:39.271276 30990 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:39.373523 30990 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:39.282768 30985 raft_consensus.cc:493] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:39.365458 22903 raft_consensus.cc:2243] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.375850 30985 raft_consensus.cc:515] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:39.371425 24781 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:36209, user_credentials={real_user=slave}} blocked reactor thread for 157790us
W20260709 12:20:39.376919 24781 consensus_peers.cc:597] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:39.378424 30985 leader_election.cc:290] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:39.381093 30990 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:39.384958 24779 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:39.390424 24216 consensus_peers.cc:597] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:39.398655 24779 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:39.399403 24779 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:39.376293 22903 raft_consensus.cc:2272] T 3fc81ca349024898b0af873713a28fcb P fa8cfbff90bf4881a56772b05008aadb [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.408936 22903 tablet_replica.cc:333] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.422209 22903 raft_consensus.cc:2243] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.418310 30989 raft_consensus.cc:493] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:39.424687 30890 raft_consensus.cc:493] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
W20260709 12:20:39.427191 24214 consensus_peers.cc:597] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:39.415640 24781 consensus_peers.cc:597] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:39.429971 24781 leader_election.cc:336] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:39.429629 30890 raft_consensus.cc:515] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:39.430393 24781 leader_election.cc:304] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
W20260709 12:20:39.431447 24781 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:39.431888 24781 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:39.432626 30890 leader_election.cc:290] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:39.433733 30989 raft_consensus.cc:515] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:39.441406 30989 leader_election.cc:290] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:39.442737 24781 consensus_peers.cc:597] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:39.437331 24779 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:20:39.434688 30985 raft_consensus.cc:2749] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:39.443441 30989 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:39.436426 22903 raft_consensus.cc:2272] T 0a36a91a0b5548f28dd004a49f5cac15 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.449631 22903 tablet_replica.cc:333] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.470245 22903 raft_consensus.cc:2243] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 16 LEADER]: Raft consensus shutting down.
W20260709 12:20:39.469090 24781 consensus_peers.cc:597] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:39.466267 24779 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:20:39.476641 22903 raft_consensus.cc:2272] T a6831162b73f4c16a41519abb392404b P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:39.493999 24781 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:39.507087 24781 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:39.507592 24779 leader_election.cc:336] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:39.534091 24779 leader_election.cc:304] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:39.538254 30985 raft_consensus.cc:2749] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:39.539817 24779 leader_election.cc:336] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:39.541914 24779 leader_election.cc:304] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:39.536294 22903 tablet_replica.cc:333] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.544710 22903 raft_consensus.cc:2243] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.546054 30890 raft_consensus.cc:2749] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:20:39.549443 22903 raft_consensus.cc:2272] T 272fa86b9b194257adecb1c4f372fde9 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.561187 22903 tablet_replica.cc:333] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
W20260709 12:20:39.555423 24781 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:39.577196 24781 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:39.578492 22903 raft_consensus.cc:2243] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.580888 22903 raft_consensus.cc:2272] T 44755249cf394d0aa1ea6b45f82eb521 P fa8cfbff90bf4881a56772b05008aadb [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.584646 22903 tablet_replica.cc:333] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.586016 22903 raft_consensus.cc:2243] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:20:39.587675 22903 raft_consensus.cc:2272] T d84a44368371490a8287d9cb8d1620d0 P fa8cfbff90bf4881a56772b05008aadb [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.596726 22903 tablet_replica.cc:333] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.597679 22903 raft_consensus.cc:2243] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.598489 22903 raft_consensus.cc:2272] T b55ff2c6fc804b36ae275790f8dfe310 P fa8cfbff90bf4881a56772b05008aadb [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:39.602625 22903 tablet_replica.cc:333] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb: stopping tablet replica
I20260709 12:20:39.603533 22903 raft_consensus.cc:2243] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:39.612591 22903 raft_consensus.cc:2272] T 4f40c9d3e625486382331d48f50901e2 P fa8cfbff90bf4881a56772b05008aadb [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:39.662417 24781 consensus_peers.cc:597] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:39.698041 24781 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:39.944459 30985 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:39.945307 30985 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:39.960685 30985 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:39.962440 24781 consensus_peers.cc:597] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:20:39.963061 24781 leader_election.cc:336] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:39.967721 30985 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:39.968431 30985 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:39.976699 24779 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:39.978039 30985 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:39.985687 24780 leader_election.cc:336] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:39.989970 30890 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:39.990612 30890 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:39.992800 30890 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.005859 24779 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:39.986578 24780 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.008036 30985 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:40.029280 24780 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.029978 24780 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.031481 30985 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:40.037606 24780 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.038188 24780 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.039114 30985 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:20:40.054306 24781 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:20:40.055451 30985 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.056218 30985 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.059041 30985 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.066732 24781 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:40.081655 30890 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.082224 30890 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.084245 30890 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.088732 24779 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:40.091087 24780 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.091876 24780 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.092555 30985 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:40.094691 24780 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.095173 24780 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.095889 30985 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:40.121728 24779 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:20:40.131762 30985 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.132511 30985 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.135054 30985 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.139686 24781 leader_election.cc:336] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:40.144699 24780 leader_election.cc:336] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.145223 24780 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.145957 30985 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:40.166147 30985 raft_consensus.cc:493] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.166817 30985 raft_consensus.cc:515] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.171631 30985 leader_election.cc:290] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.173838 24779 leader_election.cc:336] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:40.174947 24780 leader_election.cc:336] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.175385 24780 leader_election.cc:304] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.176044 30985 raft_consensus.cc:2749] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:20:40.280607 30985 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.281350 30985 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.283993 30985 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.288885 24779 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:40.289878 24780 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.290318 24780 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.291167 30985 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:40.298664 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08000f87a0 after lost signal to thread 22906
W20260709 12:20:40.300284 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080029a160 after lost signal to thread 24033
W20260709 12:20:40.301031 24271 debug-util.cc:398] Leaking SignalData structure 0x7b08002bd860 after lost signal to thread 24274
W20260709 12:20:40.302582 24271 debug-util.cc:398] Leaking SignalData structure 0x7b080009d200 after lost signal to thread 24839
I20260709 12:20:40.307961 30985 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.308728 30985 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.309235 30890 raft_consensus.cc:493] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.309885 30890 raft_consensus.cc:515] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.312091 30890 leader_election.cc:290] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:40.311589 30985 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.318840 24781 leader_election.cc:336] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:40.321417 24779 leader_election.cc:336] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:40.325333 24780 leader_election.cc:336] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.325793 24780 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.326624 30985 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:40.326854 24780 leader_election.cc:336] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.327456 24780 leader_election.cc:304] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.328212 30985 raft_consensus.cc:2749] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:20:40.375532 30985 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.376209 30985 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:40.386266 24779 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:40.392310 24780 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.392761 24780 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.393792 30890 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:20:40.394815 30890 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.395377 30890 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.397497 30890 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:40.407146 30985 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.417380 24781 leader_election.cc:336] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:40.420439 24780 leader_election.cc:336] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.422740 24780 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.409353 30890 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.430729 30890 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.433070 30890 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:40.433622 30985 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:20:40.458691 24781 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:40.465096 24780 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.469017 24780 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.473685 30993 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:20:40.467510 24779 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:40.475279 30994 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:40.475903 30994 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.478392 30994 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.483613 24779 leader_election.cc:336] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:40.488487 24780 leader_election.cc:336] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:40.489006 24780 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.489818 30994 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:40.738168 30994 raft_consensus.cc:493] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:40.738874 30994 raft_consensus.cc:515] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:40.747236 24781 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:40.748603 30994 leader_election.cc:290] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
W20260709 12:20:40.760254 24779 leader_election.cc:336] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:40.760993 24779 leader_election.cc:304] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:40.762858 30985 raft_consensus.cc:2749] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:40.763630 30985 raft_consensus.cc:493] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:40.764168 30985 raft_consensus.cc:515] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } attrs { replace: true } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:40.767828 30985 leader_election.cc:290] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:40.776254 24780 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
W20260709 12:20:40.780731 24781 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:40.781426 24781 leader_election.cc:304] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:40.784888 30994 raft_consensus.cc:2749] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:40.789008 24779 leader_election.cc:336] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:40.842795 22903 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 24271)
W20260709 12:20:40.942545 24780 consensus_peers.cc:597] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:40.954437 24780 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:41.005932 24780 consensus_peers.cc:597] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:20:41.031224 30985 raft_consensus.cc:493] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:41.032310 30985 raft_consensus.cc:515] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:41.034973 30985 leader_election.cc:290] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:41.022917 30994 raft_consensus.cc:493] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:41.044134 30994 raft_consensus.cc:515] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:41.049690 30994 leader_election.cc:290] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:41.068850 24780 leader_election.cc:336] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
W20260709 12:20:41.070343 24780 consensus_peers.cc:597] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:41.067044 24781 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:41.102437 24779 leader_election.cc:336] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:41.103132 24779 leader_election.cc:304] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:41.105738 30985 raft_consensus.cc:2749] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:20:41.108709 24780 consensus_peers.cc:597] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:41.116704 24779 leader_election.cc:336] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:41.117245 24779 leader_election.cc:304] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:41.122156 30996 raft_consensus.cc:2749] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:20:41.323961 24779 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:20:41.350555 24780 consensus_peers.cc:597] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:41.357182 24780 consensus_peers.cc:597] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:41.482283 24781 consensus_peers.cc:597] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:41.482666 24780 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:41.558215 24780 consensus_peers.cc:597] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:41.650709 24779 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:41.654301 24780 consensus_peers.cc:597] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 -> Peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Couldn't send request to peer fa8cfbff90bf4881a56772b05008aadb. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:20:41.682503 24781 consensus_peers.cc:597] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:41.715178 30985 raft_consensus.cc:493] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:41.715993 30985 raft_consensus.cc:515] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:41.718642 30985 leader_election.cc:290] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:41.723482 24781 leader_election.cc:336] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:41.724051 24780 leader_election.cc:336] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:41.724534 24780 leader_election.cc:304] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:41.725358 30985 raft_consensus.cc:2749] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:20:41.741030 24779 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:20:41.833390 24781 consensus_peers.cc:597] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:41.846618 30985 raft_consensus.cc:493] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:41.847424 30985 raft_consensus.cc:515] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:41.851346 30985 leader_election.cc:290] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:41.855641 24779 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:41.860050 24780 leader_election.cc:336] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:41.860608 24780 leader_election.cc:304] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:41.862671 30985 raft_consensus.cc:2749] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:20:41.874614 24781 consensus_peers.cc:597] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:41.877379 24779 consensus_peers.cc:597] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:20:41.921057 30985 raft_consensus.cc:493] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:41.921782 30985 raft_consensus.cc:515] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:41.924430 30985 leader_election.cc:290] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:41.929263 24779 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:41.930209 24780 leader_election.cc:336] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:41.930671 24780 leader_election.cc:304] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:41.931576 30985 raft_consensus.cc:2749] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:20:41.967609 24779 consensus_peers.cc:597] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:20:41.973623 30985 raft_consensus.cc:493] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:41.974205 30996 raft_consensus.cc:493] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:41.974418 30985 raft_consensus.cc:515] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:41.974858 30996 raft_consensus.cc:515] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:41.977252 30996 leader_election.cc:290] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:41.978304 30985 leader_election.cc:290] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:41.980863 30996 raft_consensus.cc:493] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:41.981406 30996 raft_consensus.cc:515] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:41.983170 24781 leader_election.cc:336] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:41.983731 30996 leader_election.cc:290] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:41.989137 24779 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:41.990197 24780 leader_election.cc:336] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:41.990690 24780 leader_election.cc:304] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
W20260709 12:20:41.991971 24780 leader_election.cc:336] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
W20260709 12:20:41.992317 24781 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:41.992558 30985 raft_consensus.cc:2749] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:20:41.992364 24780 leader_election.cc:304] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:41.993944 30985 raft_consensus.cc:2749] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:20:41.996704 24780 leader_election.cc:336] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:41.997169 24780 leader_election.cc:304] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:41.997888 30985 raft_consensus.cc:2749] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:42.020579 24781 consensus_peers.cc:597] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:20:42.036226 24781 consensus_peers.cc:597] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:42.054032 30985 raft_consensus.cc:493] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:42.054738 30985 raft_consensus.cc:515] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:42.056981 30985 leader_election.cc:290] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:42.063218 24781 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
W20260709 12:20:42.067333 24780 leader_election.cc:336] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:42.067842 24780 leader_election.cc:304] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:42.069222 30985 raft_consensus.cc:2749] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:42.070308 22903 tablet_server.cc:196] TabletServer@127.22.93.195:0 shutdown complete.
W20260709 12:20:42.073973 24781 consensus_peers.cc:597] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:42.090698 30985 raft_consensus.cc:493] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:42.091511 30985 raft_consensus.cc:515] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:42.094110 30985 leader_election.cc:290] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:42.096196 24779 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111) [suppressed 460 similar messages]
W20260709 12:20:42.100531 24779 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
W20260709 12:20:42.101286 24780 leader_election.cc:336] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:42.101725 24780 leader_election.cc:304] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:42.102546 30985 raft_consensus.cc:2749] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:20:42.173782 30985 raft_consensus.cc:493] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:42.174510 30985 raft_consensus.cc:515] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:42.177275 30985 leader_election.cc:290] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
W20260709 12:20:42.183756 24780 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
W20260709 12:20:42.184383 24779 leader_election.cc:336] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:42.185060 24779 leader_election.cc:304] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:42.186019 30985 raft_consensus.cc:2749] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:20:42.202421 24781 consensus_peers.cc:597] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:42.218218 22903 tablet_server.cc:179] TabletServer@127.22.93.196:0 shutting down...
W20260709 12:20:42.257129 24781 consensus_peers.cc:597] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 -> Peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Couldn't send request to peer 5d0f174a97494d0cbf08ae81ec4c807a. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:20:42.283919 30985 raft_consensus.cc:493] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 5d0f174a97494d0cbf08ae81ec4c807a)
I20260709 12:20:42.285022 30985 raft_consensus.cc:515] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:42.286069 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:42.287323 22903 tablet_replica.cc:333] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
W20260709 12:20:42.284663 24030 debug-util.cc:398] Leaking SignalData structure 0x7b0800153fc0 after lost signal to thread 22906
I20260709 12:20:42.288902 22903 raft_consensus.cc:2243] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:42.289894 24030 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa0a0 after lost signal to thread 24033
I20260709 12:20:42.290372 22903 raft_consensus.cc:2272] T 9e016416bdc742068f5568ff2bebabd1 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:42.292160 24030 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7de0 after lost signal to thread 24839
I20260709 12:20:42.295120 22903 tablet_replica.cc:333] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.296447 22903 raft_consensus.cc:2243] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.297600 22903 raft_consensus.cc:2272] T 44755249cf394d0aa1ea6b45f82eb521 P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:42.300508 24779 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:42.301589 22903 tablet_replica.cc:333] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.302078 30985 leader_election.cc:290] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209)
I20260709 12:20:42.303218 22903 raft_consensus.cc:2243] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.304719 22903 raft_consensus.cc:2272] T 290d272848834ed2813ddb5e16609dba P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.309137 22903 tablet_replica.cc:333] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.308899 30996 raft_consensus.cc:493] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:42.310628 22903 raft_consensus.cc:2243] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.309998 30996 raft_consensus.cc:515] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5d0f174a97494d0cbf08ae81ec4c807a" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 36209 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:42.312824 22903 raft_consensus.cc:2272] T 5bc5bc9605e64854a78054b02b3da6dd P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.313467 30996 leader_election.cc:290] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:42.317364 22903 tablet_replica.cc:333] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.318763 22903 raft_consensus.cc:2243] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.308043 30985 raft_consensus.cc:493] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:42.319814 30985 raft_consensus.cc:515] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
I20260709 12:20:42.320403 22903 raft_consensus.cc:2272] T 8665b055009a4659b6d86621874dddbd P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.324879 22903 tablet_replica.cc:333] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.326126 22903 raft_consensus.cc:2243] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.327932 22903 raft_consensus.cc:2272] T d4ba8a9e171042a4a56a0f731bf431cc P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.328320 30996 raft_consensus.cc:493] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader fa8cfbff90bf4881a56772b05008aadb)
I20260709 12:20:42.329082 30996 raft_consensus.cc:515] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "729aa4b1ccec48b588c14e67652c61e1" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 44043 } } peers { permanent_uuid: "fa8cfbff90bf4881a56772b05008aadb" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37157 } } peers { permanent_uuid: "c090031f610346ed82285cd847bca6d6" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 44187 } attrs { promote: false } }
W20260709 12:20:42.331593 24779 leader_election.cc:336] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:42.331940 30996 leader_election.cc:290] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:42.332465 22903 tablet_replica.cc:333] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.333606 22903 raft_consensus.cc:2243] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.334553 22903 raft_consensus.cc:2272] T 7b5b70d71470484d8fc5f942623adb98 P c090031f610346ed82285cd847bca6d6 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.338209 22903 tablet_replica.cc:333] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.339195 22903 raft_consensus.cc:2243] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:42.339283 24780 leader_election.cc:336] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
W20260709 12:20:42.339943 24780 leader_election.cc:336] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:42.340014 22903 raft_consensus.cc:2272] T 9dd67e018d26493bae6d921a57dfc306 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.344753 22903 tablet_replica.cc:333] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.345701 22903 raft_consensus.cc:2243] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.346484 22903 raft_consensus.cc:2272] T ce278f8a39b344f9a0cd7dcd099a3b66 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:42.349647 24779 leader_election.cc:336] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:42.349872 22903 tablet_replica.cc:333] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.350170 24779 leader_election.cc:304] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:42.351086 22903 raft_consensus.cc:2243] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:20:42.351325 24781 leader_election.cc:336] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:42.352573 30996 raft_consensus.cc:2749] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:20:42.352854 22903 raft_consensus.cc:2272] T 8bcb2b2e4d1146f7a8201d801a112ca0 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.351841 24781 leader_election.cc:304] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, 729aa4b1ccec48b588c14e67652c61e1
I20260709 12:20:42.355266 30985 leader_election.cc:290] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043), fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157)
I20260709 12:20:42.355840 30985 raft_consensus.cc:2749] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:20:42.357808 22903 tablet_replica.cc:333] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.358871 22903 raft_consensus.cc:2243] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.359792 22903 raft_consensus.cc:2272] T 882bb02a9e9e423bbbc4df3dd0c55540 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.363085 22903 tablet_replica.cc:333] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.364107 22903 raft_consensus.cc:2243] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:20:42.364250 24780 leader_election.cc:336] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer fa8cfbff90bf4881a56772b05008aadb (127.22.93.195:37157): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37157: connect: Connection refused (error 111)
I20260709 12:20:42.364821 24780 leader_election.cc:304] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 729aa4b1ccec48b588c14e67652c61e1, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:42.365587 22903 raft_consensus.cc:2272] T 0a36a91a0b5548f28dd004a49f5cac15 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.366276 30996 raft_consensus.cc:2749] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:20:42.368633 24781 leader_election.cc:336] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5d0f174a97494d0cbf08ae81ec4c807a (127.22.93.194:36209): Network error: Client connection negotiation failed: client connection to 127.22.93.194:36209: connect: Connection refused (error 111)
I20260709 12:20:42.369128 24781 leader_election.cc:304] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c090031f610346ed82285cd847bca6d6; no voters: 5d0f174a97494d0cbf08ae81ec4c807a, fa8cfbff90bf4881a56772b05008aadb
I20260709 12:20:42.369311 22903 tablet_replica.cc:333] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.370450 22903 raft_consensus.cc:2243] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.370488 30996 raft_consensus.cc:2749] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:20:42.372344 22903 raft_consensus.cc:2272] T c29a1bdc82674a4ab1ad6c3b54c69e25 P c090031f610346ed82285cd847bca6d6 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.375795 22903 tablet_replica.cc:333] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.376791 22903 raft_consensus.cc:2243] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.377584 22903 raft_consensus.cc:2272] T b5f8a25e7c97459c955d7ca7accd826d P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.382552 22903 tablet_replica.cc:333] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.383765 22903 raft_consensus.cc:2243] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.385365 22903 raft_consensus.cc:2272] T f9a75b1a807b49b791d2de5abd8f8ca1 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.388623 22903 tablet_replica.cc:333] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.389706 22903 raft_consensus.cc:2243] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.391199 22903 raft_consensus.cc:2272] T 2391737d1a8643bd885a4db57ceba96c P c090031f610346ed82285cd847bca6d6 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.394553 22903 tablet_replica.cc:333] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.395530 22903 raft_consensus.cc:2243] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.396472 22903 raft_consensus.cc:2272] T 7c552e5996384fef9c032a7fda531298 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.400108 22903 tablet_replica.cc:333] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.401068 22903 raft_consensus.cc:2243] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.402299 22903 raft_consensus.cc:2272] T 51d85bfbe5fb4a4ba1caf713a20ce874 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.405561 22903 tablet_replica.cc:333] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.406469 22903 raft_consensus.cc:2243] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.407368 22903 raft_consensus.cc:2272] T e37f672475a541c4b15e807dbe8bcd7d P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.411039 22903 tablet_replica.cc:333] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.411845 22903 raft_consensus.cc:2243] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.412580 22903 raft_consensus.cc:2272] T d84a44368371490a8287d9cb8d1620d0 P c090031f610346ed82285cd847bca6d6 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.415629 22903 tablet_replica.cc:333] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.416427 22903 raft_consensus.cc:2243] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.418279 22903 raft_consensus.cc:2272] T 1388d59244114d37a482e6205f04c237 P c090031f610346ed82285cd847bca6d6 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.421883 22903 tablet_replica.cc:333] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.422722 22903 raft_consensus.cc:2243] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.423431 22903 raft_consensus.cc:2272] T c617be9ee61e4bb583e2fecf7f8cd9b2 P c090031f610346ed82285cd847bca6d6 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.429296 22903 tablet_replica.cc:333] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.430166 22903 raft_consensus.cc:2243] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.431016 22903 raft_consensus.cc:2272] T 6f5cb153ce4e4ac387672e2345a08fa5 P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.434283 22903 tablet_replica.cc:333] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.435103 22903 raft_consensus.cc:2243] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.435700 22903 raft_consensus.cc:2272] T 2152258f0d654836a042cc0cf00d66a3 P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:42.436559 24779 consensus_peers.cc:597] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 -> Peer 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): Couldn't send request to peer 729aa4b1ccec48b588c14e67652c61e1. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:20:42.438771 22903 tablet_replica.cc:333] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.439705 22903 raft_consensus.cc:2243] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.441272 22903 raft_consensus.cc:2272] T f4b7521a95604ae58fb9e26c98b5e4a6 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.445070 22903 tablet_replica.cc:333] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.445829 22903 raft_consensus.cc:2243] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.447141 22903 raft_consensus.cc:2272] T 680463fca31f47d494316f240f1df66a P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.449947 22903 tablet_replica.cc:333] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.450752 22903 raft_consensus.cc:2243] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.452096 22903 raft_consensus.cc:2272] T 010e8fce74be491b8432c9ea63b75515 P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.455241 22903 tablet_replica.cc:333] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.456108 22903 raft_consensus.cc:2243] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.456775 22903 raft_consensus.cc:2272] T b29f161fe0e24b51ad5c1903bdc5112c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.460256 22903 tablet_replica.cc:333] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.461102 22903 raft_consensus.cc:2243] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.461719 22903 raft_consensus.cc:2272] T ee66a7413b024d4b8e542242a567c0cf P c090031f610346ed82285cd847bca6d6 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.464836 22903 tablet_replica.cc:333] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.465641 22903 raft_consensus.cc:2243] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.466660 22903 raft_consensus.cc:2272] T f1c672629a7b441f9e55890cd643e03a P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.470412 22903 tablet_replica.cc:333] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.471236 22903 raft_consensus.cc:2243] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.472679 22903 raft_consensus.cc:2272] T 07fcc70b8c0d43ae8334ea802c9a9924 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.476125 22903 tablet_replica.cc:333] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.476979 22903 raft_consensus.cc:2243] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.477686 22903 raft_consensus.cc:2272] T 683c964dc5814af698a7b4af6649e9ed P c090031f610346ed82285cd847bca6d6 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.480826 22903 tablet_replica.cc:333] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.481626 22903 raft_consensus.cc:2243] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.482240 22903 raft_consensus.cc:2272] T e33dc2dd26074c7d8437ce5a91c0f8bf P c090031f610346ed82285cd847bca6d6 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.485626 22903 tablet_replica.cc:333] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.486512 22903 raft_consensus.cc:2243] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.487622 22903 raft_consensus.cc:2272] T 66b5cb14ed8f4b58a27e168bcac560d2 P c090031f610346ed82285cd847bca6d6 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.491499 22903 tablet_replica.cc:333] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.492383 22903 raft_consensus.cc:2243] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.493412 22903 raft_consensus.cc:2272] T 73fc2a59a00e4ea6a3b63c28c6f58512 P c090031f610346ed82285cd847bca6d6 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.497515 22903 tablet_replica.cc:333] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.498306 22903 raft_consensus.cc:2243] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:20:42.499852 22903 raft_consensus.cc:2272] T c07ef51fde0145f3ab7d32fa63626a55 P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.502839 22903 tablet_replica.cc:333] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.503551 22903 raft_consensus.cc:2243] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.504204 22903 raft_consensus.cc:2272] T 4b5c00e5364f4911a535f428ee9a0f9c P c090031f610346ed82285cd847bca6d6 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.506844 22903 tablet_replica.cc:333] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6: stopping tablet replica
I20260709 12:20:42.507529 22903 raft_consensus.cc:2243] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:42.508669 22903 raft_consensus.cc:2272] T 4e320f288fdb4be0ada8bfff79b41a9a P c090031f610346ed82285cd847bca6d6 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:42.882938 22903 tablet_server.cc:196] TabletServer@127.22.93.196:0 shutdown complete.
I20260709 12:20:42.982146 22903 master.cc:562] Master@127.22.93.254:36285 shutting down...
W20260709 12:20:43.026878 24047 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:20:43.027251 24047 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:20:43.027509 24047 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:20:45.257828 23984 catalog_manager.cc:4755] TS 729aa4b1ccec48b588c14e67652c61e1 (127.22.93.193:44043): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 9e016416bdc742068f5568ff2bebabd1: Network error: Client connection negotiation failed: client connection to 127.22.93.193:44043: connect: Connection refused (error 111)
I20260709 12:20:45.341813 22903 raft_consensus.cc:2243] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:45.344863 22903 raft_consensus.cc:2272] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:45.345348 22903 tablet_replica.cc:333] T 00000000000000000000000000000000 P aa1cad1355eb4ec68d9dd23f0c34795d: stopping tablet replica
I20260709 12:20:45.523429 22903 master.cc:584] Master@127.22.93.254:36285 shutdown complete.
I20260709 12:20:45.573550 22903 test_util.cc:182] -----------------------------------------------
I20260709 12:20:45.573868 22903 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599348838328-22903-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (233211 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:20:45.577675 22903 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.93.254:46353
I20260709 12:20:45.579061 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:45.585724 31001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:45.585793 31002 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:45.586313 31004 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:45.587910 22903 server_base.cc:1061] running on GCE node
I20260709 12:20:45.592693 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:45.592893 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:45.593112 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599645593077 us; error 0 us; skew 500 ppm
I20260709 12:20:45.593802 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:45.596526 22903 webserver.cc:533] Webserver started at http://127.22.93.254:34511/ using document root <none> and password file <none>
I20260709 12:20:45.597074 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:45.597286 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:45.597600 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:45.599138 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/master-0-root/instance:
uuid: "da7e2688278847a08231f56f537581ee"
format_stamp: "Formatted at 2026-07-09 12:20:45 on dist-test-slave-k289"
I20260709 12:20:45.604005 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 12:20:45.607710 31009 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:45.608520 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:20:45.608817 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/master-0-root
uuid: "da7e2688278847a08231f56f537581ee"
format_stamp: "Formatted at 2026-07-09 12:20:45 on dist-test-slave-k289"
I20260709 12:20:45.609148 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:45.620002 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:45.621268 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:45.667136 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.254:46353
I20260709 12:20:45.667335 31060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.254:46353 every 8 connection(s)
I20260709 12:20:45.672189 31061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:45.685252 31061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee: Bootstrap starting.
I20260709 12:20:45.691601 31061 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:45.696720 31061 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee: No bootstrap required, opened a new log
I20260709 12:20:45.699493 31061 raft_consensus.cc:359] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7e2688278847a08231f56f537581ee" member_type: VOTER }
I20260709 12:20:45.699981 31061 raft_consensus.cc:385] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:45.700243 31061 raft_consensus.cc:740] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da7e2688278847a08231f56f537581ee, State: Initialized, Role: FOLLOWER
I20260709 12:20:45.700871 31061 consensus_queue.cc:260] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7e2688278847a08231f56f537581ee" member_type: VOTER }
I20260709 12:20:45.701412 31061 raft_consensus.cc:399] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:20:45.701628 31061 raft_consensus.cc:493] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:20:45.701954 31061 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:45.708240 31061 raft_consensus.cc:515] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7e2688278847a08231f56f537581ee" member_type: VOTER }
I20260709 12:20:45.708854 31061 leader_election.cc:304] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da7e2688278847a08231f56f537581ee; no voters: 
I20260709 12:20:45.710204 31061 leader_election.cc:290] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:20:45.710661 31064 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:45.712549 31064 raft_consensus.cc:697] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 1 LEADER]: Becoming Leader. State: Replica: da7e2688278847a08231f56f537581ee, State: Running, Role: LEADER
I20260709 12:20:45.713346 31064 consensus_queue.cc:237] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7e2688278847a08231f56f537581ee" member_type: VOTER }
I20260709 12:20:45.713908 31061 sys_catalog.cc:565] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:20:45.719420 31066 sys_catalog.cc:455] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader da7e2688278847a08231f56f537581ee. Latest consensus state: current_term: 1 leader_uuid: "da7e2688278847a08231f56f537581ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7e2688278847a08231f56f537581ee" member_type: VOTER } }
I20260709 12:20:45.720021 31066 sys_catalog.cc:458] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:45.721812 31065 sys_catalog.cc:455] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da7e2688278847a08231f56f537581ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7e2688278847a08231f56f537581ee" member_type: VOTER } }
I20260709 12:20:45.722590 31065 sys_catalog.cc:458] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [sys.catalog]: This master's current role is: LEADER
I20260709 12:20:45.728294 31072 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:20:45.734349 31072 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:20:45.735692 22903 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:20:45.745687 31072 catalog_manager.cc:1383] Generated new cluster ID: 4ae262c1545f4b24a81cd9ff52f94c5d
I20260709 12:20:45.746059 31072 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:20:45.771095 31072 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:20:45.772634 31072 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:20:45.788476 31072 catalog_manager.cc:6070] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee: Generated new TSK 0
I20260709 12:20:45.789162 31072 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:20:45.802855 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:45.809816 31082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:45.811575 31083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:45.814113 31085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:45.815430 22903 server_base.cc:1061] running on GCE node
I20260709 12:20:45.820389 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:45.820727 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:45.820948 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599645820926 us; error 0 us; skew 500 ppm
I20260709 12:20:45.821794 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:45.829409 22903 webserver.cc:533] Webserver started at http://127.22.93.193:44567/ using document root <none> and password file <none>
I20260709 12:20:45.830180 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:45.830452 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:45.830893 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:45.832726 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/instance:
uuid: "e3b87862f0eb448db7779e995eb84f64"
format_stamp: "Formatted at 2026-07-09 12:20:45 on dist-test-slave-k289"
I20260709 12:20:45.837910 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:20:45.841693 31090 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:45.842494 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:20:45.842830 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "e3b87862f0eb448db7779e995eb84f64"
format_stamp: "Formatted at 2026-07-09 12:20:45 on dist-test-slave-k289"
I20260709 12:20:45.843181 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:45.870721 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:45.872308 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:45.874121 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:45.876891 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:45.877085 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:45.877400 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:45.877584 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:45.929029 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:36023
I20260709 12:20:45.929189 31153 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:36023 every 8 connection(s)
I20260709 12:20:45.935274 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:45.945066 31158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:45.947808 31159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:45.951916 22903 server_base.cc:1061] running on GCE node
W20260709 12:20:45.952400 31161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:45.955302 31154 heartbeater.cc:344] Connected to a master server at 127.22.93.254:46353
I20260709 12:20:45.955890 31154 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:45.956709 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:45.957041 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:45.956992 31154 heartbeater.cc:507] Master 127.22.93.254:46353 requested a full tablet report, sending...
I20260709 12:20:45.957455 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599645957432 us; error 0 us; skew 500 ppm
I20260709 12:20:45.958362 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:45.960177 31026 ts_manager.cc:194] Registered new tserver with Master: e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:45.961485 22903 webserver.cc:533] Webserver started at http://127.22.93.194:42207/ using document root <none> and password file <none>
I20260709 12:20:45.962117 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:45.962337 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:45.962631 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:45.962647 31026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33566
I20260709 12:20:45.964468 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/instance:
uuid: "1d5ebd798965493785b198d6e8492c23"
format_stamp: "Formatted at 2026-07-09 12:20:45 on dist-test-slave-k289"
I20260709 12:20:45.969907 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:20:45.974154 31166 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:45.975116 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:20:45.975528 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-1-root
uuid: "1d5ebd798965493785b198d6e8492c23"
format_stamp: "Formatted at 2026-07-09 12:20:45 on dist-test-slave-k289"
I20260709 12:20:45.975863 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:45.994822 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:45.996479 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:45.998325 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:46.001051 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:46.001300 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.001564 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:46.001744 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.056303 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.194:42481
I20260709 12:20:46.056435 31229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.194:42481 every 8 connection(s)
I20260709 12:20:46.062395 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.072134 31233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.072940 31234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.075927 31230 heartbeater.cc:344] Connected to a master server at 127.22.93.254:46353
I20260709 12:20:46.076517 31230 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:46.077766 31230 heartbeater.cc:507] Master 127.22.93.254:46353 requested a full tablet report, sending...
I20260709 12:20:46.078799 22903 server_base.cc:1061] running on GCE node
W20260709 12:20:46.079866 31236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.080691 31026 ts_manager.cc:194] Registered new tserver with Master: 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:46.081228 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:46.081522 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.081707 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599646081691 us; error 0 us; skew 500 ppm
I20260709 12:20:46.082402 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.082484 31026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33570
I20260709 12:20:46.085757 22903 webserver.cc:533] Webserver started at http://127.22.93.195:37067/ using document root <none> and password file <none>
I20260709 12:20:46.086375 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.086611 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.086902 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.088279 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/instance:
uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-k289"
I20260709 12:20:46.093457 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:20:46.097259 31241 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.098351 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:20:46.098662 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-2-root
uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-k289"
I20260709 12:20:46.098955 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.119203 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.120759 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.122274 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:46.125159 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:46.125440 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.125821 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:46.126024 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.177111 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.195:37949
I20260709 12:20:46.177215 31303 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.195:37949 every 8 connection(s)
I20260709 12:20:46.183228 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:46.192309 31307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.194922 31308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:46.196962 31310 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:46.197544 22903 server_base.cc:1061] running on GCE node
I20260709 12:20:46.199055 31304 heartbeater.cc:344] Connected to a master server at 127.22.93.254:46353
I20260709 12:20:46.199234 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:20:46.199542 31304 heartbeater.cc:461] Registering TS with master...
W20260709 12:20:46.199595 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:46.199959 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599646199939 us; error 0 us; skew 500 ppm
I20260709 12:20:46.200606 31304 heartbeater.cc:507] Master 127.22.93.254:46353 requested a full tablet report, sending...
I20260709 12:20:46.200749 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:46.203549 31026 ts_manager.cc:194] Registered new tserver with Master: ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:46.204319 22903 webserver.cc:533] Webserver started at http://127.22.93.196:39845/ using document root <none> and password file <none>
I20260709 12:20:46.205060 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:46.205330 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:20:46.205672 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:20:46.205781 31026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33580
I20260709 12:20:46.207348 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-3-root/instance:
uuid: "9800423c0012421d9ce299e8c180ac96"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-k289"
I20260709 12:20:46.212340 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:20:46.216349 31315 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.217208 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:20:46.217538 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-3-root
uuid: "9800423c0012421d9ce299e8c180ac96"
format_stamp: "Formatted at 2026-07-09 12:20:46 on dist-test-slave-k289"
I20260709 12:20:46.217844 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:46.252480 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:46.254160 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:46.255980 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:46.258394 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:20:46.258625 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:46.258920 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:20:46.259121 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:20:46.310132 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.196:36383
I20260709 12:20:46.310246 31378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.196:36383 every 8 connection(s)
I20260709 12:20:46.326865 31379 heartbeater.cc:344] Connected to a master server at 127.22.93.254:46353
I20260709 12:20:46.327502 31379 heartbeater.cc:461] Registering TS with master...
I20260709 12:20:46.328498 31379 heartbeater.cc:507] Master 127.22.93.254:46353 requested a full tablet report, sending...
I20260709 12:20:46.330798 31026 ts_manager.cc:194] Registered new tserver with Master: 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:46.331331 22903 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.017531797s
I20260709 12:20:46.332942 31026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33592
I20260709 12:20:46.362879 31026 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33608:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:20:46.627736 31194 tablet_service.cc:1511] Processing CreateTablet for tablet 57753c60b8424c90bfc222514285d338 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:46.629552 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 57753c60b8424c90bfc222514285d338 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:46.631431 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57753c60b8424c90bfc222514285d338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.629603 31194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57753c60b8424c90bfc222514285d338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.630951 31193 tablet_service.cc:1511] Processing CreateTablet for tablet 5b428d9f5e1c4775a6d6ccca23e9f2fa (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:46.633675 31193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b428d9f5e1c4775a6d6ccca23e9f2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.638698 31268 tablet_service.cc:1511] Processing CreateTablet for tablet ac4ef802a3d14adfb4774a8841d34164 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:46.639901 31343 tablet_service.cc:1511] Processing CreateTablet for tablet 5b428d9f5e1c4775a6d6ccca23e9f2fa (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:46.640545 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4ef802a3d14adfb4774a8841d34164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.641603 31343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b428d9f5e1c4775a6d6ccca23e9f2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.645797 31342 tablet_service.cc:1511] Processing CreateTablet for tablet ac4ef802a3d14adfb4774a8841d34164 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:46.647855 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4ef802a3d14adfb4774a8841d34164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.657586 31341 tablet_service.cc:1511] Processing CreateTablet for tablet 302d0756616a44fbad812870fbd6d499 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:46.659535 31341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302d0756616a44fbad812870fbd6d499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.668126 31192 tablet_service.cc:1511] Processing CreateTablet for tablet 302d0756616a44fbad812870fbd6d499 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:46.669952 31192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302d0756616a44fbad812870fbd6d499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.673520 31340 tablet_service.cc:1511] Processing CreateTablet for tablet 25d1fa74ba5e44c194b27640def09ef5 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:46.675320 31340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d1fa74ba5e44c194b27640def09ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.684559 31267 tablet_service.cc:1511] Processing CreateTablet for tablet 302d0756616a44fbad812870fbd6d499 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:20:46.688283 31266 tablet_service.cc:1511] Processing CreateTablet for tablet 97f09b8867a34e32aaa4ae2f232e4fd2 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:46.690047 31266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f09b8867a34e32aaa4ae2f232e4fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.691231 31262 tablet_service.cc:1511] Processing CreateTablet for tablet 0da571cacd7e4c87b7615361589e46db (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:46.692370 31264 tablet_service.cc:1511] Processing CreateTablet for tablet 13d247b7758c49c08c20a65227f42b52 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:46.692942 31262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da571cacd7e4c87b7615361589e46db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.693908 31264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d247b7758c49c08c20a65227f42b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.696492 31263 tablet_service.cc:1511] Processing CreateTablet for tablet 7188da143a8e4c5fb12f21ff47aa63ea (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:46.697516 31261 tablet_service.cc:1511] Processing CreateTablet for tablet 9f29500f45e14bf3b37916af7a3f4982 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:46.698199 31263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7188da143a8e4c5fb12f21ff47aa63ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.699090 31261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f29500f45e14bf3b37916af7a3f4982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.701654 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 4314d275b47a469bafd749deec419c28 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:46.704922 31189 tablet_service.cc:1511] Processing CreateTablet for tablet 13d247b7758c49c08c20a65227f42b52 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:46.706630 31189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d247b7758c49c08c20a65227f42b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.708240 31339 tablet_service.cc:1511] Processing CreateTablet for tablet 4314d275b47a469bafd749deec419c28 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:46.709803 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4314d275b47a469bafd749deec419c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.709507 31190 tablet_service.cc:1511] Processing CreateTablet for tablet 25d1fa74ba5e44c194b27640def09ef5 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:46.712158 31191 tablet_service.cc:1511] Processing CreateTablet for tablet 97f09b8867a34e32aaa4ae2f232e4fd2 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:46.713938 31337 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8ec802808248f1bb901b81b304d5ef (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:46.706234 31187 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8ec802808248f1bb901b81b304d5ef (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:46.718247 31337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8ec802808248f1bb901b81b304d5ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.719451 31336 tablet_service.cc:1511] Processing CreateTablet for tablet 0da571cacd7e4c87b7615361589e46db (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:46.721017 31336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da571cacd7e4c87b7615361589e46db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.723289 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4314d275b47a469bafd749deec419c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.723915 31260 tablet_service.cc:1511] Processing CreateTablet for tablet f018fab4f8f24dc18b24bf29b839f828 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:46.726289 31260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f018fab4f8f24dc18b24bf29b839f828. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:46.730166 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:46.733384 31335 tablet_service.cc:1511] Processing CreateTablet for tablet 9f29500f45e14bf3b37916af7a3f4982 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:46.734726 31334 tablet_service.cc:1511] Processing CreateTablet for tablet c8ec895126a540df9c9474a9dd420991 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:46.708288 31188 tablet_service.cc:1511] Processing CreateTablet for tablet 7188da143a8e4c5fb12f21ff47aa63ea (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:46.712203 31338 tablet_service.cc:1511] Processing CreateTablet for tablet 13d247b7758c49c08c20a65227f42b52 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:20:46.708281 31186 tablet_service.cc:1511] Processing CreateTablet for tablet 9f29500f45e14bf3b37916af7a3f4982 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:20:46.741876 31185 tablet_service.cc:1511] Processing CreateTablet for tablet f018fab4f8f24dc18b24bf29b839f828 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:46.746088 31267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 302d0756616a44fbad812870fbd6d499. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.751941 31335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f29500f45e14bf3b37916af7a3f4982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.752945 31334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ec895126a540df9c9474a9dd420991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.755355 31338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d247b7758c49c08c20a65227f42b52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.761283 31188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7188da143a8e4c5fb12f21ff47aa63ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.764883 31186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f29500f45e14bf3b37916af7a3f4982. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.767392 31191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f09b8867a34e32aaa4ae2f232e4fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.775482 31187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8ec802808248f1bb901b81b304d5ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.779446 31190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d1fa74ba5e44c194b27640def09ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.783442 31185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f018fab4f8f24dc18b24bf29b839f828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.805775 31119 tablet_service.cc:1511] Processing CreateTablet for tablet 57753c60b8424c90bfc222514285d338 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:20:46.809373 31118 tablet_service.cc:1511] Processing CreateTablet for tablet 5b428d9f5e1c4775a6d6ccca23e9f2fa (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:20:46.811728 31119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57753c60b8424c90bfc222514285d338. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.814021 31118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b428d9f5e1c4775a6d6ccca23e9f2fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.816481 31117 tablet_service.cc:1511] Processing CreateTablet for tablet ac4ef802a3d14adfb4774a8841d34164 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:20:46.818034 31117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ac4ef802a3d14adfb4774a8841d34164. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.828356 31115 tablet_service.cc:1511] Processing CreateTablet for tablet 97f09b8867a34e32aaa4ae2f232e4fd2 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:20:46.830008 31115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f09b8867a34e32aaa4ae2f232e4fd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.832926 31114 tablet_service.cc:1511] Processing CreateTablet for tablet 25d1fa74ba5e44c194b27640def09ef5 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:20:46.836381 31113 tablet_service.cc:1511] Processing CreateTablet for tablet 4314d275b47a469bafd749deec419c28 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:20:46.839246 31112 tablet_service.cc:1511] Processing CreateTablet for tablet 7188da143a8e4c5fb12f21ff47aa63ea (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:20:46.842108 31111 tablet_service.cc:1511] Processing CreateTablet for tablet 4b8ec802808248f1bb901b81b304d5ef (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:20:46.844727 31110 tablet_service.cc:1511] Processing CreateTablet for tablet 0da571cacd7e4c87b7615361589e46db (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:20:46.846895 31109 tablet_service.cc:1511] Processing CreateTablet for tablet f018fab4f8f24dc18b24bf29b839f828 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:20:46.851856 31114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 25d1fa74ba5e44c194b27640def09ef5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.782500 31192 tablet_service.cc:1511] Processing CreateTablet for tablet c8ec895126a540df9c9474a9dd420991 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:46.862740 31194 tablet_service.cc:1511] Processing CreateTablet for tablet 437143ed6af647b0b4b7a3f240e11346 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:46.864162 31192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ec895126a540df9c9474a9dd420991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.864984 31194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437143ed6af647b0b4b7a3f240e11346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.865485 31113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4314d275b47a469bafd749deec419c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.866290 31112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7188da143a8e4c5fb12f21ff47aa63ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.866973 31110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0da571cacd7e4c87b7615361589e46db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.867743 31109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f018fab4f8f24dc18b24bf29b839f828. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.871646 31111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8ec802808248f1bb901b81b304d5ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.886162 31194 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8eed6a3bca469facb370f6293185b7 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:46.887779 31194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8eed6a3bca469facb370f6293185b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.897601 31262 tablet_service.cc:1511] Processing CreateTablet for tablet fab0948c0d0a4bf4a2d9a762fa77f379 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:46.919718 31262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab0948c0d0a4bf4a2d9a762fa77f379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.949810 31266 tablet_service.cc:1511] Processing CreateTablet for tablet 437143ed6af647b0b4b7a3f240e11346 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:46.953727 31266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437143ed6af647b0b4b7a3f240e11346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:46.966085 31154 heartbeater.cc:499] Master 127.22.93.254:46353 was elected leader, sending a full tablet report...
I20260709 12:20:46.966969 31194 tablet_service.cc:1511] Processing CreateTablet for tablet 4c71bd7869d948b4bc36991abb4b71a5 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:46.978344 31340 tablet_service.cc:1511] Processing CreateTablet for tablet 437143ed6af647b0b4b7a3f240e11346 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:20:47.001220 31399 tablet_bootstrap.cc:492] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:47.005347 31400 tablet_bootstrap.cc:492] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:47.015170 31401 tablet_bootstrap.cc:492] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:47.017750 31340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 437143ed6af647b0b4b7a3f240e11346. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.026662 31341 tablet_service.cc:1511] Processing CreateTablet for tablet fab0948c0d0a4bf4a2d9a762fa77f379 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:47.035746 31341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab0948c0d0a4bf4a2d9a762fa77f379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.031477 31338 tablet_service.cc:1511] Processing CreateTablet for tablet 964ad8a458c2403a9dbdd50be2fd763d (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:47.042346 31338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964ad8a458c2403a9dbdd50be2fd763d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.042316 31268 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8eed6a3bca469facb370f6293185b7 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:47.043210 31190 tablet_service.cc:1511] Processing CreateTablet for tablet 702d6fce6e6745b4952d035e0ceccd49 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:47.043987 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8eed6a3bca469facb370f6293185b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.052124 31194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c71bd7869d948b4bc36991abb4b71a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.041293 31335 tablet_service.cc:1511] Processing CreateTablet for tablet 4c71bd7869d948b4bc36991abb4b71a5 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:47.055272 31335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c71bd7869d948b4bc36991abb4b71a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.065302 31263 tablet_service.cc:1511] Processing CreateTablet for tablet 964ad8a458c2403a9dbdd50be2fd763d (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:47.067960 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 702d6fce6e6745b4952d035e0ceccd49 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:47.075737 31264 tablet_service.cc:1511] Processing CreateTablet for tablet 89f5e32511d244df9299237b280d2405 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:47.080585 31189 tablet_service.cc:1511] Processing CreateTablet for tablet 89f5e32511d244df9299237b280d2405 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:47.066872 31263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964ad8a458c2403a9dbdd50be2fd763d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.099718 31187 tablet_service.cc:1511] Processing CreateTablet for tablet 77cb701e3ab34e60b09c279e2bcfe26a (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:47.101835 31230 heartbeater.cc:499] Master 127.22.93.254:46353 was elected leader, sending a full tablet report...
I20260709 12:20:47.115744 31189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f5e32511d244df9299237b280d2405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.121134 31190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702d6fce6e6745b4952d035e0ceccd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.107925 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702d6fce6e6745b4952d035e0ceccd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.135221 31399 tablet_bootstrap.cc:654] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.145138 31187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cb701e3ab34e60b09c279e2bcfe26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.150122 31264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f5e32511d244df9299237b280d2405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.161813 31113 tablet_service.cc:1511] Processing CreateTablet for tablet fab0948c0d0a4bf4a2d9a762fa77f379 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:20:47.163823 31113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab0948c0d0a4bf4a2d9a762fa77f379. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.165062 31336 tablet_service.cc:1511] Processing CreateTablet for tablet ef66344d4a1a4900832a1486db956576 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:47.166172 31401 tablet_bootstrap.cc:654] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.166755 31336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66344d4a1a4900832a1486db956576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.132903 31118 tablet_service.cc:1511] Processing CreateTablet for tablet c8ec895126a540df9c9474a9dd420991 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:20:47.173450 31118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8ec895126a540df9c9474a9dd420991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.168018 31112 tablet_service.cc:1511] Processing CreateTablet for tablet 3d8eed6a3bca469facb370f6293185b7 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:20:47.175902 31112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d8eed6a3bca469facb370f6293185b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.175542 31343 tablet_service.cc:1511] Processing CreateTablet for tablet 41c876d87436493a8aaeb3be151cbf9e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:47.177048 31343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c876d87436493a8aaeb3be151cbf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.168488 31267 tablet_service.cc:1511] Processing CreateTablet for tablet ead9af52f3cb440a823ab640a53caa2d (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:47.178643 31267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead9af52f3cb440a823ab640a53caa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.180222 31115 tablet_service.cc:1511] Processing CreateTablet for tablet 4c71bd7869d948b4bc36991abb4b71a5 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:20:47.170358 31260 tablet_service.cc:1511] Processing CreateTablet for tablet 41c876d87436493a8aaeb3be151cbf9e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:47.236122 31260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c876d87436493a8aaeb3be151cbf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.170024 31342 tablet_service.cc:1511] Processing CreateTablet for tablet ead9af52f3cb440a823ab640a53caa2d (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:47.239997 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead9af52f3cb440a823ab640a53caa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.236122 31115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c71bd7869d948b4bc36991abb4b71a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.244920 31192 tablet_service.cc:1511] Processing CreateTablet for tablet ead9af52f3cb440a823ab640a53caa2d (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:20:47.246498 31192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ead9af52f3cb440a823ab640a53caa2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.181092 31400 tablet_bootstrap.cc:654] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.181867 31402 tablet_bootstrap.cc:492] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:47.182651 31339 tablet_service.cc:1511] Processing CreateTablet for tablet 702d6fce6e6745b4952d035e0ceccd49 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:20:47.252030 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 702d6fce6e6745b4952d035e0ceccd49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.194077 31265 tablet_service.cc:1511] Processing CreateTablet for tablet d56e60fa30c74545837b808553cb3e3c (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:47.208927 31304 heartbeater.cc:499] Master 127.22.93.254:46353 was elected leader, sending a full tablet report...
I20260709 12:20:47.259310 31110 tablet_service.cc:1511] Processing CreateTablet for tablet 89f5e32511d244df9299237b280d2405 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:20:47.259974 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56e60fa30c74545837b808553cb3e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.273644 31185 tablet_service.cc:1511] Processing CreateTablet for tablet ef66344d4a1a4900832a1486db956576 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:47.208532 31111 tablet_service.cc:1511] Processing CreateTablet for tablet 964ad8a458c2403a9dbdd50be2fd763d (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:20:47.224797 31337 tablet_service.cc:1511] Processing CreateTablet for tablet 77cb701e3ab34e60b09c279e2bcfe26a (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
W20260709 12:20:47.227469 31011 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 78143.3us
W20260709 12:20:47.229262 31012 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.93.196:36383, user_credentials={real_user=slave}} blocked reactor thread for 72808.1us
I20260709 12:20:47.260856 31110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89f5e32511d244df9299237b280d2405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.266124 31402 tablet_bootstrap.cc:654] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.223672 31261 tablet_service.cc:1511] Processing CreateTablet for tablet a4622853e390489ebd01e9f3ace8f0fc (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:47.292336 31263 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0f6d602e394c848d29df14804fa855 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:47.293932 31263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0f6d602e394c848d29df14804fa855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.296823 31262 tablet_service.cc:1511] Processing CreateTablet for tablet 89a400868ea34d6287dd1306d2c7456c (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:47.298280 31262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a400868ea34d6287dd1306d2c7456c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.301548 31117 tablet_service.cc:1511] Processing CreateTablet for tablet 77cb701e3ab34e60b09c279e2bcfe26a (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:20:47.305684 31342 tablet_service.cc:1511] Processing CreateTablet for tablet a4622853e390489ebd01e9f3ace8f0fc (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:47.307462 31337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cb701e3ab34e60b09c279e2bcfe26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.310084 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4622853e390489ebd01e9f3ace8f0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.317869 31186 tablet_service.cc:1511] Processing CreateTablet for tablet d56e60fa30c74545837b808553cb3e3c (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:47.323989 31261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4622853e390489ebd01e9f3ace8f0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.302582 31109 tablet_service.cc:1511] Processing CreateTablet for tablet a4622853e390489ebd01e9f3ace8f0fc (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:20:47.360877 31111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 964ad8a458c2403a9dbdd50be2fd763d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.356184 31185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66344d4a1a4900832a1486db956576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.371434 31191 tablet_service.cc:1511] Processing CreateTablet for tablet 89a400868ea34d6287dd1306d2c7456c (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:47.377771 31112 tablet_service.cc:1511] Processing CreateTablet for tablet d56e60fa30c74545837b808553cb3e3c (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:20:47.356312 31379 heartbeater.cc:499] Master 127.22.93.254:46353 was elected leader, sending a full tablet report...
I20260709 12:20:47.365334 31119 tablet_service.cc:1511] Processing CreateTablet for tablet 41c876d87436493a8aaeb3be151cbf9e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:20:47.389657 31114 tablet_service.cc:1511] Processing CreateTablet for tablet ef66344d4a1a4900832a1486db956576 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:20:47.391353 31186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56e60fa30c74545837b808553cb3e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.397814 31191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a400868ea34d6287dd1306d2c7456c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.386683 31338 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddcff546cb345c98b79aff0049e96f1 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:47.404250 31338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddcff546cb345c98b79aff0049e96f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.363555 31188 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0f6d602e394c848d29df14804fa855 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:47.416059 31334 tablet_service.cc:1511] Processing CreateTablet for tablet 8d0f6d602e394c848d29df14804fa855 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:20:47.437405 31266 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2005abeeca4984960b64be4b5d532e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:47.438687 31399 tablet_bootstrap.cc:492] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:47.439407 31188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0f6d602e394c848d29df14804fa855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.439438 31399 ts_tablet_manager.cc:1403] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.449s	user 0.045s	sys 0.028s
I20260709 12:20:47.443077 31266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2005abeeca4984960b64be4b5d532e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.395242 31117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77cb701e3ab34e60b09c279e2bcfe26a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.445221 31399 raft_consensus.cc:359] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:47.451089 31401 tablet_bootstrap.cc:492] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:47.451752 31401 ts_tablet_manager.cc:1403] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.437s	user 0.017s	sys 0.015s
I20260709 12:20:47.450773 31399 raft_consensus.cc:385] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.455180 31399 raft_consensus.cc:740] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.463235 31263 tablet_service.cc:1511] Processing CreateTablet for tablet 76f9f2ccc422431581e845d7df278107 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:47.438647 31400 tablet_bootstrap.cc:492] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:47.447382 31114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef66344d4a1a4900832a1486db956576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.464954 31263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f9f2ccc422431581e845d7df278107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.466329 31341 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2005abeeca4984960b64be4b5d532e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:47.468022 31112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d56e60fa30c74545837b808553cb3e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.471349 31109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4622853e390489ebd01e9f3ace8f0fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.472744 31335 tablet_service.cc:1511] Processing CreateTablet for tablet 1c590f5280eb4ea99fbfbe28c2630d55 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:47.474164 31400 ts_tablet_manager.cc:1403] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.469s	user 0.026s	sys 0.028s
I20260709 12:20:47.448287 31113 tablet_service.cc:1511] Processing CreateTablet for tablet 89a400868ea34d6287dd1306d2c7456c (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:20:47.459403 31193 tablet_service.cc:1511] Processing CreateTablet for tablet 2c051d29b0624a46be22221fba1d500e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:47.462713 31264 tablet_service.cc:1511] Processing CreateTablet for tablet 2c051d29b0624a46be22221fba1d500e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:47.478224 31264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c051d29b0624a46be22221fba1d500e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.478055 31190 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8a7095a2544957b3d93c160aebdad6 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:47.463523 31267 tablet_service.cc:1511] Processing CreateTablet for tablet b70e3a964ca446edb98d1ad6c8984716 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:47.480305 31119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41c876d87436493a8aaeb3be151cbf9e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.480768 31267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70e3a964ca446edb98d1ad6c8984716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.480641 31115 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddcff546cb345c98b79aff0049e96f1 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:47.482254 31115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddcff546cb345c98b79aff0049e96f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.464006 31334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8d0f6d602e394c848d29df14804fa855. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.488647 31341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2005abeeca4984960b64be4b5d532e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.500666 31335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c590f5280eb4ea99fbfbe28c2630d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.504024 31401 raft_consensus.cc:359] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:47.442095 31189 tablet_service.cc:1511] Processing CreateTablet for tablet 7ddcff546cb345c98b79aff0049e96f1 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:20:47.504230 31260 tablet_service.cc:1511] Processing CreateTablet for tablet 1c590f5280eb4ea99fbfbe28c2630d55 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:47.507261 31260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c590f5280eb4ea99fbfbe28c2630d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.479699 31190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8a7095a2544957b3d93c160aebdad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.515400 31193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c051d29b0624a46be22221fba1d500e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.519387 31189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ddcff546cb345c98b79aff0049e96f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.505950 31401 raft_consensus.cc:385] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.524516 31118 tablet_service.cc:1511] Processing CreateTablet for tablet 8a2005abeeca4984960b64be4b5d532e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:20:47.525269 31401 raft_consensus.cc:740] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.526432 31401 consensus_queue.cc:260] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:47.461189 31194 tablet_service.cc:1511] Processing CreateTablet for tablet 1c590f5280eb4ea99fbfbe28c2630d55 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:20:47.529807 31194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c590f5280eb4ea99fbfbe28c2630d55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.526255 31113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 89a400868ea34d6287dd1306d2c7456c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.528126 31399 consensus_queue.cc:260] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:47.533166 31336 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8a7095a2544957b3d93c160aebdad6 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:47.549544 31336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8a7095a2544957b3d93c160aebdad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.557008 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 8dda8bf3c6e5443fa3dcaf9b4dbf8417 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:47.558609 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dda8bf3c6e5443fa3dcaf9b4dbf8417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.559129 31343 tablet_service.cc:1511] Processing CreateTablet for tablet f83751ae3dbd4d78add4ddcbf77254a4 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:47.559851 31192 tablet_service.cc:1511] Processing CreateTablet for tablet de710065f7ad4be19742d79b91324d29 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:47.560588 31343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83751ae3dbd4d78add4ddcbf77254a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.561311 31192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de710065f7ad4be19742d79b91324d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.563640 31118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a2005abeeca4984960b64be4b5d532e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.546872 31340 tablet_service.cc:1511] Processing CreateTablet for tablet b70e3a964ca446edb98d1ad6c8984716 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:47.564082 31339 tablet_service.cc:1511] Processing CreateTablet for tablet 8dda8bf3c6e5443fa3dcaf9b4dbf8417 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:47.565480 31340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70e3a964ca446edb98d1ad6c8984716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.530967 31342 tablet_service.cc:1511] Processing CreateTablet for tablet 76f9f2ccc422431581e845d7df278107 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:47.566437 31400 raft_consensus.cc:359] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:47.567375 31400 raft_consensus.cc:385] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.567766 31400 raft_consensus.cc:740] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.568616 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 256c4c6b88d240658c96e3d2b37b1d51 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:47.566498 31187 tablet_service.cc:1511] Processing CreateTablet for tablet b70e3a964ca446edb98d1ad6c8984716 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:20:47.574401 31187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b70e3a964ca446edb98d1ad6c8984716. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.579698 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f9f2ccc422431581e845d7df278107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.560276 31268 tablet_service.cc:1511] Processing CreateTablet for tablet de710065f7ad4be19742d79b91324d29 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:47.585085 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dda8bf3c6e5443fa3dcaf9b4dbf8417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.568965 31400 consensus_queue.cc:260] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:47.619693 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de710065f7ad4be19742d79b91324d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.656816 31402 tablet_bootstrap.cc:492] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:47.657601 31402 ts_tablet_manager.cc:1403] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.476s	user 0.017s	sys 0.000s
I20260709 12:20:47.660876 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256c4c6b88d240658c96e3d2b37b1d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.681542 31189 tablet_service.cc:1511] Processing CreateTablet for tablet f83751ae3dbd4d78add4ddcbf77254a4 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:47.694021 31399 ts_tablet_manager.cc:1434] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.252s	user 0.016s	sys 0.007s
I20260709 12:20:47.701207 31186 tablet_service.cc:1511] Processing CreateTablet for tablet 256c4c6b88d240658c96e3d2b37b1d51 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:47.701476 31402 raft_consensus.cc:359] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:47.702525 31402 raft_consensus.cc:385] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:47.703678 31402 raft_consensus.cc:740] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:47.703670 31401 ts_tablet_manager.cc:1434] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.252s	user 0.009s	sys 0.011s
I20260709 12:20:47.705925 31402 consensus_queue.cc:260] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:47.708581 31337 tablet_service.cc:1511] Processing CreateTablet for tablet 24d785aaedd448a7bc9ddde9d573d467 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:47.710847 31401 tablet_bootstrap.cc:492] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
W20260709 12:20:47.761991 31011 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.93.195:37949, user_credentials={real_user=slave}} blocked reactor thread for 53989.9us
I20260709 12:20:47.712307 31189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83751ae3dbd4d78add4ddcbf77254a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.663610 31334 tablet_service.cc:1511] Processing CreateTablet for tablet 256c4c6b88d240658c96e3d2b37b1d51 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:20:47.753362 31112 tablet_service.cc:1511] Processing CreateTablet for tablet 2c051d29b0624a46be22221fba1d500e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:20:47.755465 31342 tablet_service.cc:1511] Processing CreateTablet for tablet 2de9d20cb0f14f9e95f678bcf8c59988 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
W20260709 12:20:47.772739 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:47.753362 31399 tablet_bootstrap.cc:492] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:47.783248 31186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256c4c6b88d240658c96e3d2b37b1d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.783878 31112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c051d29b0624a46be22221fba1d500e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.784216 31400 ts_tablet_manager.cc:1434] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.310s	user 0.007s	sys 0.007s
I20260709 12:20:47.788251 31400 tablet_bootstrap.cc:492] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:47.787920 31111 tablet_service.cc:1511] Processing CreateTablet for tablet 76f9f2ccc422431581e845d7df278107 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:20:47.789484 31111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 76f9f2ccc422431581e845d7df278107. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.778220 31337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24d785aaedd448a7bc9ddde9d573d467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.795756 31401 tablet_bootstrap.cc:654] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.797189 31334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 256c4c6b88d240658c96e3d2b37b1d51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.799969 31191 tablet_service.cc:1511] Processing CreateTablet for tablet 24d785aaedd448a7bc9ddde9d573d467 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:47.800076 31267 tablet_service.cc:1511] Processing CreateTablet for tablet 5c37a6f0ffae493aa28e03c18d52e48f (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:47.801478 31191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24d785aaedd448a7bc9ddde9d573d467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.801692 31267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c37a6f0ffae493aa28e03c18d52e48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.803676 31342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de9d20cb0f14f9e95f678bcf8c59988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.803848 31409 raft_consensus.cc:493] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:47.804484 31409 raft_consensus.cc:515] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
W20260709 12:20:47.763962 31012 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.93.196:36383, user_credentials={real_user=slave}} blocked reactor thread for 55105.1us
I20260709 12:20:47.833215 31408 raft_consensus.cc:493] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:47.846405 31380 tablet.cc:2406] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:20:47.844907 31408 raft_consensus.cc:515] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:47.853566 31409 leader_election.cc:290] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:47.853917 31408 leader_election.cc:290] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:47.823014 31114 tablet_service.cc:1511] Processing CreateTablet for tablet 1e8a7095a2544957b3d93c160aebdad6 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:20:47.873983 31114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e8a7095a2544957b3d93c160aebdad6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.892812 31400 tablet_bootstrap.cc:654] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:47.893252 31185 tablet_service.cc:1511] Processing CreateTablet for tablet ce58073b26274815b7e9542e152bd07c (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:47.894948 31185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce58073b26274815b7e9542e152bd07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.895638 31190 tablet_service.cc:1511] Processing CreateTablet for tablet 5c37a6f0ffae493aa28e03c18d52e48f (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:47.903750 31110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45002 (request call id 15) took 1068 ms. Trace:
I20260709 12:20:47.932642 31109 tablet_service.cc:1511] Processing CreateTablet for tablet f83751ae3dbd4d78add4ddcbf77254a4 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:20:47.934456 31110 rpcz_store.cc:276] 0709 12:20:46.858745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.149520 (+290775us) service_pool.cc:224] Handling call
0709 12:20:47.260355 (+110835us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:20:47.260451 (+    96us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:20:47.672417 (+411966us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:47.903048 (+230631us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:47.903660 (+   612us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2890}
I20260709 12:20:47.936381 31109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f83751ae3dbd4d78add4ddcbf77254a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.937273 31110 tablet_service.cc:1511] Processing CreateTablet for tablet 8dda8bf3c6e5443fa3dcaf9b4dbf8417 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:20:47.938756 31110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8dda8bf3c6e5443fa3dcaf9b4dbf8417. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.940251 31119 tablet_service.cc:1511] Processing CreateTablet for tablet 5c37a6f0ffae493aa28e03c18d52e48f (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:20:47.941816 31119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c37a6f0ffae493aa28e03c18d52e48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.941926 31188 tablet_service.cc:1511] Processing CreateTablet for tablet 20fcea95aa024b629aecb6d0ff49c9d1 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:47.902904 31117 tablet_service.cc:1511] Processing CreateTablet for tablet de710065f7ad4be19742d79b91324d29 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:20:47.965494 31117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de710065f7ad4be19742d79b91324d29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.985095 31336 tablet_service.cc:1511] Processing CreateTablet for tablet ce58073b26274815b7e9542e152bd07c (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:47.985162 31118 tablet_service.cc:1511] Processing CreateTablet for tablet 24d785aaedd448a7bc9ddde9d573d467 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:20:47.987905 31190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c37a6f0ffae493aa28e03c18d52e48f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.989814 31341 tablet_service.cc:1511] Processing CreateTablet for tablet 2929cced2b1543e0aa12f490cb2abbbd (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:47.987888 31118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24d785aaedd448a7bc9ddde9d573d467. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:47.991940 31188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fcea95aa024b629aecb6d0ff49c9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.010265 31336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce58073b26274815b7e9542e152bd07c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:48.007261 31011 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.93.195:37949, user_credentials={real_user=slave}} blocked reactor thread for 47624.4us
I20260709 12:20:48.024781 31407 raft_consensus.cc:493] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.025483 31407 raft_consensus.cc:515] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:48.026309 31260 tablet_service.cc:1511] Processing CreateTablet for tablet 2de9d20cb0f14f9e95f678bcf8c59988 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:48.027962 31260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de9d20cb0f14f9e95f678bcf8c59988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.028909 31407 leader_election.cc:290] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:48.029742 31113 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45002 (request call id 21) took 1008 ms. Trace:
I20260709 12:20:48.041878 31263 tablet_service.cc:1511] Processing CreateTablet for tablet 20fcea95aa024b629aecb6d0ff49c9d1 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:48.042948 31268 tablet_service.cc:1511] Processing CreateTablet for tablet ce58073b26274815b7e9542e152bd07c (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:20:48.043542 31263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fcea95aa024b629aecb6d0ff49c9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.044481 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce58073b26274815b7e9542e152bd07c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.044701 31399 tablet_bootstrap.cc:654] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.047283 31402 ts_tablet_manager.cc:1434] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.389s	user 0.014s	sys 0.022s
I20260709 12:20:48.055439 31401 tablet_bootstrap.cc:492] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:48.071318 31341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2929cced2b1543e0aa12f490cb2abbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.053970 31262 tablet_service.cc:1511] Processing CreateTablet for tablet a8c6d0d195714cae8e83d74d668f13fe (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:48.064090 31416 raft_consensus.cc:493] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.059703 31335 tablet_service.cc:1511] Processing CreateTablet for tablet a8c6d0d195714cae8e83d74d668f13fe (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:48.120309 31187 tablet_service.cc:1511] Processing CreateTablet for tablet 3f45cc601c2c422b933c4fd00560db82 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:20:48.121932 31187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f45cc601c2c422b933c4fd00560db82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.111855 31401 ts_tablet_manager.cc:1403] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.399s	user 0.014s	sys 0.010s
I20260709 12:20:48.124557 31402 tablet_bootstrap.cc:492] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:48.127846 31262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c6d0d195714cae8e83d74d668f13fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.137181 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:48.139714 31244 leader_election.cc:343] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.143442 31335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c6d0d195714cae8e83d74d668f13fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.113327 31416 raft_consensus.cc:515] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:48.150453 31416 leader_election.cc:290] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:48.102144 31193 tablet_service.cc:1511] Processing CreateTablet for tablet 2929cced2b1543e0aa12f490cb2abbbd (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:48.156430 31193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2929cced2b1543e0aa12f490cb2abbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.153661 31401 raft_consensus.cc:359] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.162714 31401 raft_consensus.cc:385] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.171262 31402 tablet_bootstrap.cc:654] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.170719 31401 raft_consensus.cc:740] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.194167 31401 consensus_queue.cc:260] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.195043 31400 tablet_bootstrap.cc:492] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:48.195753 31400 ts_tablet_manager.cc:1403] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.408s	user 0.021s	sys 0.008s
I20260709 12:20:48.196693 31401 ts_tablet_manager.cc:1434] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.002s
I20260709 12:20:48.197134 31399 tablet_bootstrap.cc:492] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:48.197748 31399 ts_tablet_manager.cc:1403] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.445s	user 0.016s	sys 0.014s
I20260709 12:20:48.198851 31401 tablet_bootstrap.cc:492] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:48.199527 31400 raft_consensus.cc:359] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:48.200381 31400 raft_consensus.cc:385] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.200740 31400 raft_consensus.cc:740] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.201375 31399 raft_consensus.cc:359] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.201640 31400 consensus_queue.cc:260] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:48.202215 31399 raft_consensus.cc:385] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.202600 31399 raft_consensus.cc:740] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.030165 31113 rpcz_store.cc:276] 0709 12:20:47.021336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.426571 (+405235us) service_pool.cc:224] Handling call
0709 12:20:47.525713 (+ 99142us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:20:47.525816 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:20:47.680094 (+154278us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:47.968506 (+288412us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:48.029667 (+ 61161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34432}
I20260709 12:20:48.274046 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:48.068670 31114 tablet_service.cc:1511] Processing CreateTablet for tablet 2de9d20cb0f14f9e95f678bcf8c59988 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:20:48.279286 31114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2de9d20cb0f14f9e95f678bcf8c59988. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.301028 31399 consensus_queue.cc:260] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.276188 31113 tablet_service.cc:1511] Processing CreateTablet for tablet 20fcea95aa024b629aecb6d0ff49c9d1 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:20:48.325968 31113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20fcea95aa024b629aecb6d0ff49c9d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.336365 31334 tablet_service.cc:1511] Processing CreateTablet for tablet 3f45cc601c2c422b933c4fd00560db82 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
W20260709 12:20:48.337745 31243 leader_election.cc:343] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.338932 31243 leader_election.cc:304] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:48.341179 31409 raft_consensus.cc:2749] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.343218 31334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f45cc601c2c422b933c4fd00560db82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.344486 31400 ts_tablet_manager.cc:1434] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.148s	user 0.003s	sys 0.006s
I20260709 12:20:48.348737 31399 ts_tablet_manager.cc:1434] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.151s	user 0.013s	sys 0.000s
I20260709 12:20:48.354261 31401 tablet_bootstrap.cc:654] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.355456 31408 raft_consensus.cc:493] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.356244 31408 raft_consensus.cc:515] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.284570 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:48.379788 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302d0756616a44fbad812870fbd6d499" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:48.392246 31168 leader_election.cc:343] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:48.341703 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:36023, user_credentials={real_user=slave}} blocked reactor thread for 44777.2us
I20260709 12:20:48.366866 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:48.369649 31269 tablet_service.cc:1511] Processing CreateTablet for tablet 6d69b4dd96704efb9cb29a41aae2b039 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:48.399677 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d69b4dd96704efb9cb29a41aae2b039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.367108 31268 tablet_service.cc:1511] Processing CreateTablet for tablet 3f45cc601c2c422b933c4fd00560db82 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:20:48.404297 31409 raft_consensus.cc:493] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:48.393961 31168 leader_election.cc:343] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.404963 31409 raft_consensus.cc:515] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:48.415853 31407 raft_consensus.cc:493] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.416886 31407 raft_consensus.cc:515] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.417963 31409 leader_election.cc:290] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:48.419869 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f45cc601c2c422b933c4fd00560db82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.420845 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da571cacd7e4c87b7615361589e46db" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:48.422693 31244 leader_election.cc:343] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.381179 31400 tablet_bootstrap.cc:492] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:48.431629 31407 leader_election.cc:290] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:48.366530 31408 leader_election.cc:290] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:48.455564 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da571cacd7e4c87b7615361589e46db" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:48.468422 31185 tablet_service.cc:1511] Processing CreateTablet for tablet 6d69b4dd96704efb9cb29a41aae2b039 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 12:20:48.449949 31168 leader_election.cc:343] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.483448 31185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d69b4dd96704efb9cb29a41aae2b039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.489131 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302d0756616a44fbad812870fbd6d499" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:48.490084 31354 raft_consensus.cc:2468] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:48.490594 31339 tablet_service.cc:1511] Processing CreateTablet for tablet ff93479d44174057843c235314d57461 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:48.492488 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff93479d44174057843c235314d57461. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:20:48.495389 31265 consensus_meta.cc:287] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent flushing consensus metadata: real 0.528s	user 0.014s	sys 0.004s
I20260709 12:20:48.495187 31169 leader_election.cc:304] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:48.496551 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
W20260709 12:20:48.498574 31317 leader_election.cc:343] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.499191 31399 tablet_bootstrap.cc:492] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:48.503229 31408 raft_consensus.cc:2804] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:48.503854 31408 raft_consensus.cc:493] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:48.504349 31408 raft_consensus.cc:3060] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.508630 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:48.476070 31168 leader_election.cc:304] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:48.510914 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302d0756616a44fbad812870fbd6d499" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
W20260709 12:20:48.512574 31317 leader_election.cc:343] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.513118 31317 leader_election.cc:304] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:48.514132 31407 raft_consensus.cc:2749] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.518399 31336 tablet_service.cc:1511] Processing CreateTablet for tablet c66c15cae85a4a45bae00ea0560859d7 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:48.519213 31402 tablet_bootstrap.cc:492] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:48.520160 31402 ts_tablet_manager.cc:1403] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.396s	user 0.018s	sys 0.021s
I20260709 12:20:48.520490 31336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66c15cae85a4a45bae00ea0560859d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.523120 31112 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45002 (request call id 24) took 1063 ms. Trace:
I20260709 12:20:48.523602 31112 rpcz_store.cc:276] 0709 12:20:47.459734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.752219 (+292485us) service_pool.cc:224] Handling call
0709 12:20:47.780825 (+ 28606us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:20:47.783441 (+  2616us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:20:48.068868 (+285427us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:48.522263 (+453395us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:48.522877 (+   614us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:48.526010 31112 tablet_service.cc:1511] Processing CreateTablet for tablet a8c6d0d195714cae8e83d74d668f13fe (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:20:48.541006 31399 tablet_bootstrap.cc:654] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:48.543823 31243 leader_election.cc:343] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.561656 31402 raft_consensus.cc:359] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:48.568464 31109 tablet_service.cc:1511] Processing CreateTablet for tablet 2929cced2b1543e0aa12f490cb2abbbd (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:20:48.569244 31402 raft_consensus.cc:385] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.575177 31402 raft_consensus.cc:740] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.576333 31402 consensus_queue.cc:260] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:48.576854 31263 tablet_service.cc:1511] Processing CreateTablet for tablet c66c15cae85a4a45bae00ea0560859d7 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:48.581976 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7188da143a8e4c5fb12f21ff47aa63ea" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:48.585400 31189 tablet_service.cc:1511] Processing CreateTablet for tablet 26a6299c5cfa4197a694ae06c6e07e4f (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:48.585652 31265 tablet_service.cc:1511] Processing CreateTablet for tablet 26a6299c5cfa4197a694ae06c6e07e4f (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:48.587014 31189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a6299c5cfa4197a694ae06c6e07e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.588516 31112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a8c6d0d195714cae8e83d74d668f13fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.591008 31115 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45002 (request call id 22) took 1261 ms. Trace:
I20260709 12:20:48.591495 31115 rpcz_store.cc:276] 0709 12:20:47.329295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.449994 (+120699us) service_pool.cc:224] Handling call
0709 12:20:47.481721 (+ 31727us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:20:47.481831 (+   110us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:20:48.272841 (+791010us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:48.562224 (+289383us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:48.590367 (+ 28143us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b5800004898. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c024571a2 00007f4c0b398889 00007f4c0a4c9d88 00007f4c0a590973 00007f4c0a58c70f 00007f4c0a58cecd 00007f4c0a53b400 00007f4c039c0af4 00007f4c039c0a82
0709 12:20:48.590758 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":62539648}
I20260709 12:20:48.594017 31115 tablet_service.cc:1511] Processing CreateTablet for tablet ff93479d44174057843c235314d57461 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
W20260709 12:20:48.598866 31092 leader_election.cc:343] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.591547 31111 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45002 (request call id 26) took 1131 ms. Trace:
I20260709 12:20:48.599642 31111 rpcz_store.cc:276] 0709 12:20:47.460365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.764232 (+303867us) service_pool.cc:224] Handling call
0709 12:20:47.788936 (+ 24704us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:20:47.789059 (+   123us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:20:48.390795 (+601736us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:48.537752 (+146957us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:48.591340 (+ 53588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:48.603012 31243 leader_election.cc:304] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:48.604156 31409 raft_consensus.cc:2749] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.552131 31400 tablet_bootstrap.cc:654] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:48.605482 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:36023, user_credentials={real_user=slave}} blocked reactor thread for 61706.8us
I20260709 12:20:48.608592 31263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66c15cae85a4a45bae00ea0560859d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.608798 31115 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff93479d44174057843c235314d57461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.617069 31111 tablet_service.cc:1511] Processing CreateTablet for tablet c66c15cae85a4a45bae00ea0560859d7 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:20:48.618647 31111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66c15cae85a4a45bae00ea0560859d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.617494 31110 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45002 (request call id 29) took 1065 ms. Trace:
W20260709 12:20:48.619181 31168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.195:37949, user_credentials={real_user=slave}} blocked reactor thread for 173590us
I20260709 12:20:48.619133 31110 rpcz_store.cc:276] 0709 12:20:47.552212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.936043 (+383831us) service_pool.cc:224] Handling call
0709 12:20:47.938241 (+  2198us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:20:47.938339 (+    98us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:20:48.378551 (+440212us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:48.587503 (+208952us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:48.616876 (+ 29373us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b5800004898. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c024571a2 00007f4c0b398889 00007f4c0a4c9d88 00007f4c0a590973 00007f4c0a58c70f 00007f4c0a58cecd 00007f4c0a53b400 00007f4c039c0af4 00007f4c039c0a82
0709 12:20:48.617310 (+   434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53145856}
I20260709 12:20:48.621773 31188 tablet_service.cc:1511] Processing CreateTablet for tablet 9d70b39511ff4d30b5b30ea93e6d471b (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:48.591848 31119 tablet_service.cc:1511] Processing CreateTablet for tablet 6d69b4dd96704efb9cb29a41aae2b039 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:20:48.626206 31109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2929cced2b1543e0aa12f490cb2abbbd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.631441 31188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d70b39511ff4d30b5b30ea93e6d471b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.636972 31110 tablet_service.cc:1511] Processing CreateTablet for tablet 9d70b39511ff4d30b5b30ea93e6d471b (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:48.637718 31265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a6299c5cfa4197a694ae06c6e07e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.637457 31260 tablet_service.cc:1511] Processing CreateTablet for tablet 9d70b39511ff4d30b5b30ea93e6d471b (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:20:48.638904 31260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d70b39511ff4d30b5b30ea93e6d471b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.640882 31402 ts_tablet_manager.cc:1434] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.120s	user 0.008s	sys 0.004s
I20260709 12:20:48.646808 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7188da143a8e4c5fb12f21ff47aa63ea" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:48.649183 31119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d69b4dd96704efb9cb29a41aae2b039. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.668449 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302d0756616a44fbad812870fbd6d499" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:48.666640 31401 tablet_bootstrap.cc:492] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:48.659559 31433 raft_consensus.cc:2749] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.672232 31117 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45002 (request call id 27) took 1170 ms. Trace:
I20260709 12:20:48.683059 31117 rpcz_store.cc:276] 0709 12:20:47.460693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:47.901342 (+440649us) service_pool.cc:224] Handling call
0709 12:20:47.960277 (+ 58935us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:20:47.964908 (+  4631us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:20:48.527851 (+562943us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:48.618673 (+ 90822us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:48.631148 (+ 12475us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:20:48.680871 31401 ts_tablet_manager.cc:1403] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.482s	user 0.016s	sys 0.009s
W20260709 12:20:48.680709 31317 leader_election.cc:343] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.675868 31190 tablet_service.cc:1511] Processing CreateTablet for tablet ff93479d44174057843c235314d57461 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:20:48.681917 31110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d70b39511ff4d30b5b30ea93e6d471b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.660379 31341 tablet_service.cc:1511] Processing CreateTablet for tablet 26a6299c5cfa4197a694ae06c6e07e4f (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:20:48.682442 31402 tablet_bootstrap.cc:492] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:20:48.673625 31092 leader_election.cc:343] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.663769 31408 raft_consensus.cc:515] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.695581 31092 leader_election.cc:304] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:48.700393 31420 raft_consensus.cc:2749] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.702349 31334 tablet_service.cc:1511] Processing CreateTablet for tablet 23ff1489a95143b79e3d3c4aa6dc7523 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:48.704010 31334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ff1489a95143b79e3d3c4aa6dc7523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.708456 31117 tablet_service.cc:1511] Processing CreateTablet for tablet 23ff1489a95143b79e3d3c4aa6dc7523 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:20:48.710652 31117 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ff1489a95143b79e3d3c4aa6dc7523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.714447 31402 tablet_bootstrap.cc:654] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.715472 31341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26a6299c5cfa4197a694ae06c6e07e4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.726405 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302d0756616a44fbad812870fbd6d499" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:48.751151 31268 tablet_service.cc:1511] Processing CreateTablet for tablet 28ff0dec68504c32b1b5df23cd8f25a0 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:48.757563 31354 raft_consensus.cc:3060] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:48.758695 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ff0dec68504c32b1b5df23cd8f25a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.725144 31408 leader_election.cc:290] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:48.753461 31335 tablet_service.cc:1511] Processing CreateTablet for tablet 28ff0dec68504c32b1b5df23cd8f25a0 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:48.764667 31335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ff0dec68504c32b1b5df23cd8f25a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.726224 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "302d0756616a44fbad812870fbd6d499" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
W20260709 12:20:48.769129 31168 leader_election.cc:343] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.723472 31203 raft_consensus.cc:2393] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9800423c0012421d9ce299e8c180ac96 in current term 1: Already voted for candidate 1d5ebd798965493785b198d6e8492c23 in this term.
I20260709 12:20:48.730731 31187 tablet_service.cc:1511] Processing CreateTablet for tablet 23ff1489a95143b79e3d3c4aa6dc7523 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
W20260709 12:20:48.777588 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:48.781917 31317 leader_election.cc:304] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:48.735634 31190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff93479d44174057843c235314d57461. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.786818 31187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23ff1489a95143b79e3d3c4aa6dc7523. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.788477 31400 tablet_bootstrap.cc:492] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:48.789167 31400 ts_tablet_manager.cc:1403] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.409s	user 0.040s	sys 0.038s
I20260709 12:20:48.722944 31401 raft_consensus.cc:359] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:48.791816 31401 raft_consensus.cc:385] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.792228 31401 raft_consensus.cc:740] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.793241 31401 consensus_queue.cc:260] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:48.730283 31399 tablet_bootstrap.cc:492] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:48.807802 31118 tablet_service.cc:1511] Processing CreateTablet for tablet 28ff0dec68504c32b1b5df23cd8f25a0 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:20:48.802866 31354 raft_consensus.cc:2468] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:48.814666 31407 raft_consensus.cc:2749] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.820953 31169 leader_election.cc:304] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:48.822393 31408 raft_consensus.cc:2804] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:48.822932 31408 raft_consensus.cc:697] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:48.823951 31408 consensus_queue.cc:237] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.832662 31400 raft_consensus.cc:359] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:48.833649 31400 raft_consensus.cc:385] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.834012 31400 raft_consensus.cc:740] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.835312 31399 ts_tablet_manager.cc:1403] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.484s	user 0.019s	sys 0.008s
I20260709 12:20:48.840128 31118 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28ff0dec68504c32b1b5df23cd8f25a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.844182 31260 tablet_service.cc:1511] Processing CreateTablet for tablet 399de19748dd4407986684b816a07da9 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:48.851975 31260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399de19748dd4407986684b816a07da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.853423 31190 tablet_service.cc:1511] Processing CreateTablet for tablet 399de19748dd4407986684b816a07da9 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:48.858074 31335 tablet_service.cc:1511] Processing CreateTablet for tablet 399de19748dd4407986684b816a07da9 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:20:48.860121 31335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399de19748dd4407986684b816a07da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.860571 31401 ts_tablet_manager.cc:1434] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.172s	user 0.006s	sys 0.006s
I20260709 12:20:48.863559 31420 raft_consensus.cc:493] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.864144 31420 raft_consensus.cc:515] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:48.865500 31190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 399de19748dd4407986684b816a07da9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.866935 31026 catalog_manager.cc:5697] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:48.868454 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4314d275b47a469bafd749deec419c28" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:48.870328 31092 leader_election.cc:343] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.877737 31268 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2db72180a343d9a6ee51388b24edd9 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:48.844630 31400 consensus_queue.cc:260] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:48.880411 31187 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2db72180a343d9a6ee51388b24edd9 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:48.881531 31339 tablet_service.cc:1511] Processing CreateTablet for tablet 13829eeeec8d43728320a1237d93b27e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:48.882886 31185 tablet_service.cc:1511] Processing CreateTablet for tablet 13829eeeec8d43728320a1237d93b27e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:48.900538 31187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2db72180a343d9a6ee51388b24edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.884670 31110 tablet_service.cc:1511] Processing CreateTablet for tablet 13829eeeec8d43728320a1237d93b27e (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:20:48.901288 31399 raft_consensus.cc:359] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.902081 31110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13829eeeec8d43728320a1237d93b27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.886482 31114 tablet_service.cc:1511] Processing CreateTablet for tablet 7d2db72180a343d9a6ee51388b24edd9 (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:20:48.902217 31399 raft_consensus.cc:385] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.907605 31399 raft_consensus.cc:740] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.907938 31114 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2db72180a343d9a6ee51388b24edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.908836 31400 ts_tablet_manager.cc:1434] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.117s	user 0.010s	sys 0.000s
I20260709 12:20:48.909536 31399 consensus_queue.cc:260] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.888280 31268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d2db72180a343d9a6ee51388b24edd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.879302 31420 leader_election.cc:290] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:48.893126 31336 tablet_service.cc:1511] Processing CreateTablet for tablet d181ab9ed7ab4e54ac19b4cdad63a90a (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:48.910334 31400 tablet_bootstrap.cc:492] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:48.887691 31269 tablet_service.cc:1511] Processing CreateTablet for tablet d181ab9ed7ab4e54ac19b4cdad63a90a (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:48.912226 31185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13829eeeec8d43728320a1237d93b27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.927371 31399 ts_tablet_manager.cc:1434] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.071s	user 0.006s	sys 0.002s
I20260709 12:20:48.929497 31399 tablet_bootstrap.cc:492] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:48.913084 31339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13829eeeec8d43728320a1237d93b27e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.912846 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4314d275b47a469bafd749deec419c28" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:48.933100 31093 leader_election.cc:343] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.933657 31093 leader_election.cc:304] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:48.883033 31401 tablet_bootstrap.cc:492] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:48.934549 31420 raft_consensus.cc:2749] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:48.935503 31336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d181ab9ed7ab4e54ac19b4cdad63a90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.939466 31269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d181ab9ed7ab4e54ac19b4cdad63a90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.941135 31119 tablet_service.cc:1511] Processing CreateTablet for tablet d181ab9ed7ab4e54ac19b4cdad63a90a (DEFAULT_TABLE table=test-workload [id=a6077157b3c1476d886477d90b723b2d]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:20:48.941953 31399 tablet_bootstrap.cc:654] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:48.943225 31119 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d181ab9ed7ab4e54ac19b4cdad63a90a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:20:48.948850 31402 tablet_bootstrap.cc:492] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:48.949450 31402 ts_tablet_manager.cc:1403] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.284s	user 0.027s	sys 0.027s
I20260709 12:20:48.953174 31402 raft_consensus.cc:359] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:48.953917 31402 raft_consensus.cc:385] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:48.954216 31402 raft_consensus.cc:740] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:48.971079 31408 raft_consensus.cc:493] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:48.973670 31402 consensus_queue.cc:260] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:48.974308 31408 raft_consensus.cc:515] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:48.976410 31402 ts_tablet_manager.cc:1434] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.003s
I20260709 12:20:48.977557 31408 leader_election.cc:290] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:48.978554 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:48.979784 31402 tablet_bootstrap.cc:492] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:20:48.980275 31168 leader_election.cc:343] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.990669 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:48.992527 31169 leader_election.cc:343] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:48.993059 31169 leader_election.cc:304] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:48.998303 31408 raft_consensus.cc:2749] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.005885 31109 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:45002 (request call id 34) took 1071 ms. Trace:
I20260709 12:20:49.006599 31109 rpcz_store.cc:276] 0709 12:20:47.934679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:20:48.490586 (+555907us) service_pool.cc:224] Handling call
0709 12:20:48.609371 (+118785us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b5800004898. stack: 00007f4c0245c343 00007f4c0245c240 00007f4c01deb1d4 00007f4c0bb29304 00007f4c0bb29299 00007f4c02316db1 00007f4c02456b71 00007f4c02456a22 00007f4c0b36f8d9 00007f4c0a4c9ee0 00007f4c0a5af831 00007f4c0a58cac3 00007f4c0a53b400 00007f4c039c0af4 00007f4c039c0a82 00007f4c039c09b1
0709 12:20:48.609523 (+   152us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:20:48.609642 (+   119us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:20:48.842348 (+232706us) tablet_metadata.cc:665] Metadata flushed
0709 12:20:49.005141 (+162793us) tablet_replica.cc:206] Creating consensus instance
0709 12:20:49.005794 (+   653us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57431424}
I20260709 12:20:49.018553 31400 tablet_bootstrap.cc:654] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.029999 31402 tablet_bootstrap.cc:654] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.037861 31400 tablet_bootstrap.cc:492] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:49.038744 31400 ts_tablet_manager.cc:1403] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.129s	user 0.016s	sys 0.000s
I20260709 12:20:49.034829 31401 tablet_bootstrap.cc:654] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.051079 31400 raft_consensus.cc:359] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.052012 31400 raft_consensus.cc:385] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.052141 31399 tablet_bootstrap.cc:492] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:49.052388 31400 raft_consensus.cc:740] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.055444 31402 tablet_bootstrap.cc:492] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:49.055539 31399 ts_tablet_manager.cc:1403] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.126s	user 0.050s	sys 0.034s
I20260709 12:20:49.056207 31402 ts_tablet_manager.cc:1403] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.077s	user 0.017s	sys 0.010s
I20260709 12:20:49.055850 31400 consensus_queue.cc:260] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.059873 31402 raft_consensus.cc:359] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.060633 31402 raft_consensus.cc:385] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.060940 31402 raft_consensus.cc:740] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.061771 31402 consensus_queue.cc:260] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.064038 31399 raft_consensus.cc:359] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.064890 31399 raft_consensus.cc:385] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.065186 31399 raft_consensus.cc:740] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.066087 31399 consensus_queue.cc:260] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.067468 31400 ts_tablet_manager.cc:1434] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:20:49.068385 31420 raft_consensus.cc:493] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.068707 31399 ts_tablet_manager.cc:1434] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:20:49.069265 31420 raft_consensus.cc:515] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.070323 31399 tablet_bootstrap.cc:492] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:49.073137 31420 leader_election.cc:290] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.071810 31400 tablet_bootstrap.cc:492] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:49.073896 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b428d9f5e1c4775a6d6ccca23e9f2fa" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
W20260709 12:20:49.079430 31092 leader_election.cc:343] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.073309 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b428d9f5e1c4775a6d6ccca23e9f2fa" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:49.082276 31093 leader_election.cc:343] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.082799 31093 leader_election.cc:304] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:49.083714 31420 raft_consensus.cc:2749] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.083892 31399 tablet_bootstrap.cc:654] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.074952 31402 ts_tablet_manager.cc:1434] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:20:49.085757 31402 tablet_bootstrap.cc:492] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:49.088012 31401 tablet_bootstrap.cc:492] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:49.088632 31401 ts_tablet_manager.cc:1403] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.206s	user 0.016s	sys 0.000s
I20260709 12:20:49.092478 31401 raft_consensus.cc:359] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.093286 31401 raft_consensus.cc:385] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.093592 31401 raft_consensus.cc:740] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.094422 31401 consensus_queue.cc:260] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.085853 31400 tablet_bootstrap.cc:654] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.098317 31402 tablet_bootstrap.cc:654] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.101030 31401 ts_tablet_manager.cc:1434] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:20:49.103638 31401 tablet_bootstrap.cc:492] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:49.109138 31399 tablet_bootstrap.cc:492] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:49.109773 31399 ts_tablet_manager.cc:1403] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.020s
I20260709 12:20:49.128583 31401 tablet_bootstrap.cc:654] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.128733 31400 tablet_bootstrap.cc:492] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:49.129487 31400 ts_tablet_manager.cc:1403] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.015s
I20260709 12:20:49.129168 31399 raft_consensus.cc:359] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.130079 31399 raft_consensus.cc:385] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.130437 31399 raft_consensus.cc:740] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.130842 31402 tablet_bootstrap.cc:492] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:49.131520 31402 ts_tablet_manager.cc:1403] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.021s
I20260709 12:20:49.131347 31399 consensus_queue.cc:260] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.133737 31400 raft_consensus.cc:359] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.134490 31400 raft_consensus.cc:385] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.134723 31399 ts_tablet_manager.cc:1434] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:20:49.134792 31400 raft_consensus.cc:740] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.136180 31400 consensus_queue.cc:260] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.136785 31399 tablet_bootstrap.cc:492] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:49.147096 31400 ts_tablet_manager.cc:1434] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:20:49.148119 31399 tablet_bootstrap.cc:654] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.156287 31402 raft_consensus.cc:359] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.157289 31402 raft_consensus.cc:385] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.158186 31402 raft_consensus.cc:740] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.158367 31400 tablet_bootstrap.cc:492] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:49.159291 31402 consensus_queue.cc:260] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.164301 31399 tablet_bootstrap.cc:492] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:49.164544 31401 tablet_bootstrap.cc:492] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:49.164980 31399 ts_tablet_manager.cc:1403] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.029s	user 0.019s	sys 0.005s
I20260709 12:20:49.165098 31401 ts_tablet_manager.cc:1403] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.022s
I20260709 12:20:49.167229 31400 tablet_bootstrap.cc:654] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.168812 31399 raft_consensus.cc:359] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.169427 31402 ts_tablet_manager.cc:1434] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.000s
I20260709 12:20:49.169665 31399 raft_consensus.cc:385] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.170050 31399 raft_consensus.cc:740] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.170933 31402 tablet_bootstrap.cc:492] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:49.172034 31401 raft_consensus.cc:359] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.172865 31401 raft_consensus.cc:385] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.173175 31401 raft_consensus.cc:740] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.174185 31399 consensus_queue.cc:260] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.176229 31401 consensus_queue.cc:260] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.179003 31401 ts_tablet_manager.cc:1434] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:20:49.179134 31402 tablet_bootstrap.cc:654] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.180869 31399 ts_tablet_manager.cc:1434] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.004s
I20260709 12:20:49.181802 31401 tablet_bootstrap.cc:492] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:49.182166 31399 tablet_bootstrap.cc:492] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:49.190622 31401 tablet_bootstrap.cc:654] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.194006 31399 tablet_bootstrap.cc:654] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.198474 31402 tablet_bootstrap.cc:492] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:49.199316 31402 ts_tablet_manager.cc:1403] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.015s
I20260709 12:20:49.204438 31402 raft_consensus.cc:359] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.205542 31402 raft_consensus.cc:385] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.205929 31402 raft_consensus.cc:740] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.207062 31402 consensus_queue.cc:260] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.210736 31402 ts_tablet_manager.cc:1434] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:20:49.212471 31402 tablet_bootstrap.cc:492] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:49.223672 31420 raft_consensus.cc:493] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.224530 31420 raft_consensus.cc:515] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.228861 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da571cacd7e4c87b7615361589e46db" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:49.229836 31279 raft_consensus.cc:2468] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:49.231717 31092 leader_election.cc:304] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:49.236238 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da571cacd7e4c87b7615361589e46db" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:49.239367 31407 raft_consensus.cc:493] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.240139 31407 raft_consensus.cc:515] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.246583 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d1fa74ba5e44c194b27640def09ef5" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.247534 31203 raft_consensus.cc:2468] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
W20260709 12:20:49.247752 31093 leader_election.cc:343] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.248523 31402 tablet_bootstrap.cc:654] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.248837 31407 leader_election.cc:290] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.249694 31317 leader_election.cc:304] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:20:49.251046 31420 leader_election.cc:290] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:49.251727 31420 raft_consensus.cc:2804] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.252683 31407 raft_consensus.cc:2804] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.253500 31420 raft_consensus.cc:493] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.253677 31407 raft_consensus.cc:493] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.253927 31420 raft_consensus.cc:3060] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.254297 31407 raft_consensus.cc:3060] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.256492 31401 tablet_bootstrap.cc:492] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:49.251533 31408 consensus_queue.cc:1048] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:49.257160 31401 ts_tablet_manager.cc:1403] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.076s	user 0.018s	sys 0.011s
I20260709 12:20:49.261809 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d1fa74ba5e44c194b27640def09ef5" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:49.263329 31400 tablet_bootstrap.cc:492] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:49.263942 31400 ts_tablet_manager.cc:1403] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.106s	user 0.027s	sys 0.031s
I20260709 12:20:49.265636 31399 tablet_bootstrap.cc:492] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
W20260709 12:20:49.267282 31317 leader_election.cc:343] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.266310 31399 ts_tablet_manager.cc:1403] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.084s	user 0.037s	sys 0.029s
I20260709 12:20:49.270053 31401 raft_consensus.cc:359] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.270869 31401 raft_consensus.cc:385] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.266309 31420 raft_consensus.cc:515] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.271265 31401 raft_consensus.cc:740] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.272456 31400 raft_consensus.cc:359] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.273900 31399 raft_consensus.cc:359] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.274546 31400 raft_consensus.cc:385] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.274382 31401 consensus_queue.cc:260] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.274900 31399 raft_consensus.cc:385] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.275028 31400 raft_consensus.cc:740] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.276585 31400 consensus_queue.cc:260] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.277168 31401 ts_tablet_manager.cc:1434] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:20:49.278007 31407 raft_consensus.cc:515] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.278964 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da571cacd7e4c87b7615361589e46db" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:49.279815 31279 raft_consensus.cc:3060] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.280793 31402 tablet_bootstrap.cc:492] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:49.281446 31402 ts_tablet_manager.cc:1403] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.000s
I20260709 12:20:49.285228 31402 raft_consensus.cc:359] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.286021 31402 raft_consensus.cc:385] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.286330 31402 raft_consensus.cc:740] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.287212 31402 consensus_queue.cc:260] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.288419 31400 ts_tablet_manager.cc:1434] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.000s
I20260709 12:20:49.289655 31402 ts_tablet_manager.cc:1434] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:20:49.291018 31402 tablet_bootstrap.cc:492] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:49.289748 31400 tablet_bootstrap.cc:492] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:49.294977 31409 raft_consensus.cc:493] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.295634 31409 raft_consensus.cc:515] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.295660 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d1fa74ba5e44c194b27640def09ef5" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
W20260709 12:20:49.297912 31317 leader_election.cc:343] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.298542 31409 leader_election.cc:290] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.299383 31407 leader_election.cc:290] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.278527 31401 tablet_bootstrap.cc:492] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:49.275512 31399 raft_consensus.cc:740] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.301167 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d1fa74ba5e44c194b27640def09ef5" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.304930 31203 raft_consensus.cc:3060] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.307499 31402 tablet_bootstrap.cc:654] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.314977 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:49.316059 31129 raft_consensus.cc:2468] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:49.317225 31420 leader_election.cc:290] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:49.321858 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da571cacd7e4c87b7615361589e46db" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
W20260709 12:20:49.323227 31168 consensus_peers.cc:597] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:49.323617 31093 leader_election.cc:343] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.329303 31420 raft_consensus.cc:493] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.335508 31279 raft_consensus.cc:2468] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:49.334376 31407 raft_consensus.cc:493] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.336891 31407 raft_consensus.cc:515] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.338601 31420 raft_consensus.cc:515] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.341048 31407 leader_election.cc:290] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:49.342900 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d247b7758c49c08c20a65227f42b52" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.329651 31399 consensus_queue.cc:260] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.343799 31204 raft_consensus.cc:2468] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:49.345655 31317 leader_election.cc:304] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:20:49.347653 31420 leader_election.cc:290] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:49.343292 31243 leader_election.cc:304] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:49.349331 31437 raft_consensus.cc:2804] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.350956 31437 raft_consensus.cc:493] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.351359 31437 raft_consensus.cc:3060] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.354796 31401 tablet_bootstrap.cc:654] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.356029 31402 tablet_bootstrap.cc:492] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:49.356662 31402 ts_tablet_manager.cc:1403] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.066s	user 0.014s	sys 0.006s
I20260709 12:20:49.355463 31399 ts_tablet_manager.cc:1434] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.087s	user 0.009s	sys 0.001s
I20260709 12:20:49.360054 31409 raft_consensus.cc:2804] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.360320 31203 raft_consensus.cc:2468] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:49.360503 31409 raft_consensus.cc:493] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.360929 31409 raft_consensus.cc:3060] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.361661 31317 leader_election.cc:304] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:49.362608 31407 raft_consensus.cc:2804] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.363698 31092 leader_election.cc:304] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:49.364259 31399 tablet_bootstrap.cc:492] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:49.365178 31420 raft_consensus.cc:2804] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.365965 31420 raft_consensus.cc:697] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:49.366966 31420 consensus_queue.cc:237] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.371393 31400 tablet_bootstrap.cc:654] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.376777 31402 raft_consensus.cc:359] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.378434 31402 raft_consensus.cc:385] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.378666 31402 raft_consensus.cc:740] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.372802 31437 raft_consensus.cc:515] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.383533 31399 tablet_bootstrap.cc:654] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.383626 31437 leader_election.cc:290] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:49.387967 31407 raft_consensus.cc:697] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:49.388960 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d247b7758c49c08c20a65227f42b52" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.389493 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f018fab4f8f24dc18b24bf29b839f828" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:49.389446 31409 raft_consensus.cc:515] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.391654 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d247b7758c49c08c20a65227f42b52" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:49.392264 31409 leader_election.cc:290] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.392410 31277 raft_consensus.cc:3060] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.389719 31203 raft_consensus.cc:3060] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.387781 31402 consensus_queue.cc:260] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.393962 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d247b7758c49c08c20a65227f42b52" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:49.394347 31467 raft_consensus.cc:493] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.395359 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f018fab4f8f24dc18b24bf29b839f828" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.401051 31457 raft_consensus.cc:493] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:49.401288 31092 leader_election.cc:343] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.401623 31457 raft_consensus.cc:515] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
W20260709 12:20:49.402143 31092 leader_election.cc:343] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.402590 31092 leader_election.cc:304] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:49.404065 31457 leader_election.cc:290] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.404639 31457 raft_consensus.cc:2749] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.405002 31402 ts_tablet_manager.cc:1434] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.003s
I20260709 12:20:49.406258 31402 tablet_bootstrap.cc:492] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:49.406731 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:49.399966 31467 raft_consensus.cc:515] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.407514 31354 raft_consensus.cc:2468] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:49.392422 31401 tablet_bootstrap.cc:492] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:49.409353 31401 ts_tablet_manager.cc:1403] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.131s	user 0.007s	sys 0.019s
I20260709 12:20:49.410404 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:49.394315 31407 consensus_queue.cc:237] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.411681 31129 raft_consensus.cc:3060] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.413345 31401 raft_consensus.cc:359] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.414178 31401 raft_consensus.cc:385] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.414517 31401 raft_consensus.cc:740] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.415714 31401 consensus_queue.cc:260] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.417654 31401 ts_tablet_manager.cc:1434] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:20:49.418952 31401 tablet_bootstrap.cc:492] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:49.418813 31464 raft_consensus.cc:493] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.419582 31464 raft_consensus.cc:515] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.410356 31093 leader_election.cc:304] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:49.424100 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
W20260709 12:20:49.426294 31168 leader_election.cc:343] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.427471 31457 raft_consensus.cc:2804] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.427910 31401 tablet_bootstrap.cc:654] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.429697 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:49.434724 31168 leader_election.cc:343] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.436684 31168 leader_election.cc:304] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:49.437876 31408 raft_consensus.cc:2749] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.427944 31464 leader_election.cc:290] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:49.432313 31129 raft_consensus.cc:2468] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:49.442215 31400 tablet_bootstrap.cc:492] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:49.442495 31243 leader_election.cc:304] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:49.446761 31469 raft_consensus.cc:493] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.447345 31469 raft_consensus.cc:515] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.448486 31277 raft_consensus.cc:2468] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:49.449786 31469 leader_election.cc:290] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:49.427950 31457 raft_consensus.cc:493] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.451843 31457 raft_consensus.cc:3060] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.442807 31400 ts_tablet_manager.cc:1403] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.153s	user 0.007s	sys 0.023s
I20260709 12:20:49.455227 31203 raft_consensus.cc:2468] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:49.456583 31409 raft_consensus.cc:493] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.456480 31317 leader_election.cc:304] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:20:49.457578 31469 raft_consensus.cc:2804] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.458098 31469 raft_consensus.cc:697] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:49.459076 31469 consensus_queue.cc:237] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.460839 31409 raft_consensus.cc:515] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.468225 31468 raft_consensus.cc:493] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.469106 31468 raft_consensus.cc:515] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.470130 31400 raft_consensus.cc:359] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.470945 31400 raft_consensus.cc:385] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:49.467555 31092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 65440.3us
I20260709 12:20:49.464836 31467 leader_election.cc:290] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:49.471379 31400 raft_consensus.cc:740] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.476104 31402 tablet_bootstrap.cc:654] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.476250 31464 raft_consensus.cc:493] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.477773 31464 raft_consensus.cc:515] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.475286 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.479664 31203 raft_consensus.cc:2468] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:49.481133 31464 leader_election.cc:290] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:49.481801 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d247b7758c49c08c20a65227f42b52" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:49.483439 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:49.486464 31400 consensus_queue.cc:260] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.487425 31468 leader_election.cc:290] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.489312 31026 catalog_manager.cc:5697] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.490211 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:49.490876 31354 raft_consensus.cc:2468] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:49.492429 31169 leader_election.cc:304] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:20:49.478787 31467 raft_consensus.cc:2804] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.489336 31400 ts_tablet_manager.cc:1434] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 12:20:49.493475 31467 raft_consensus.cc:697] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:49.486449 31409 leader_election.cc:290] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:49.497228 31399 tablet_bootstrap.cc:492] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:49.497996 31399 ts_tablet_manager.cc:1403] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.134s	user 0.007s	sys 0.009s
I20260709 12:20:49.499444 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4314d275b47a469bafd749deec419c28" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:49.500304 31464 raft_consensus.cc:2804] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.500329 31128 raft_consensus.cc:2468] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:49.501102 31464 raft_consensus.cc:493] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.501668 31464 raft_consensus.cc:3060] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.502187 31317 leader_election.cc:304] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:49.503281 31437 raft_consensus.cc:2804] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.503787 31437 raft_consensus.cc:493] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.504241 31437 raft_consensus.cc:3060] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.504510 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:49.508169 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7188da143a8e4c5fb12f21ff47aa63ea" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:49.508991 31128 raft_consensus.cc:2468] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:49.511678 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4314d275b47a469bafd749deec419c28" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:49.513439 31317 leader_election.cc:343] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.515944 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.516678 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.519179 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.520020 31204 raft_consensus.cc:2468] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:49.522550 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d247b7758c49c08c20a65227f42b52" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.523383 31204 raft_consensus.cc:2468] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:49.526520 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7188da143a8e4c5fb12f21ff47aa63ea" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.526592 31399 raft_consensus.cc:359] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.527467 31399 raft_consensus.cc:385] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.527752 31399 raft_consensus.cc:740] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
W20260709 12:20:49.528450 31243 leader_election.cc:343] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.528618 31399 consensus_queue.cc:260] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.529780 31243 leader_election.cc:304] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:49.494586 31467 consensus_queue.cc:237] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.530927 31399 ts_tablet_manager.cc:1434] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:20:49.535745 31474 raft_consensus.cc:2804] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.552054 31474 raft_consensus.cc:493] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.546239 31023 catalog_manager.cc:5697] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.552439 31474 raft_consensus.cc:3060] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.553965 31401 tablet_bootstrap.cc:492] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:49.550959 31400 tablet_bootstrap.cc:492] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:49.539311 31437 raft_consensus.cc:515] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.540967 31464 raft_consensus.cc:515] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.560933 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
W20260709 12:20:49.531226 31243 leader_election.cc:343] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.561790 31354 raft_consensus.cc:3060] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.570048 31437 leader_election.cc:290] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:49.570787 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4314d275b47a469bafd749deec419c28" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:49.571653 31128 raft_consensus.cc:3060] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.571939 31400 tablet_bootstrap.cc:654] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.572101 31464 leader_election.cc:290] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:49.573101 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:49.540654 31407 raft_consensus.cc:493] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.575690 31407 raft_consensus.cc:515] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.579003 31407 leader_election.cc:290] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:49.554702 31401 ts_tablet_manager.cc:1403] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.136s	user 0.030s	sys 0.010s
I20260709 12:20:49.581343 31128 raft_consensus.cc:2468] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:49.581004 31474 raft_consensus.cc:515] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.491767 31457 raft_consensus.cc:515] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.583425 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.583654 31354 raft_consensus.cc:2468] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:49.584877 31129 raft_consensus.cc:2393] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d5ebd798965493785b198d6e8492c23 in current term 1: Already voted for candidate e3b87862f0eb448db7779e995eb84f64 in this term.
I20260709 12:20:49.585091 31457 leader_election.cc:290] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.585109 31169 leader_election.cc:304] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:49.587450 31464 raft_consensus.cc:2804] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.588122 31401 raft_consensus.cc:359] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.585510 31026 catalog_manager.cc:5697] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.589082 31401 raft_consensus.cc:385] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.589452 31401 raft_consensus.cc:740] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.590590 31399 tablet_bootstrap.cc:492] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:49.590406 31401 consensus_queue.cc:260] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
W20260709 12:20:49.591820 31317 leader_election.cc:343] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.592509 31474 leader_election.cc:290] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.592708 31317 leader_election.cc:304] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:49.593266 31401 ts_tablet_manager.cc:1434] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:20:49.593658 31407 raft_consensus.cc:2804] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.594880 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.594527 31407 raft_consensus.cc:697] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:49.596534 31407 consensus_queue.cc:237] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.597205 31464 raft_consensus.cc:697] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:49.594451 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b8ec802808248f1bb901b81b304d5ef" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:49.598191 31464 consensus_queue.cc:237] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.598821 31354 raft_consensus.cc:2393] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e3b87862f0eb448db7779e995eb84f64 in current term 1: Already voted for candidate 1d5ebd798965493785b198d6e8492c23 in this term.
W20260709 12:20:49.600258 31243 leader_election.cc:343] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.601331 31437 raft_consensus.cc:493] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.601490 31243 leader_election.cc:304] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:49.601912 31437 raft_consensus.cc:515] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.602128 31023 catalog_manager.cc:5697] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.605443 31437 leader_election.cc:290] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.606137 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b428d9f5e1c4775a6d6ccca23e9f2fa" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.607195 31474 raft_consensus.cc:2804] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.607651 31474 raft_consensus.cc:493] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.608028 31474 raft_consensus.cc:3060] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:49.608062 31317 leader_election.cc:343] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.609633 31402 tablet_bootstrap.cc:492] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:49.616760 31402 ts_tablet_manager.cc:1403] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.211s	user 0.023s	sys 0.014s
I20260709 12:20:49.618099 31474 raft_consensus.cc:515] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.620486 31474 leader_election.cc:290] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:49.621712 31092 leader_election.cc:304] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:49.602931 31243 leader_election.cc:304] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:49.623162 31457 raft_consensus.cc:2749] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.612744 31401 tablet_bootstrap.cc:492] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:49.615479 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b428d9f5e1c4775a6d6ccca23e9f2fa" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:49.624475 31400 tablet_bootstrap.cc:492] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:49.624361 31128 raft_consensus.cc:2468] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:49.625190 31400 ts_tablet_manager.cc:1403] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.075s	user 0.018s	sys 0.004s
I20260709 12:20:49.626245 31317 leader_election.cc:304] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23
I20260709 12:20:49.615090 31399 tablet_bootstrap.cc:654] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.628115 31437 raft_consensus.cc:2804] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.628556 31437 raft_consensus.cc:493] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.629151 31437 raft_consensus.cc:3060] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.628428 31402 raft_consensus.cc:359] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.629621 31402 raft_consensus.cc:385] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.629984 31402 raft_consensus.cc:740] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.630596 31400 raft_consensus.cc:359] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.631364 31400 raft_consensus.cc:385] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.630967 31402 consensus_queue.cc:260] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.631703 31400 raft_consensus.cc:740] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.632757 31400 consensus_queue.cc:260] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.633817 31467 raft_consensus.cc:2804] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:49.634265 31467 raft_consensus.cc:493] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.634624 31467 raft_consensus.cc:3060] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:49.633649 31026 catalog_manager.cc:5697] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.639221 31437 raft_consensus.cc:515] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.642828 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b428d9f5e1c4775a6d6ccca23e9f2fa" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
W20260709 12:20:49.623363 31243 leader_election.cc:343] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.644979 31437 leader_election.cc:290] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
W20260709 12:20:49.686149 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 62832.7us
I20260709 12:20:49.654866 31399 tablet_bootstrap.cc:492] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:49.660668 31026 catalog_manager.cc:5697] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.661295 31401 tablet_bootstrap.cc:654] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.646279 31400 ts_tablet_manager.cc:1434] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.003s
I20260709 12:20:49.688346 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7188da143a8e4c5fb12f21ff47aa63ea" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:49.689078 31129 raft_consensus.cc:3060] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.689352 31400 tablet_bootstrap.cc:492] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:49.689682 31399 ts_tablet_manager.cc:1403] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.022s
I20260709 12:20:49.693127 31399 raft_consensus.cc:359] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.693868 31399 raft_consensus.cc:385] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.694170 31399 raft_consensus.cc:740] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.643518 31128 raft_consensus.cc:3060] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.695158 31399 consensus_queue.cc:260] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.697901 31399 ts_tablet_manager.cc:1434] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:20:49.643266 31467 raft_consensus.cc:515] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.709951 31457 raft_consensus.cc:493] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.724057 31457 raft_consensus.cc:515] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.712164 31277 raft_consensus.cc:3060] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.720242 31399 tablet_bootstrap.cc:492] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:49.666999 31402 ts_tablet_manager.cc:1434] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:20:49.732393 31402 tablet_bootstrap.cc:492] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:49.732461 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7188da143a8e4c5fb12f21ff47aa63ea" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.733180 31203 raft_consensus.cc:3060] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.733392 31457 leader_election.cc:290] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:49.733577 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:49.734464 31354 raft_consensus.cc:2468] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:49.735281 31399 tablet_bootstrap.cc:654] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.735826 31093 leader_election.cc:304] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:49.739380 31457 raft_consensus.cc:2804] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.740021 31457 raft_consensus.cc:493] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.740561 31457 raft_consensus.cc:3060] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.743731 31203 raft_consensus.cc:2468] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:49.745162 31402 tablet_bootstrap.cc:654] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.746474 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.747459 31202 raft_consensus.cc:3060] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.756732 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:49.757747 31127 raft_consensus.cc:3060] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.645731 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5b428d9f5e1c4775a6d6ccca23e9f2fa" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.761831 31402 tablet_bootstrap.cc:492] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
W20260709 12:20:49.761706 31317 leader_election.cc:343] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.762579 31402 ts_tablet_manager.cc:1403] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.030s	user 0.002s	sys 0.010s
I20260709 12:20:49.766746 31474 raft_consensus.cc:493] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.767407 31474 raft_consensus.cc:515] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.768086 31467 leader_election.cc:290] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:49.768384 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d247b7758c49c08c20a65227f42b52" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:49.769152 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4314d275b47a469bafd749deec419c28" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:49.769630 31474 leader_election.cc:290] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.775221 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:49.766396 31402 raft_consensus.cc:359] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.776072 31402 raft_consensus.cc:385] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.776388 31402 raft_consensus.cc:740] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.777269 31402 consensus_queue.cc:260] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.778574 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d247b7758c49c08c20a65227f42b52" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.779626 31204 raft_consensus.cc:3060] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:49.780737 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:49.783946 31127 raft_consensus.cc:2468] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:49.786154 31402 ts_tablet_manager.cc:1434] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:20:49.787485 31402 tablet_bootstrap.cc:492] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:49.787933 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f018fab4f8f24dc18b24bf29b839f828" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.788712 31203 raft_consensus.cc:2468] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
W20260709 12:20:49.790269 31317 leader_election.cc:343] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.791188 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:49.791821 31317 leader_election.cc:343] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.792210 31278 raft_consensus.cc:2468] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:49.792532 31317 leader_election.cc:304] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:49.793725 31437 raft_consensus.cc:2749] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:49.794144 31243 leader_election.cc:304] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:49.795357 31474 raft_consensus.cc:2804] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.795601 31243 leader_election.cc:304] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:49.795904 31474 raft_consensus.cc:697] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:49.797240 31474 consensus_queue.cc:237] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.801720 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f018fab4f8f24dc18b24bf29b839f828" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:49.802553 31127 raft_consensus.cc:2468] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:49.804733 31202 raft_consensus.cc:2468] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:49.805437 31129 raft_consensus.cc:2468] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:49.808604 31402 tablet_bootstrap.cc:654] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.809348 31474 raft_consensus.cc:2804] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.809953 31474 raft_consensus.cc:493] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.810515 31474 raft_consensus.cc:3060] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.810451 31026 catalog_manager.cc:5697] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.825520 31243 leader_election.cc:304] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:49.826833 31467 raft_consensus.cc:2804] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.827482 31467 raft_consensus.cc:697] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:49.828469 31467 consensus_queue.cc:237] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.829701 31204 raft_consensus.cc:2468] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 2.
I20260709 12:20:49.844105 31400 tablet_bootstrap.cc:654] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.847237 31401 tablet_bootstrap.cc:492] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:49.847968 31401 ts_tablet_manager.cc:1403] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.237s	user 0.041s	sys 0.061s
I20260709 12:20:49.861724 31457 raft_consensus.cc:515] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.863116 31128 raft_consensus.cc:2468] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:49.852420 31243 leader_election.cc:304] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:49.864950 31317 leader_election.cc:304] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23
I20260709 12:20:49.866248 31437 raft_consensus.cc:2804] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.867249 31437 raft_consensus.cc:697] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:49.868109 31457 leader_election.cc:290] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:49.868381 31437 consensus_queue.cc:237] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.866614 31474 raft_consensus.cc:515] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.870798 31399 tablet_bootstrap.cc:492] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:49.869954 31401 raft_consensus.cc:359] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.871481 31399 ts_tablet_manager.cc:1403] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.172s	user 0.042s	sys 0.067s
I20260709 12:20:49.871552 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:49.873268 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f018fab4f8f24dc18b24bf29b839f828" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:49.873596 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:49.873991 31129 raft_consensus.cc:3060] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.874320 31278 raft_consensus.cc:3060] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.876372 31400 tablet_bootstrap.cc:492] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:49.876932 31400 ts_tablet_manager.cc:1403] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.188s	user 0.012s	sys 0.007s
I20260709 12:20:49.876718 31399 raft_consensus.cc:359] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.877468 31399 raft_consensus.cc:385] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.877766 31399 raft_consensus.cc:740] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.878556 31399 consensus_queue.cc:260] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.879282 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f018fab4f8f24dc18b24bf29b839f828" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.873592 31354 raft_consensus.cc:3060] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.880002 31204 raft_consensus.cc:3060] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.871963 31401 raft_consensus.cc:385] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.882563 31401 raft_consensus.cc:740] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.871349 31467 raft_consensus.cc:2804] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:49.879460 31457 raft_consensus.cc:493] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:49.872488 31474 leader_election.cc:290] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:49.885246 31402 tablet_bootstrap.cc:492] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:49.885982 31402 ts_tablet_manager.cc:1403] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.099s	user 0.018s	sys 0.003s
I20260709 12:20:49.886758 31129 raft_consensus.cc:2468] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:49.884097 31457 raft_consensus.cc:515] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.888334 31243 leader_election.cc:304] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:49.889300 31457 leader_election.cc:290] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:49.889770 31402 raft_consensus.cc:359] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.890165 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:49.890326 31474 raft_consensus.cc:2804] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.883945 31401 consensus_queue.cc:260] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.890849 31202 raft_consensus.cc:2468] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:49.892223 31354 raft_consensus.cc:2468] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:49.892663 31278 raft_consensus.cc:2468] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:49.892799 31092 leader_election.cc:304] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:49.893208 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:49.894181 31457 raft_consensus.cc:2804] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:49.894827 31457 raft_consensus.cc:493] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:49.894949 31093 leader_election.cc:304] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:49.883426 31467 raft_consensus.cc:697] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:49.895339 31457 raft_consensus.cc:3060] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.896378 31402 raft_consensus.cc:385] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.897537 31402 raft_consensus.cc:740] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.898351 31402 consensus_queue.cc:260] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:49.896389 31467 consensus_queue.cc:237] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.901854 31204 raft_consensus.cc:2468] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:49.904772 31457 raft_consensus.cc:515] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.904556 31026 catalog_manager.cc:5697] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.894996 31399 ts_tablet_manager.cc:1434] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:20:49.907320 31472 raft_consensus.cc:2804] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.907353 31457 leader_election.cc:290] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:49.908068 31472 raft_consensus.cc:697] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:49.908430 31204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:49.908876 31472 consensus_queue.cc:237] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.909192 31204 raft_consensus.cc:3060] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.912818 31474 raft_consensus.cc:697] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:49.914019 31399 tablet_bootstrap.cc:492] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:49.913892 31474 consensus_queue.cc:237] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:49.917312 31401 ts_tablet_manager.cc:1434] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.001s
I20260709 12:20:49.918591 31401 tablet_bootstrap.cc:492] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
W20260709 12:20:49.925794 31092 leader_election.cc:343] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.929859 31401 tablet_bootstrap.cc:654] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.930728 31354 raft_consensus.cc:3060] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:49.932833 31400 raft_consensus.cc:359] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.933990 31400 raft_consensus.cc:385] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:49.934196 31400 raft_consensus.cc:740] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:49.932325 31402 ts_tablet_manager.cc:1434] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.046s	user 0.009s	sys 0.000s
I20260709 12:20:49.935180 31400 consensus_queue.cc:260] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:49.937655 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:49.943482 31400 ts_tablet_manager.cc:1434] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.066s	user 0.009s	sys 0.001s
I20260709 12:20:49.945013 31400 tablet_bootstrap.cc:492] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:49.946123 31420 consensus_queue.cc:1048] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:49.948838 31202 raft_consensus.cc:1240] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Rejecting Update request from peer 9800423c0012421d9ce299e8c180ac96 for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:49.951191 31437 consensus_queue.cc:1059] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:49.952064 31407 raft_consensus.cc:3055] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:49.952432 31407 raft_consensus.cc:740] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:49.953433 31407 consensus_queue.cc:260] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:49.954787 31407 raft_consensus.cc:3060] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:20:49.962205 31092 leader_election.cc:343] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:49.966717 31402 tablet_bootstrap.cc:492] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:49.964246 31472 consensus_queue.cc:1048] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:20:49.980345 31399 tablet_bootstrap.cc:654] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:49.982450 31023 catalog_manager.cc:5697] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:49.986896 31400 tablet_bootstrap.cc:654] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:49.972095 31243 consensus_peers.cc:597] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:49.994659 31026 catalog_manager.cc:5697] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:49.996327 31204 raft_consensus.cc:2468] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:49.998204 31092 leader_election.cc:304] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:49.999208 31472 raft_consensus.cc:2804] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:49.999747 31472 raft_consensus.cc:697] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:50.000720 31472 consensus_queue.cc:237] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.001466 31402 tablet_bootstrap.cc:654] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.021992 31474 raft_consensus.cc:493] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.022908 31474 raft_consensus.cc:515] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.025996 31474 leader_election.cc:290] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:50.027124 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4314d275b47a469bafd749deec419c28" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:50.029706 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4314d275b47a469bafd749deec419c28" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:50.033253 31129 raft_consensus.cc:2393] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee8bcffe388e4e0796bc17d15b7adcde in current term 1: Already voted for candidate 9800423c0012421d9ce299e8c180ac96 in this term.
I20260709 12:20:50.035949 31399 tablet_bootstrap.cc:492] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:50.036163 31474 consensus_queue.cc:1048] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.036738 31399 ts_tablet_manager.cc:1403] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.123s	user 0.023s	sys 0.009s
I20260709 12:20:50.038636 31243 leader_election.cc:304] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:50.041751 31474 raft_consensus.cc:3060] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.045825 31399 raft_consensus.cc:359] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.047199 31399 raft_consensus.cc:385] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.047557 31399 raft_consensus.cc:740] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.051069 31399 consensus_queue.cc:260] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.056298 31402 tablet_bootstrap.cc:492] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:50.057467 31402 ts_tablet_manager.cc:1403] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.094s	user 0.018s	sys 0.008s
I20260709 12:20:50.059880 31023 catalog_manager.cc:5697] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:50.071295 31025 catalog_manager.cc:5697] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:50.073525 31407 consensus_queue.cc:1048] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.073480 31025 catalog_manager.cc:5697] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 1 to 2, leader changed from 9800423c0012421d9ce299e8c180ac96 (127.22.93.196) to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 2 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:50.075608 31399 ts_tablet_manager.cc:1434] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 12:20:50.077440 31474 raft_consensus.cc:2749] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.091518 31437 consensus_queue.cc:1048] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.097380 31399 tablet_bootstrap.cc:492] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:50.094662 31127 raft_consensus.cc:3060] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.118878 31400 tablet_bootstrap.cc:492] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:50.119715 31400 ts_tablet_manager.cc:1403] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.175s	user 0.021s	sys 0.006s
I20260709 12:20:50.124584 31400 raft_consensus.cc:359] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.125392 31400 raft_consensus.cc:385] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.126452 31400 raft_consensus.cc:740] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.124877 31402 raft_consensus.cc:359] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.127374 31402 raft_consensus.cc:385] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.128381 31400 consensus_queue.cc:260] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.127589 31402 raft_consensus.cc:740] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.134501 31400 ts_tablet_manager.cc:1434] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.002s
I20260709 12:20:50.135862 31399 tablet_bootstrap.cc:654] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.145843 31400 tablet_bootstrap.cc:492] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:50.147145 31464 consensus_queue.cc:1048] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.152595 31437 consensus_queue.cc:1048] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.156564 31400 tablet_bootstrap.cc:654] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.157160 31401 tablet_bootstrap.cc:492] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:50.158808 31401 ts_tablet_manager.cc:1403] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.241s	user 0.030s	sys 0.047s
I20260709 12:20:50.157605 31402 consensus_queue.cc:260] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.169010 31402 ts_tablet_manager.cc:1434] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.111s	user 0.007s	sys 0.001s
I20260709 12:20:50.174629 31401 raft_consensus.cc:359] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.175750 31401 raft_consensus.cc:385] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.176183 31401 raft_consensus.cc:740] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.174842 31464 consensus_queue.cc:1048] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:20:50.182286 31472 raft_consensus.cc:493] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.188830 31472 raft_consensus.cc:515] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.189966 31399 tablet_bootstrap.cc:492] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:50.190604 31399 ts_tablet_manager.cc:1403] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.094s	user 0.018s	sys 0.018s
I20260709 12:20:50.191442 31472 leader_election.cc:290] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:50.193811 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c71bd7869d948b4bc36991abb4b71a5" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:50.195489 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c71bd7869d948b4bc36991abb4b71a5" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:50.195858 31401 consensus_queue.cc:260] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.196408 31399 raft_consensus.cc:359] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.197269 31399 raft_consensus.cc:385] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.197583 31399 raft_consensus.cc:740] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.199107 31401 ts_tablet_manager.cc:1434] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 12:20:50.198756 31399 consensus_queue.cc:260] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.202052 31399 ts_tablet_manager.cc:1434] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:20:50.203652 31399 tablet_bootstrap.cc:492] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
W20260709 12:20:50.204131 31092 leader_election.cc:343] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:50.205906 31093 leader_election.cc:343] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.206593 31093 leader_election.cc:304] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:50.208274 31472 raft_consensus.cc:2749] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.217459 31399 tablet_bootstrap.cc:654] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.221369 31401 tablet_bootstrap.cc:492] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:50.251286 31401 tablet_bootstrap.cc:654] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.253322 31400 tablet_bootstrap.cc:492] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:50.254277 31400 ts_tablet_manager.cc:1403] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.109s	user 0.029s	sys 0.029s
I20260709 12:20:50.237268 31512 raft_consensus.cc:493] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.259591 31512 raft_consensus.cc:515] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.262419 31437 raft_consensus.cc:493] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.265699 31437 raft_consensus.cc:515] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.264855 31512 leader_election.cc:290] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:50.266410 31409 consensus_queue.cc:1048] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:50.266393 31402 tablet_bootstrap.cc:492] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:50.268092 31437 leader_election.cc:290] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:50.272735 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ec895126a540df9c9474a9dd420991" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
W20260709 12:20:50.278525 31168 leader_election.cc:343] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.286803 31400 raft_consensus.cc:359] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.287941 31400 raft_consensus.cc:385] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.288319 31400 raft_consensus.cc:740] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.289184 31400 consensus_queue.cc:260] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.313903 31402 tablet_bootstrap.cc:654] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.317435 31400 ts_tablet_manager.cc:1434] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.001s
I20260709 12:20:50.319483 31400 tablet_bootstrap.cc:492] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:50.324326 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead9af52f3cb440a823ab640a53caa2d" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:50.325107 31409 raft_consensus.cc:493] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.325757 31409 raft_consensus.cc:515] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.327466 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead9af52f3cb440a823ab640a53caa2d" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:50.328598 31400 tablet_bootstrap.cc:654] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.334170 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:50.335335 31399 tablet_bootstrap.cc:492] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:50.335523 31354 raft_consensus.cc:2468] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:50.335909 31399 ts_tablet_manager.cc:1403] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.133s	user 0.027s	sys 0.024s
I20260709 12:20:50.336665 31474 consensus_queue.cc:1048] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:50.337236 31244 leader_election.cc:304] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:50.338267 31474 raft_consensus.cc:2804] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.338686 31474 raft_consensus.cc:493] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.329682 31409 leader_election.cc:290] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:50.339135 31474 raft_consensus.cc:3060] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.340986 31399 raft_consensus.cc:359] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.341746 31399 raft_consensus.cc:385] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.342034 31399 raft_consensus.cc:740] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.330392 31464 raft_consensus.cc:493] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.343367 31464 raft_consensus.cc:515] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.342823 31399 consensus_queue.cc:260] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.353298 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:50.354216 31202 raft_consensus.cc:2468] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:50.359069 31399 ts_tablet_manager.cc:1434] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:20:50.365221 31522 raft_consensus.cc:493] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.366043 31522 raft_consensus.cc:515] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.366254 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:50.368587 31522 leader_election.cc:290] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:50.369683 31518 consensus_queue.cc:1048] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:20:50.371445 31354 raft_consensus.cc:1275] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer ee8bcffe388e4e0796bc17d15b7adcde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:20:50.371887 31354 pending_rounds.cc:85] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96: Aborting all ops after (but not including) 0
I20260709 12:20:50.372136 31354 pending_rounds.cc:107] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:20:50.372452 31354 raft_consensus.cc:2889] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:20:50.373780 31317 leader_election.cc:343] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.375319 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f5e32511d244df9299237b280d2405" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:50.363047 31525 raft_consensus.cc:493] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.385579 31399 tablet_bootstrap.cc:492] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:50.390008 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f5e32511d244df9299237b280d2405" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:50.390944 31277 raft_consensus.cc:2468] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:50.390944 31467 consensus_queue.cc:1048] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:50.395044 31168 leader_election.cc:343] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.396302 31168 leader_election.cc:304] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:50.399036 31522 raft_consensus.cc:2804] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.399628 31522 raft_consensus.cc:493] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.400108 31522 raft_consensus.cc:3060] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.400919 31400 tablet_bootstrap.cc:492] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:50.401508 31400 ts_tablet_manager.cc:1403] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.025s
I20260709 12:20:50.397823 31202 raft_consensus.cc:1275] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer ee8bcffe388e4e0796bc17d15b7adcde: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:20:50.405413 31400 raft_consensus.cc:359] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.406241 31400 raft_consensus.cc:385] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.406553 31400 raft_consensus.cc:740] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.407393 31400 consensus_queue.cc:260] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.408901 31467 consensus_queue.cc:1048] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.387909 31525 raft_consensus.cc:515] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.393555 31464 leader_election.cc:290] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
W20260709 12:20:50.429550 31317 leader_election.cc:343] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.444743 31399 tablet_bootstrap.cc:654] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.446250 31400 ts_tablet_manager.cc:1434] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.044s	user 0.021s	sys 0.008s
I20260709 12:20:50.451586 31530 consensus_queue.cc:1048] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.453084 31400 tablet_bootstrap.cc:492] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:50.453735 31401 tablet_bootstrap.cc:492] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:50.454339 31401 ts_tablet_manager.cc:1403] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.233s	user 0.023s	sys 0.018s
I20260709 12:20:50.456845 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:50.458351 31401 raft_consensus.cc:359] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.459803 31401 raft_consensus.cc:385] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.460157 31401 raft_consensus.cc:740] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.460637 31402 tablet_bootstrap.cc:492] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:50.461172 31402 ts_tablet_manager.cc:1403] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.195s	user 0.028s	sys 0.021s
I20260709 12:20:50.461056 31401 consensus_queue.cc:260] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.461673 31474 raft_consensus.cc:515] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.463495 31279 raft_consensus.cc:2393] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d5ebd798965493785b198d6e8492c23 in current term 1: Already voted for candidate ee8bcffe388e4e0796bc17d15b7adcde in this term.
I20260709 12:20:50.446321 31525 leader_election.cc:290] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:50.468344 31400 tablet_bootstrap.cc:654] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.468976 31401 ts_tablet_manager.cc:1434] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.001s
W20260709 12:20:50.469110 31526 log.cc:927] Time spent T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Append to log took a long time: real 0.112s	user 0.004s	sys 0.000s
I20260709 12:20:50.470382 31401 tablet_bootstrap.cc:492] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:50.445185 31317 leader_election.cc:304] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
W20260709 12:20:50.472692 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 44644.1us
I20260709 12:20:50.474054 31534 consensus_queue.cc:1048] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.474598 31420 consensus_queue.cc:1048] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:50.485667 31317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 64378.1us
I20260709 12:20:50.490448 31402 raft_consensus.cc:359] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.491636 31402 raft_consensus.cc:385] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.492057 31402 raft_consensus.cc:740] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.493075 31402 consensus_queue.cc:260] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.500584 31524 raft_consensus.cc:2749] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.501269 31401 tablet_bootstrap.cc:654] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.445442 31467 consensus_queue.cc:1048] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.050s
I20260709 12:20:50.507733 31402 ts_tablet_manager.cc:1434] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.046s	user 0.010s	sys 0.000s
I20260709 12:20:50.489404 31472 consensus_queue.cc:1048] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20260709 12:20:50.519497 31474 leader_election.cc:290] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:50.519332 31524 consensus_queue.cc:1048] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:20:50.537007 31522 raft_consensus.cc:515] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.538456 31472 consensus_queue.cc:1048] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.543604 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f5e32511d244df9299237b280d2405" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:50.543769 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ec895126a540df9c9474a9dd420991" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:50.544759 31350 raft_consensus.cc:2468] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:50.547660 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:50.548568 31354 raft_consensus.cc:2468] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:50.549038 31522 leader_election.cc:290] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:50.550141 31402 tablet_bootstrap.cc:492] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:20:50.551013 31168 leader_election.cc:343] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.553056 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:50.555721 31169 leader_election.cc:304] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
W20260709 12:20:50.556051 31317 consensus_peers.cc:597] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.557310 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:50.558223 31354 raft_consensus.cc:3060] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.560233 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f5e32511d244df9299237b280d2405" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:50.570322 31522 raft_consensus.cc:2804] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.573830 31278 raft_consensus.cc:3060] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.578442 31169 leader_election.cc:304] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:50.580130 31464 raft_consensus.cc:2804] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.580592 31464 raft_consensus.cc:493] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.580996 31464 raft_consensus.cc:3060] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.581835 31203 raft_consensus.cc:3060] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.576828 31522 raft_consensus.cc:493] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.583488 31522 raft_consensus.cc:3060] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.573850 31168 leader_election.cc:304] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:50.585235 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:50.593438 31522 raft_consensus.cc:515] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
W20260709 12:20:50.598356 31092 consensus_peers.cc:597] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:50.599346 31534 consensus_queue.cc:1048] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:50.602967 31399 tablet_bootstrap.cc:492] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:50.609858 31399 ts_tablet_manager.cc:1403] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.232s	user 0.027s	sys 0.007s
I20260709 12:20:50.611260 31402 tablet_bootstrap.cc:654] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.606938 31278 raft_consensus.cc:2468] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:50.631489 31400 tablet_bootstrap.cc:492] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:50.631227 31354 raft_consensus.cc:2468] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:50.633778 31400 ts_tablet_manager.cc:1403] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.181s	user 0.018s	sys 0.016s
I20260709 12:20:50.636471 31401 tablet_bootstrap.cc:492] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:50.639925 31401 ts_tablet_manager.cc:1403] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.170s	user 0.015s	sys 0.011s
I20260709 12:20:50.642602 31168 leader_election.cc:304] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:50.644716 31512 raft_consensus.cc:2804] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:50.654481 31401 raft_consensus.cc:359] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.655350 31401 raft_consensus.cc:385] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.655618 31401 raft_consensus.cc:740] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.656361 31401 consensus_queue.cc:260] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.658572 31399 raft_consensus.cc:359] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.659238 31399 raft_consensus.cc:385] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.652390 31244 leader_election.cc:304] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:50.659723 31399 raft_consensus.cc:740] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.660331 31534 raft_consensus.cc:2804] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:50.660869 31534 raft_consensus.cc:697] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:50.660583 31399 consensus_queue.cc:260] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.661976 31534 consensus_queue.cc:237] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.663328 31399 ts_tablet_manager.cc:1434] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:20:50.664003 31512 raft_consensus.cc:697] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:50.664611 31399 tablet_bootstrap.cc:492] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:50.665058 31512 consensus_queue.cc:237] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.682458 31522 leader_election.cc:290] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:50.685128 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ec895126a540df9c9474a9dd420991" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
W20260709 12:20:50.687143 31168 leader_election.cc:343] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.689769 31399 tablet_bootstrap.cc:654] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.691010 31401 ts_tablet_manager.cc:1434] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:20:50.702042 31400 raft_consensus.cc:359] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.703500 31400 raft_consensus.cc:385] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.704175 31400 raft_consensus.cc:740] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.715384 31407 raft_consensus.cc:493] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.716117 31407 raft_consensus.cc:515] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.720407 31407 leader_election.cc:290] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:50.722281 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ec895126a540df9c9474a9dd420991" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:50.722600 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ad8a458c2403a9dbdd50be2fd763d" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:50.730285 31401 tablet_bootstrap.cc:492] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:50.727897 31352 raft_consensus.cc:3060] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.724025 31472 raft_consensus.cc:493] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.736830 31472 raft_consensus.cc:515] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.718209 31464 raft_consensus.cc:515] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.750002 31400 consensus_queue.cc:260] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.762449 31201 raft_consensus.cc:2393] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee8bcffe388e4e0796bc17d15b7adcde in current term 1: Already voted for candidate 1d5ebd798965493785b198d6e8492c23 in this term.
I20260709 12:20:50.766829 31401 tablet_bootstrap.cc:654] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:50.750926 31317 leader_election.cc:343] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.769380 31472 leader_election.cc:290] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:50.785704 31400 ts_tablet_manager.cc:1434] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.146s	user 0.008s	sys 0.000s
I20260709 12:20:50.787417 31400 tablet_bootstrap.cc:492] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:50.787992 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:50.789825 31093 leader_election.cc:343] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.797652 31399 tablet_bootstrap.cc:492] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:50.798583 31399 ts_tablet_manager.cc:1403] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.134s	user 0.033s	sys 0.036s
I20260709 12:20:50.828712 31464 leader_election.cc:290] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:50.830852 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:50.841120 31402 tablet_bootstrap.cc:492] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:50.841822 31402 ts_tablet_manager.cc:1403] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.313s	user 0.027s	sys 0.044s
I20260709 12:20:50.842056 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ad8a458c2403a9dbdd50be2fd763d" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:50.842904 31278 raft_consensus.cc:2468] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:50.843184 31536 raft_consensus.cc:2749] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.844012 31400 tablet_bootstrap.cc:654] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.845609 31352 raft_consensus.cc:2468] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:50.847311 31169 leader_election.cc:304] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:50.848821 31536 raft_consensus.cc:2804] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:50.849426 31536 raft_consensus.cc:697] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:50.849431 31399 raft_consensus.cc:359] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.850593 31399 raft_consensus.cc:385] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.851058 31536 consensus_queue.cc:237] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.855573 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:50.858115 31399 raft_consensus.cc:740] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.864621 31399 consensus_queue.cc:260] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.868309 31317 leader_election.cc:304] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:50.869406 31407 raft_consensus.cc:2804] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.866014 31026 catalog_manager.cc:5697] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:50.859503 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f29500f45e14bf3b37916af7a3f4982" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:50.871771 31407 raft_consensus.cc:493] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.876791 31407 raft_consensus.cc:3060] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.876888 31354 raft_consensus.cc:2393] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1d5ebd798965493785b198d6e8492c23 in current term 1: Already voted for candidate ee8bcffe388e4e0796bc17d15b7adcde in this term.
W20260709 12:20:50.869421 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:50.887351 31399 ts_tablet_manager.cc:1434] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.088s	user 0.012s	sys 0.000s
I20260709 12:20:50.891547 31402 raft_consensus.cc:359] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.892251 31402 raft_consensus.cc:385] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.892514 31402 raft_consensus.cc:740] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.895087 31402 consensus_queue.cc:260] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
W20260709 12:20:50.895448 31552 log.cc:927] Time spent T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:20:50.899981 31169 leader_election.cc:304] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:50.901263 31401 tablet_bootstrap.cc:492] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:50.901922 31401 ts_tablet_manager.cc:1403] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.172s	user 0.025s	sys 0.019s
I20260709 12:20:50.901819 31464 raft_consensus.cc:2749] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.903107 31402 ts_tablet_manager.cc:1434] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.061s	user 0.011s	sys 0.000s
I20260709 12:20:50.901163 31203 raft_consensus.cc:3060] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.904424 31402 tablet_bootstrap.cc:492] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:20:50.908524 31092 leader_election.cc:343] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.909283 31092 leader_election.cc:304] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:50.910558 31554 raft_consensus.cc:2749] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:50.914345 31402 tablet_bootstrap.cc:654] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.915846 31407 raft_consensus.cc:515] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.925719 31531 raft_consensus.cc:493] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.926426 31531 raft_consensus.cc:515] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.927531 31400 tablet_bootstrap.cc:492] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:50.928364 31400 ts_tablet_manager.cc:1403] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.141s	user 0.021s	sys 0.035s
I20260709 12:20:50.930344 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead9af52f3cb440a823ab640a53caa2d" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:50.931180 31352 raft_consensus.cc:2468] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:50.932737 31244 leader_election.cc:304] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:50.933748 31534 raft_consensus.cc:2804] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:50.933522 31401 raft_consensus.cc:359] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.934154 31534 raft_consensus.cc:493] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:50.934356 31401 raft_consensus.cc:385] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.934542 31534 raft_consensus.cc:3060] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.932410 31399 tablet_bootstrap.cc:492] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:50.934669 31401 raft_consensus.cc:740] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.938194 31407 leader_election.cc:290] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:50.943500 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ad8a458c2403a9dbdd50be2fd763d" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:50.944417 31277 raft_consensus.cc:3060] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:50.945734 31399 tablet_bootstrap.cc:654] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:50.939739 31401 consensus_queue.cc:260] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:50.937644 31531 leader_election.cc:290] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:50.948073 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead9af52f3cb440a823ab640a53caa2d" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:50.948406 31534 raft_consensus.cc:515] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.949896 31401 ts_tablet_manager.cc:1434] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.002s
I20260709 12:20:50.951169 31401 tablet_bootstrap.cc:492] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:50.952273 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead9af52f3cb440a823ab640a53caa2d" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:50.952929 31352 raft_consensus.cc:3060] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:50.953713 31243 leader_election.cc:343] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.963430 31400 raft_consensus.cc:359] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.964751 31400 raft_consensus.cc:385] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.965220 31400 raft_consensus.cc:740] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.959847 31534 leader_election.cc:290] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:50.967384 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ad8a458c2403a9dbdd50be2fd763d" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:50.964617 31536 raft_consensus.cc:493] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:50.968627 31536 raft_consensus.cc:515] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
W20260709 12:20:50.968973 31317 leader_election.cc:343] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.970031 31402 tablet_bootstrap.cc:492] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:50.970628 31402 ts_tablet_manager.cc:1403] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.066s	user 0.020s	sys 0.009s
I20260709 12:20:50.972321 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:50.975244 31402 raft_consensus.cc:359] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.976133 31402 raft_consensus.cc:385] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.976500 31402 raft_consensus.cc:740] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.978255 31402 consensus_queue.cc:260] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:50.979422 31401 tablet_bootstrap.cc:654] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:50.980590 31168 leader_election.cc:343] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.981446 31402 ts_tablet_manager.cc:1434] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.011s	user 0.011s	sys 0.000s
I20260709 12:20:50.981735 31400 consensus_queue.cc:260] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:50.982702 31402 tablet_bootstrap.cc:492] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:50.983402 31352 raft_consensus.cc:2468] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:50.985777 31399 tablet_bootstrap.cc:492] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:50.986199 31399 ts_tablet_manager.cc:1403] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.001s
I20260709 12:20:50.984630 31244 leader_election.cc:304] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:50.988971 31536 leader_election.cc:290] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:50.989562 31399 raft_consensus.cc:359] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.990334 31399 raft_consensus.cc:385] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:50.990612 31399 raft_consensus.cc:740] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:50.991408 31531 raft_consensus.cc:2804] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:50.991348 31399 consensus_queue.cc:260] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.992319 31531 raft_consensus.cc:697] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:50.993446 31531 consensus_queue.cc:237] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:50.995186 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead9af52f3cb440a823ab640a53caa2d" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:50.995905 31399 ts_tablet_manager.cc:1434] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:20:50.997229 31399 tablet_bootstrap.cc:492] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
W20260709 12:20:50.997745 31243 leader_election.cc:343] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:50.999267 31277 raft_consensus.cc:2468] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:51.001498 31402 tablet_bootstrap.cc:654] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.003576 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.005009 31317 leader_election.cc:304] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:51.017660 31524 raft_consensus.cc:2804] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.018245 31524 raft_consensus.cc:697] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
W20260709 12:20:51.019062 31169 leader_election.cc:343] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.019661 31169 leader_election.cc:304] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:51.020673 31536 raft_consensus.cc:2749] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.005381 31401 tablet_bootstrap.cc:492] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:51.019280 31524 consensus_queue.cc:237] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.021615 31399 tablet_bootstrap.cc:654] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.008847 31400 ts_tablet_manager.cc:1434] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.080s	user 0.008s	sys 0.002s
I20260709 12:20:51.024224 31400 tablet_bootstrap.cc:492] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:51.027637 31401 ts_tablet_manager.cc:1403] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.004s
I20260709 12:20:51.033751 31400 tablet_bootstrap.cc:654] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.037004 31399 tablet_bootstrap.cc:492] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:51.037531 31399 ts_tablet_manager.cc:1403] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.000s
I20260709 12:20:51.037549 31401 raft_consensus.cc:359] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.038805 31401 raft_consensus.cc:385] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.042009 31401 raft_consensus.cc:740] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.041143 31399 raft_consensus.cc:359] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.043056 31402 tablet_bootstrap.cc:492] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:51.043440 31399 raft_consensus.cc:385] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.043862 31402 ts_tablet_manager.cc:1403] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.061s	user 0.017s	sys 0.000s
I20260709 12:20:51.044153 31399 raft_consensus.cc:740] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.045200 31399 consensus_queue.cc:260] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.042817 31401 consensus_queue.cc:260] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.047355 31400 tablet_bootstrap.cc:492] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:51.047423 31402 raft_consensus.cc:359] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.048038 31400 ts_tablet_manager.cc:1403] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 12:20:51.048242 31402 raft_consensus.cc:385] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.048537 31402 raft_consensus.cc:740] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.049281 31402 consensus_queue.cc:260] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.052094 31402 ts_tablet_manager.cc:1434] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:20:51.051738 31400 raft_consensus.cc:359] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.052587 31400 raft_consensus.cc:385] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.052878 31400 raft_consensus.cc:740] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.053311 31402 tablet_bootstrap.cc:492] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:51.053795 31400 consensus_queue.cc:260] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.056373 31400 ts_tablet_manager.cc:1434] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:20:51.056764 31399 ts_tablet_manager.cc:1434] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:20:51.057632 31400 tablet_bootstrap.cc:492] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:51.057996 31399 tablet_bootstrap.cc:492] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:51.059299 31536 raft_consensus.cc:493] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.059897 31536 raft_consensus.cc:515] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.060962 31402 tablet_bootstrap.cc:654] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.064010 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c71bd7869d948b4bc36991abb4b71a5" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:51.064780 31129 raft_consensus.cc:2468] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:51.065570 31399 tablet_bootstrap.cc:654] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.065629 31400 tablet_bootstrap.cc:654] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.066929 31536 leader_election.cc:290] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:51.068297 31401 ts_tablet_manager.cc:1434] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.004s
I20260709 12:20:51.092375 31401 tablet_bootstrap.cc:492] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:51.072237 31168 leader_election.cc:304] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:51.078094 31400 tablet_bootstrap.cc:492] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:51.099946 31400 ts_tablet_manager.cc:1403] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.043s	user 0.016s	sys 0.003s
I20260709 12:20:51.081012 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c71bd7869d948b4bc36991abb4b71a5" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.090727 31402 tablet_bootstrap.cc:492] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:51.101145 31401 tablet_bootstrap.cc:654] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.102147 31402 ts_tablet_manager.cc:1403] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.049s	user 0.018s	sys 0.003s
I20260709 12:20:51.106117 31352 raft_consensus.cc:2468] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:51.105528 31023 catalog_manager.cc:5697] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.100466 31024 catalog_manager.cc:5697] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.103601 31536 raft_consensus.cc:2804] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.111326 31536 raft_consensus.cc:493] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.114121 31402 raft_consensus.cc:359] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.114902 31402 raft_consensus.cc:385] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.115288 31402 raft_consensus.cc:740] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.114965 31536 raft_consensus.cc:3060] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.116114 31402 consensus_queue.cc:260] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.121184 31402 ts_tablet_manager.cc:1434] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:20:51.121666 31399 tablet_bootstrap.cc:492] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:51.122309 31399 ts_tablet_manager.cc:1403] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.016s
I20260709 12:20:51.127414 31399 raft_consensus.cc:359] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.135016 31402 tablet_bootstrap.cc:492] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:51.135517 31536 raft_consensus.cc:515] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.137192 31399 raft_consensus.cc:385] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.137622 31399 raft_consensus.cc:740] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.138372 31399 consensus_queue.cc:260] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.141683 31399 ts_tablet_manager.cc:1434] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:20:51.142787 31399 tablet_bootstrap.cc:492] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:51.147790 31402 tablet_bootstrap.cc:654] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.150040 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c71bd7869d948b4bc36991abb4b71a5" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:51.155313 31554 raft_consensus.cc:493] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.152581 31536 leader_election.cc:290] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:51.152951 31399 tablet_bootstrap.cc:654] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.153332 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c71bd7869d948b4bc36991abb4b71a5" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:51.153628 31400 raft_consensus.cc:359] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.152145 31464 raft_consensus.cc:493] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.155611 31354 raft_consensus.cc:3060] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.157218 31400 raft_consensus.cc:385] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.158385 31400 raft_consensus.cc:740] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.159823 31464 raft_consensus.cc:515] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.160372 31420 raft_consensus.cc:493] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.160064 31400 consensus_queue.cc:260] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.160892 31420 raft_consensus.cc:515] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.161981 31400 ts_tablet_manager.cc:1434] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260709 12:20:51.160166 31531 consensus_queue.cc:1048] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.162271 31464 leader_election.cc:290] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:51.163224 31400 tablet_bootstrap.cc:492] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:51.163486 31129 raft_consensus.cc:3060] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.164108 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d6fce6e6745b4952d035e0ceccd49" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:51.165858 31168 leader_election.cc:343] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.168421 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d6fce6e6745b4952d035e0ceccd49" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:51.170001 31169 leader_election.cc:343] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.169920 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ec895126a540df9c9474a9dd420991" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.170586 31169 leader_election.cc:304] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:51.171324 31400 tablet_bootstrap.cc:654] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.171167 31420 leader_election.cc:290] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:51.172770 31401 tablet_bootstrap.cc:492] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:51.172206 31351 raft_consensus.cc:2393] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b87862f0eb448db7779e995eb84f64 in current term 1: Already voted for candidate 1d5ebd798965493785b198d6e8492c23 in this term.
I20260709 12:20:51.173286 31026 catalog_manager.cc:5697] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.172421 31531 raft_consensus.cc:493] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.176074 31531 raft_consensus.cc:515] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.174113 31464 raft_consensus.cc:2749] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.181854 31401 ts_tablet_manager.cc:1403] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.090s	user 0.041s	sys 0.018s
I20260709 12:20:51.156275 31554 raft_consensus.cc:515] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.186424 31401 raft_consensus.cc:359] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.187165 31401 raft_consensus.cc:385] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.187584 31401 raft_consensus.cc:740] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.188050 31129 raft_consensus.cc:2468] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:51.188566 31401 consensus_queue.cc:260] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.189469 31168 leader_election.cc:304] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:51.190428 31464 raft_consensus.cc:2804] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.190896 31464 raft_consensus.cc:697] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:51.191331 31401 ts_tablet_manager.cc:1434] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:20:51.191777 31464 consensus_queue.cc:237] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.192878 31401 tablet_bootstrap.cc:492] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:51.204787 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f6d602e394c848d29df14804fa855" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:51.208600 31244 leader_election.cc:343] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.211184 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.212024 31352 raft_consensus.cc:2468] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:51.212795 31512 consensus_queue.cc:1048] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.214691 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f6d602e394c848d29df14804fa855" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:51.200168 31554 leader_election.cc:290] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:51.215902 31531 leader_election.cc:290] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:51.213511 31093 leader_election.cc:304] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:51.216969 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8ec895126a540df9c9474a9dd420991" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:51.217666 31420 raft_consensus.cc:2804] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.218067 31420 raft_consensus.cc:493] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.218405 31420 raft_consensus.cc:3060] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.218899 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:51.223234 31524 raft_consensus.cc:493] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.223763 31524 raft_consensus.cc:515] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.226035 31524 leader_election.cc:290] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:51.231024 31092 leader_election.cc:304] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:51.233948 31472 raft_consensus.cc:3060] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.234215 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
W20260709 12:20:51.235349 31092 leader_election.cc:343] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.236644 31129 raft_consensus.cc:2468] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:51.242707 31401 tablet_bootstrap.cc:654] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.244899 31531 consensus_queue.cc:1048] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.250401 31531 raft_consensus.cc:493] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.251467 31531 raft_consensus.cc:515] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.253124 31402 tablet_bootstrap.cc:492] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:51.254851 31554 raft_consensus.cc:493] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.255159 31317 leader_election.cc:304] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:51.255534 31554 raft_consensus.cc:515] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:51.256018 31531 leader_election.cc:290] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:51.256198 31524 raft_consensus.cc:2804] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:20:51.242184 31243 leader_election.cc:343] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.257061 31402 ts_tablet_manager.cc:1403] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.006s
I20260709 12:20:51.256111 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.260191 31354 raft_consensus.cc:2468] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:51.257444 31524 raft_consensus.cc:493] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.263947 31524 raft_consensus.cc:3060] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.270006 31399 tablet_bootstrap.cc:492] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:51.270789 31399 ts_tablet_manager.cc:1403] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.128s	user 0.015s	sys 0.004s
I20260709 12:20:51.277096 31401 tablet_bootstrap.cc:492] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:51.277637 31401 ts_tablet_manager.cc:1403] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.000s
I20260709 12:20:51.260289 31243 leader_election.cc:304] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:51.287112 31467 raft_consensus.cc:2749] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:51.287467 31168 consensus_peers.cc:597] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:51.288059 31420 raft_consensus.cc:515] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.289783 31467 raft_consensus.cc:493] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.290557 31420 leader_election.cc:290] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:51.290362 31467 raft_consensus.cc:515] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.292742 31467 leader_election.cc:290] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:51.293330 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
W20260709 12:20:51.295379 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 53572.9us
W20260709 12:20:51.298048 31092 leader_election.cc:343] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.295426 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.299137 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:51.299412 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:51.299841 31354 raft_consensus.cc:3060] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:51.300171 31244 leader_election.cc:343] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.300143 31127 raft_consensus.cc:2468] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:51.300983 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:51.301743 31203 raft_consensus.cc:2468] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:51.302062 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:51.302812 31278 raft_consensus.cc:2468] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:51.303627 31399 raft_consensus.cc:359] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.297155 31472 raft_consensus.cc:2749] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.307021 31554 leader_election.cc:290] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:51.304328 31243 leader_election.cc:304] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:51.310112 31531 raft_consensus.cc:2804] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.310487 31531 raft_consensus.cc:493] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.304363 31399 raft_consensus.cc:385] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.311020 31531 raft_consensus.cc:3060] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.311317 31399 raft_consensus.cc:740] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.312206 31399 consensus_queue.cc:260] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.305850 31400 tablet_bootstrap.cc:492] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:51.315568 31512 raft_consensus.cc:493] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.315990 31400 ts_tablet_manager.cc:1403] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.153s	user 0.008s	sys 0.015s
I20260709 12:20:51.316078 31512 raft_consensus.cc:515] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.318014 31399 ts_tablet_manager.cc:1434] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 12:20:51.320895 31243 leader_election.cc:304] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:51.322676 31399 tablet_bootstrap.cc:492] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:51.304832 31401 raft_consensus.cc:359] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.323632 31401 raft_consensus.cc:385] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.323978 31401 raft_consensus.cc:740] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.311520 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:51.325374 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead9af52f3cb440a823ab640a53caa2d" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.326292 31349 raft_consensus.cc:2393] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d5ebd798965493785b198d6e8492c23 in current term 1: Already voted for candidate ee8bcffe388e4e0796bc17d15b7adcde in this term.
I20260709 12:20:51.328603 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:51.322335 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ead9af52f3cb440a823ab640a53caa2d" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:51.332693 31402 raft_consensus.cc:359] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.333314 31402 raft_consensus.cc:385] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.333564 31402 raft_consensus.cc:740] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.334126 31402 consensus_queue.cc:260] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.336015 31401 consensus_queue.cc:260] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.339152 31400 raft_consensus.cc:359] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.340096 31400 raft_consensus.cc:385] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.340344 31400 raft_consensus.cc:740] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.341332 31402 ts_tablet_manager.cc:1434] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.000s
I20260709 12:20:51.323185 31467 raft_consensus.cc:2804] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.318471 31512 leader_election.cc:290] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:51.347496 31401 ts_tablet_manager.cc:1434] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.001s
I20260709 12:20:51.348088 31400 consensus_queue.cc:260] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.344233 31467 raft_consensus.cc:493] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.352608 31402 tablet_bootstrap.cc:492] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:51.352936 31023 catalog_manager.cc:5697] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:51.347316 31092 leader_election.cc:343] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.356343 31169 leader_election.cc:304] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
W20260709 12:20:51.358014 31092 leader_election.cc:343] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.358446 31512 raft_consensus.cc:3060] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.359977 31402 tablet_bootstrap.cc:654] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.362332 31420 raft_consensus.cc:493] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.362901 31420 raft_consensus.cc:515] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.358510 31092 leader_election.cc:304] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:51.367130 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cb701e3ab34e60b09c279e2bcfe26a" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.367975 31554 raft_consensus.cc:2749] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.369740 31401 tablet_bootstrap.cc:492] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
W20260709 12:20:51.370148 31093 leader_election.cc:343] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.377076 31420 leader_election.cc:290] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:51.377362 31464 consensus_queue.cc:1048] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.380127 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cb701e3ab34e60b09c279e2bcfe26a" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:51.380863 31203 raft_consensus.cc:2468] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:51.383149 31401 tablet_bootstrap.cc:654] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.387029 31400 ts_tablet_manager.cc:1434] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.070s	user 0.004s	sys 0.004s
I20260709 12:20:51.388140 31512 raft_consensus.cc:2749] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.368697 31467 raft_consensus.cc:3060] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.388530 31400 tablet_bootstrap.cc:492] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:51.386819 31092 leader_election.cc:304] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:51.393653 31399 tablet_bootstrap.cc:654] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.356740 31023 catalog_manager.cc:5697] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:51.350065 31524 raft_consensus.cc:515] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.403414 31351 raft_consensus.cc:2393] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee8bcffe388e4e0796bc17d15b7adcde in current term 1: Already voted for candidate 9800423c0012421d9ce299e8c180ac96 in this term.
I20260709 12:20:51.405728 31524 leader_election.cc:290] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:51.407651 31354 raft_consensus.cc:2468] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:51.401443 31420 raft_consensus.cc:2804] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.409564 31093 leader_election.cc:304] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23
I20260709 12:20:51.409971 31420 raft_consensus.cc:493] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:51.410566 31420 raft_consensus.cc:3060] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.413511 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:51.414338 31129 raft_consensus.cc:3060] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.411435 31554 raft_consensus.cc:2804] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.416040 31554 raft_consensus.cc:697] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:51.417481 31554 consensus_queue.cc:237] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.420066 31402 tablet_bootstrap.cc:492] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:51.420817 31402 ts_tablet_manager.cc:1403] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.068s	user 0.025s	sys 0.011s
I20260709 12:20:51.424743 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:51.424619 31536 consensus_queue.cc:1048] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:51.425714 31402 raft_consensus.cc:359] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:51.426774 31402 raft_consensus.cc:385] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.427207 31402 raft_consensus.cc:740] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.428982 31402 consensus_queue.cc:260] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:51.457795 31472 raft_consensus.cc:493] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.458472 31472 raft_consensus.cc:515] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.461623 31472 leader_election.cc:290] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:51.431360 31474 consensus_queue.cc:1048] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:20:51.464228 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ad8a458c2403a9dbdd50be2fd763d" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.484344 31402 ts_tablet_manager.cc:1434] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.063s	user 0.010s	sys 0.008s
I20260709 12:20:51.467597 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "964ad8a458c2403a9dbdd50be2fd763d" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:51.488420 31402 tablet_bootstrap.cc:492] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:51.491309 31278 raft_consensus.cc:2393] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b87862f0eb448db7779e995eb84f64 in current term 1: Already voted for candidate 9800423c0012421d9ce299e8c180ac96 in this term.
I20260709 12:20:51.493548 31128 raft_consensus.cc:3060] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.495815 31129 raft_consensus.cc:2468] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:51.506347 31400 tablet_bootstrap.cc:654] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.507622 31092 leader_election.cc:304] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:51.514194 31401 tablet_bootstrap.cc:492] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:51.519382 31591 raft_consensus.cc:2749] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.490666 31531 raft_consensus.cc:515] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.520429 31401 ts_tablet_manager.cc:1403] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.151s	user 0.018s	sys 0.001s
I20260709 12:20:51.526311 31317 leader_election.cc:304] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:51.544251 31518 raft_consensus.cc:2804] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.544968 31407 consensus_queue.cc:1048] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:20:51.561501 31402 tablet_bootstrap.cc:654] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.561990 31467 raft_consensus.cc:515] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.562508 31026 catalog_manager.cc:5697] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:51.577049 31277 raft_consensus.cc:2393] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9800423c0012421d9ce299e8c180ac96 in current term 1: Already voted for candidate ee8bcffe388e4e0796bc17d15b7adcde in this term.
I20260709 12:20:51.585027 31467 leader_election.cc:290] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:51.593901 31512 raft_consensus.cc:493] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.589879 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:51.599915 31401 raft_consensus.cc:359] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.602869 31401 raft_consensus.cc:385] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.603277 31399 tablet_bootstrap.cc:492] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:51.603293 31401 raft_consensus.cc:740] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.604172 31399 ts_tablet_manager.cc:1403] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.283s	user 0.039s	sys 0.078s
I20260709 12:20:51.606312 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab0948c0d0a4bf4a2d9a762fa77f379" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:51.607368 31128 raft_consensus.cc:2393] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ee8bcffe388e4e0796bc17d15b7adcde in current term 1: Already voted for candidate 9800423c0012421d9ce299e8c180ac96 in this term.
I20260709 12:20:51.612371 31401 consensus_queue.cc:260] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.626020 31401 ts_tablet_manager.cc:1434] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.099s	user 0.011s	sys 0.000s
I20260709 12:20:51.616477 31518 raft_consensus.cc:697] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:51.616986 31407 consensus_queue.cc:1048] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 12:20:51.611624 31512 raft_consensus.cc:515] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.634603 31401 tablet_bootstrap.cc:492] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:51.636303 31518 consensus_queue.cc:237] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.637137 31400 tablet_bootstrap.cc:492] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:51.637758 31400 ts_tablet_manager.cc:1403] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.249s	user 0.026s	sys 0.021s
I20260709 12:20:51.644137 31420 raft_consensus.cc:515] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.644728 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:51.640506 31531 leader_election.cc:290] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:51.647951 31531 raft_consensus.cc:493] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:51.648483 31531 raft_consensus.cc:515] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.650353 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cb701e3ab34e60b09c279e2bcfe26a" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:51.651870 31399 raft_consensus.cc:359] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:51.656180 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:51.658808 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cb701e3ab34e60b09c279e2bcfe26a" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:51.660137 31467 consensus_queue.cc:1048] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.660756 31512 leader_election.cc:290] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:51.662389 31399 raft_consensus.cc:385] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.665815 31199 raft_consensus.cc:3060] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.666088 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.664937 31203 raft_consensus.cc:3060] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.667084 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:51.671134 31407 raft_consensus.cc:493] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.673913 31244 leader_election.cc:343] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:51.674618 31093 leader_election.cc:343] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.671944 31399 raft_consensus.cc:740] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.647969 31420 leader_election.cc:290] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:51.675211 31407 raft_consensus.cc:515] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.680832 31399 consensus_queue.cc:260] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
W20260709 12:20:51.677000 31168 leader_election.cc:343] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.683094 31400 raft_consensus.cc:359] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:51.683874 31400 raft_consensus.cc:385] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.684160 31400 raft_consensus.cc:740] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.684953 31400 consensus_queue.cc:260] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
W20260709 12:20:51.689502 31169 leader_election.cc:343] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.690066 31169 leader_election.cc:304] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:51.691962 31129 raft_consensus.cc:3060] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.694832 31399 ts_tablet_manager.cc:1434] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.002s
I20260709 12:20:51.693590 31536 raft_consensus.cc:2749] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.701503 31531 leader_election.cc:290] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:51.702505 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c876d87436493a8aaeb3be151cbf9e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:51.709273 31399 tablet_bootstrap.cc:492] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
W20260709 12:20:51.709348 31244 leader_election.cc:343] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.711380 31126 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c876d87436493a8aaeb3be151cbf9e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:51.702775 31400 ts_tablet_manager.cc:1434] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.000s
I20260709 12:20:51.704828 31464 consensus_queue.cc:1048] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.705349 31402 tablet_bootstrap.cc:492] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:51.713398 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d6fce6e6745b4952d035e0ceccd49" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:51.713639 31402 ts_tablet_manager.cc:1403] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.227s	user 0.014s	sys 0.012s
I20260709 12:20:51.714169 31201 raft_consensus.cc:2468] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:51.715191 31400 tablet_bootstrap.cc:492] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:51.715626 31317 leader_election.cc:304] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:20:51.717126 31524 raft_consensus.cc:2804] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:51.717694 31524 raft_consensus.cc:493] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:20:51.716248 31243 leader_election.cc:343] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.705595 31203 raft_consensus.cc:2468] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:51.718078 31524 raft_consensus.cc:3060] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.721707 31407 leader_election.cc:290] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:51.718338 31243 leader_election.cc:304] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:51.726785 31464 consensus_queue.cc:1048] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:51.727952 31199 raft_consensus.cc:2468] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:51.731302 31531 raft_consensus.cc:2749] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:51.733305 31524 raft_consensus.cc:515] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.716944 31402 raft_consensus.cc:359] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.742141 31092 leader_election.cc:304] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:51.742374 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d6fce6e6745b4952d035e0ceccd49" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:51.741856 31402 raft_consensus.cc:385] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.748093 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d6fce6e6745b4952d035e0ceccd49" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:51.749965 31402 raft_consensus.cc:740] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.757411 31402 consensus_queue.cc:260] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.759685 31401 tablet_bootstrap.cc:654] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.765662 31402 ts_tablet_manager.cc:1434] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.001s
I20260709 12:20:51.749626 31591 raft_consensus.cc:2804] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.765841 31203 raft_consensus.cc:3060] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:51.831672 31402 tablet_bootstrap.cc:492] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:51.839771 31524 leader_election.cc:290] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:51.751127 31243 leader_election.cc:304] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:51.826380 31518 raft_consensus.cc:493] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:51.852182 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 107299us
I20260709 12:20:51.853531 31518 raft_consensus.cc:515] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.855870 31409 raft_consensus.cc:2804] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.856550 31409 raft_consensus.cc:697] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:51.856594 31518 leader_election.cc:290] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:51.853070 31402 tablet_bootstrap.cc:654] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.857767 31409 consensus_queue.cc:237] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
W20260709 12:20:51.860848 31317 leader_election.cc:343] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.852140 31400 tablet_bootstrap.cc:654] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.866938 31399 tablet_bootstrap.cc:654] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.833225 31591 raft_consensus.cc:697] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:51.871908 31591 consensus_queue.cc:237] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.873809 31401 tablet_bootstrap.cc:492] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:51.874559 31401 ts_tablet_manager.cc:1403] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.243s	user 0.021s	sys 0.031s
I20260709 12:20:51.869088 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:51.901309 31401 raft_consensus.cc:359] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.902490 31401 raft_consensus.cc:385] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.902854 31401 raft_consensus.cc:740] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.903784 31401 consensus_queue.cc:260] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.888360 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d6fce6e6745b4952d035e0ceccd49" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:51.912564 31420 raft_consensus.cc:493] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d5ebd798965493785b198d6e8492c23)
I20260709 12:20:51.914700 31420 raft_consensus.cc:515] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:51.919245 31401 ts_tablet_manager.cc:1434] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.001s
I20260709 12:20:51.905539 31244 leader_election.cc:304] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:51.931785 31401 tablet_bootstrap.cc:492] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:51.932376 31608 raft_consensus.cc:2749] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:20:51.926460 31317 leader_election.cc:343] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.937774 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f5e32511d244df9299237b280d2405" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
W20260709 12:20:51.939700 31244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:36383, user_credentials={real_user=slave}} blocked reactor thread for 43590.3us
W20260709 12:20:51.941051 31092 consensus_peers.cc:597] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:51.945824 31401 tablet_bootstrap.cc:654] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.946105 31402 tablet_bootstrap.cc:492] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:51.946696 31402 ts_tablet_manager.cc:1403] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.026s
I20260709 12:20:51.952872 31399 tablet_bootstrap.cc:492] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:51.953456 31399 ts_tablet_manager.cc:1403] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.244s	user 0.018s	sys 0.013s
I20260709 12:20:51.956750 31399 raft_consensus.cc:359] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.957589 31399 raft_consensus.cc:385] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.957854 31399 raft_consensus.cc:740] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.958673 31399 consensus_queue.cc:260] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.958964 31402 raft_consensus.cc:359] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.959822 31402 raft_consensus.cc:385] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.960124 31402 raft_consensus.cc:740] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.961664 31399 ts_tablet_manager.cc:1434] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:20:51.962831 31399 tablet_bootstrap.cc:492] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:51.965732 31203 raft_consensus.cc:2468] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:51.967190 31317 leader_election.cc:304] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:20:51.968068 31518 raft_consensus.cc:2804] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:51.968566 31518 raft_consensus.cc:697] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:51.970073 31399 tablet_bootstrap.cc:654] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.969614 31518 consensus_queue.cc:237] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:51.974607 31402 consensus_queue.cc:260] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:51.976171 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:51.977777 31317 leader_election.cc:343] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:51.980275 31402 ts_tablet_manager.cc:1434] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:20:51.982926 31402 tablet_bootstrap.cc:492] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:51.983541 31399 tablet_bootstrap.cc:492] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:51.984035 31399 ts_tablet_manager.cc:1403] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.008s
W20260709 12:20:51.984838 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:51.987201 31399 raft_consensus.cc:359] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.987959 31399 raft_consensus.cc:385] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:51.988214 31554 consensus_queue.cc:1048] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:51.989704 31402 tablet_bootstrap.cc:654] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:51.988232 31399 raft_consensus.cc:740] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:51.995278 31399 consensus_queue.cc:260] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:51.999599 31474 raft_consensus.cc:493] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.000279 31399 ts_tablet_manager.cc:1434] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:20:52.000160 31474 raft_consensus.cc:515] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.002487 31474 leader_election.cc:290] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.004999 31399 tablet_bootstrap.cc:492] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
W20260709 12:20:52.013638 31317 leader_election.cc:343] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.014199 31317 leader_election.cc:304] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.016518 31407 raft_consensus.cc:2749] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.016891 31402 tablet_bootstrap.cc:492] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:52.017534 31402 ts_tablet_manager.cc:1403] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.035s	user 0.017s	sys 0.010s
I20260709 12:20:52.020445 31420 leader_election.cc:290] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:52.022359 31399 tablet_bootstrap.cc:654] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.021768 31402 raft_consensus.cc:359] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.022759 31402 raft_consensus.cc:385] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.023065 31402 raft_consensus.cc:740] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.023751 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:52.024488 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f5e32511d244df9299237b280d2405" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.024519 31203 raft_consensus.cc:2468] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:52.026553 31092 leader_election.cc:304] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.031881 31026 catalog_manager.cc:5697] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.034261 31399 tablet_bootstrap.cc:492] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:52.035003 31399 ts_tablet_manager.cc:1403] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.000s
I20260709 12:20:52.027563 31402 consensus_queue.cc:260] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.039846 31399 raft_consensus.cc:359] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.040812 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.041586 31125 raft_consensus.cc:2468] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:52.040905 31399 raft_consensus.cc:385] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.043016 31399 raft_consensus.cc:740] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.044495 31399 consensus_queue.cc:260] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.047942 31399 ts_tablet_manager.cc:1434] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 12:20:52.048419 31402 ts_tablet_manager.cc:1434] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.003s
I20260709 12:20:52.049590 31399 tablet_bootstrap.cc:492] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:52.049798 31402 tablet_bootstrap.cc:492] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:52.051484 31591 raft_consensus.cc:2749] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:52.065402 31400 tablet_bootstrap.cc:492] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:52.065946 31400 ts_tablet_manager.cc:1403] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.351s	user 0.022s	sys 0.008s
I20260709 12:20:52.055487 31243 leader_election.cc:304] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:52.075095 31402 tablet_bootstrap.cc:654] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.075809 31400 raft_consensus.cc:359] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.076694 31400 raft_consensus.cc:385] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.076992 31400 raft_consensus.cc:740] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.077767 31400 consensus_queue.cc:260] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.079104 31608 raft_consensus.cc:2804] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.079497 31608 raft_consensus.cc:493] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.079844 31608 raft_consensus.cc:3060] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.086244 31401 tablet_bootstrap.cc:492] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:52.087074 31401 ts_tablet_manager.cc:1403] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.162s	user 0.037s	sys 0.033s
I20260709 12:20:52.096316 31399 tablet_bootstrap.cc:654] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.099401 31608 raft_consensus.cc:515] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.098307 31400 ts_tablet_manager.cc:1434] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 12:20:52.101724 31608 leader_election.cc:290] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.102666 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:52.104401 31400 tablet_bootstrap.cc:492] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:52.101753 31401 raft_consensus.cc:359] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.106276 31401 raft_consensus.cc:385] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.104648 31125 raft_consensus.cc:3060] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.106649 31401 raft_consensus.cc:740] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.095629 31024 catalog_manager.cc:5697] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.112684 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:52.113384 31202 raft_consensus.cc:3060] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.108590 31401 consensus_queue.cc:260] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.120249 31401 ts_tablet_manager.cc:1434] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.004s
I20260709 12:20:52.120718 31472 raft_consensus.cc:493] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.121574 31401 tablet_bootstrap.cc:492] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:52.121271 31472 raft_consensus.cc:515] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.131861 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:52.132593 31354 raft_consensus.cc:2468] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:52.135260 31093 leader_election.cc:304] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:52.135462 31602 raft_consensus.cc:493] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.137920 31125 raft_consensus.cc:2468] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:52.134563 31472 leader_election.cc:290] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:52.138262 31602 raft_consensus.cc:515] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.145795 31243 leader_election.cc:304] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:52.138718 31399 tablet_bootstrap.cc:492] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:52.139282 31554 raft_consensus.cc:2804] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.146749 31554 raft_consensus.cc:493] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.147287 31554 raft_consensus.cc:3060] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.146701 31608 raft_consensus.cc:2804] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.147097 31602 leader_election.cc:290] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:52.148344 31608 raft_consensus.cc:697] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:52.148653 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.148984 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:52.149315 31608 consensus_queue.cc:237] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.150138 31401 tablet_bootstrap.cc:654] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:52.150283 31168 leader_election.cc:343] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:52.151671 31169 leader_election.cc:343] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.152355 31169 leader_election.cc:304] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:52.153199 31602 raft_consensus.cc:2749] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.156219 31554 raft_consensus.cc:515] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.159328 31399 ts_tablet_manager.cc:1403] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.003s
I20260709 12:20:52.164713 31023 catalog_manager.cc:5697] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.139432 31202 raft_consensus.cc:2468] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:52.168653 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:52.169131 31401 tablet_bootstrap.cc:492] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:52.169651 31401 ts_tablet_manager.cc:1403] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.012s
W20260709 12:20:52.172006 31092 leader_election.cc:343] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.172204 31518 raft_consensus.cc:493] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.172766 31518 raft_consensus.cc:515] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.172971 31401 raft_consensus.cc:359] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.173744 31401 raft_consensus.cc:385] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.174024 31401 raft_consensus.cc:740] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.174922 31518 leader_election.cc:290] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:52.174746 31401 consensus_queue.cc:260] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.177084 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c876d87436493a8aaeb3be151cbf9e" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.177527 31401 ts_tablet_manager.cc:1434] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:52.140687 31402 tablet_bootstrap.cc:492] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:52.136034 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.177805 31125 raft_consensus.cc:2468] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:52.144488 31400 tablet_bootstrap.cc:654] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.178675 31401 tablet_bootstrap.cc:492] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:52.179791 31317 leader_election.cc:304] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:52.181273 31407 raft_consensus.cc:2804] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.181727 31407 raft_consensus.cc:493] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.182184 31407 raft_consensus.cc:3060] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.183095 31518 consensus_queue.cc:1048] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.168274 31399 raft_consensus.cc:359] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.184290 31399 raft_consensus.cc:385] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.184641 31399 raft_consensus.cc:740] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.185462 31399 consensus_queue.cc:260] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.186429 31401 tablet_bootstrap.cc:654] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.188050 31402 ts_tablet_manager.cc:1403] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.139s	user 0.016s	sys 0.030s
W20260709 12:20:52.188843 31092 leader_election.cc:343] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.190781 31472 raft_consensus.cc:493] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.191598 31472 raft_consensus.cc:515] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.193359 31407 raft_consensus.cc:515] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.194448 31399 ts_tablet_manager.cc:1434] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:20:52.195765 31399 tablet_bootstrap.cc:492] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:52.198097 31402 raft_consensus.cc:359] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.198868 31402 raft_consensus.cc:385] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.199153 31402 raft_consensus.cc:740] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.199743 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2005abeeca4984960b64be4b5d532e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:52.199858 31402 consensus_queue.cc:260] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
W20260709 12:20:52.202616 31093 leader_election.cc:343] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.203646 31518 raft_consensus.cc:493] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.204545 31400 tablet_bootstrap.cc:492] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:52.205104 31400 ts_tablet_manager.cc:1403] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.101s	user 0.013s	sys 0.006s
I20260709 12:20:52.204727 31518 raft_consensus.cc:515] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.208606 31400 raft_consensus.cc:359] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.209368 31400 raft_consensus.cc:385] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.209676 31400 raft_consensus.cc:740] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.210539 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c876d87436493a8aaeb3be151cbf9e" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:52.211184 31125 raft_consensus.cc:3060] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.218371 31399 tablet_bootstrap.cc:654] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.219357 31407 leader_election.cc:290] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:52.220994 31402 ts_tablet_manager.cc:1434] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:20:52.210394 31400 consensus_queue.cc:260] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.221102 31472 leader_election.cc:290] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:52.249961 31409 raft_consensus.cc:493] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.261197 31021 catalog_manager.cc:5697] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.261020 31409 raft_consensus.cc:515] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.226559 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c876d87436493a8aaeb3be151cbf9e" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.266165 31277 raft_consensus.cc:2468] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:52.266613 31409 leader_election.cc:290] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.268676 31400 ts_tablet_manager.cc:1434] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.063s	user 0.011s	sys 0.002s
I20260709 12:20:52.269380 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:52.270005 31400 tablet_bootstrap.cc:492] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:52.270367 31354 raft_consensus.cc:3060] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.258320 31402 tablet_bootstrap.cc:492] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:52.276636 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:52.277603 31202 raft_consensus.cc:2393] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9800423c0012421d9ce299e8c180ac96 in current term 1: Already voted for candidate ee8bcffe388e4e0796bc17d15b7adcde in this term.
I20260709 12:20:52.278357 31402 tablet_bootstrap.cc:654] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.280100 31602 raft_consensus.cc:493] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.280613 31518 leader_election.cc:290] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:52.280699 31602 raft_consensus.cc:515] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.281569 31554 leader_election.cc:290] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:52.282123 31399 tablet_bootstrap.cc:492] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:52.282711 31399 ts_tablet_manager.cc:1403] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.087s	user 0.008s	sys 0.004s
I20260709 12:20:52.285816 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "41c876d87436493a8aaeb3be151cbf9e" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:52.286693 31278 raft_consensus.cc:3060] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.287101 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.288471 31602 leader_election.cc:290] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:52.292301 31399 raft_consensus.cc:359] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.293085 31399 raft_consensus.cc:385] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.293359 31399 raft_consensus.cc:740] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.293597 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:52.295792 31169 leader_election.cc:304] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:52.297325 31512 raft_consensus.cc:2749] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.294075 31399 consensus_queue.cc:260] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.298938 31399 ts_tablet_manager.cc:1434] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:20:52.300168 31399 tablet_bootstrap.cc:492] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:52.301618 31602 raft_consensus.cc:493] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.302163 31602 raft_consensus.cc:515] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.308537 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:52.310187 31168 leader_election.cc:343] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.311205 31400 tablet_bootstrap.cc:654] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.313735 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.317457 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:52.323194 31596 raft_consensus.cc:493] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.323928 31596 raft_consensus.cc:515] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.325944 31125 raft_consensus.cc:2468] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:52.326566 31596 leader_election.cc:290] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:52.328295 31401 tablet_bootstrap.cc:492] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:52.328627 31402 tablet_bootstrap.cc:492] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:52.328851 31401 ts_tablet_manager.cc:1403] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.150s	user 0.058s	sys 0.065s
I20260709 12:20:52.329193 31402 ts_tablet_manager.cc:1403] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.000s
I20260709 12:20:52.329622 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f6d602e394c848d29df14804fa855" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:52.330417 31202 raft_consensus.cc:2468] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:52.332326 31401 raft_consensus.cc:359] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.333133 31401 raft_consensus.cc:385] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.333415 31202 raft_consensus.cc:3060] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.333424 31401 raft_consensus.cc:740] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.334617 31401 consensus_queue.cc:260] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.336846 31399 tablet_bootstrap.cc:654] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.332265 31317 leader_election.cc:304] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:52.338251 31401 ts_tablet_manager.cc:1434] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:20:52.338728 31596 raft_consensus.cc:2804] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.339406 31596 raft_consensus.cc:697] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:52.339242 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.339876 31402 raft_consensus.cc:359] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.340732 31602 leader_election.cc:290] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:52.340616 31596 consensus_queue.cc:237] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.343083 31400 tablet_bootstrap.cc:492] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
W20260709 12:20:52.343328 31168 leader_election.cc:343] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.343840 31400 ts_tablet_manager.cc:1403] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.074s	user 0.011s	sys 0.002s
I20260709 12:20:52.343936 31168 leader_election.cc:304] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.345356 31602 raft_consensus.cc:2749] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.347019 31401 tablet_bootstrap.cc:492] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:52.338142 31317 leader_election.cc:304] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:20:52.347173 31400 raft_consensus.cc:359] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.350960 31400 raft_consensus.cc:385] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.351322 31400 raft_consensus.cc:740] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.352314 31400 consensus_queue.cc:260] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.353828 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2005abeeca4984960b64be4b5d532e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.354741 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f6d602e394c848d29df14804fa855" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.354831 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "437143ed6af647b0b4b7a3f240e11346" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.355621 31276 raft_consensus.cc:2468] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:52.356953 31407 raft_consensus.cc:493] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.357621 31407 raft_consensus.cc:515] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.358786 31400 ts_tablet_manager.cc:1434] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.003s
I20260709 12:20:52.361842 31401 tablet_bootstrap.cc:654] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.361850 31407 leader_election.cc:290] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.365978 31278 raft_consensus.cc:2468] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:52.366865 31400 tablet_bootstrap.cc:492] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
W20260709 12:20:52.371088 31092 leader_election.cc:343] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.371646 31092 leader_election.cc:304] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.375211 31602 raft_consensus.cc:493] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.375818 31602 raft_consensus.cc:515] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.376242 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cb701e3ab34e60b09c279e2bcfe26a" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:52.377113 31201 raft_consensus.cc:2393] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9800423c0012421d9ce299e8c180ac96 in current term 1: Already voted for candidate e3b87862f0eb448db7779e995eb84f64 in this term.
I20260709 12:20:52.378132 31602 leader_election.cc:290] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:52.379225 31317 leader_election.cc:304] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.379943 31554 raft_consensus.cc:2749] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.380211 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a400868ea34d6287dd1306d2c7456c" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.380041 31407 raft_consensus.cc:2804] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.380178 31524 consensus_queue.cc:1048] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:20:52.384433 31524 raft_consensus.cc:3060] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.382594 31407 raft_consensus.cc:493] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.385368 31407 raft_consensus.cc:3060] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.386675 31400 tablet_bootstrap.cc:654] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.340618 31402 raft_consensus.cc:385] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.389708 31402 raft_consensus.cc:740] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.391889 31354 raft_consensus.cc:2468] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:52.396070 31093 leader_election.cc:304] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.398046 31420 raft_consensus.cc:2804] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.398576 31420 raft_consensus.cc:697] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:52.399539 31524 raft_consensus.cc:2749] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.399881 31420 consensus_queue.cc:237] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.401664 31243 leader_election.cc:304] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:52.405310 31401 tablet_bootstrap.cc:492] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:52.382380 31125 raft_consensus.cc:2468] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:52.406160 31401 ts_tablet_manager.cc:1403] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.059s	user 0.010s	sys 0.013s
I20260709 12:20:52.408418 31168 leader_election.cc:304] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:52.409646 31401 raft_consensus.cc:359] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.410526 31602 raft_consensus.cc:2804] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.411109 31602 raft_consensus.cc:493] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.411533 31602 raft_consensus.cc:3060] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.411635 31402 consensus_queue.cc:260] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.415715 31409 raft_consensus.cc:2749] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.416728 31409 consensus_queue.cc:1048] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.420979 31591 consensus_queue.cc:1048] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.423055 31402 ts_tablet_manager.cc:1434] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.093s	user 0.009s	sys 0.000s
I20260709 12:20:52.424018 31354 raft_consensus.cc:3060] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.424330 31402 tablet_bootstrap.cc:492] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:52.429015 31591 raft_consensus.cc:493] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.429593 31591 raft_consensus.cc:515] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.381053 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cb701e3ab34e60b09c279e2bcfe26a" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.432126 31591 leader_election.cc:290] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.434428 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:52.434124 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:52.435146 31201 raft_consensus.cc:2468] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
W20260709 12:20:52.436821 31093 leader_election.cc:343] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.441164 31409 consensus_queue.cc:1048] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.440207 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a400868ea34d6287dd1306d2c7456c" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.441901 31092 leader_election.cc:304] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:52.442927 31317 leader_election.cc:304] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:52.410521 31401 raft_consensus.cc:385] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.446154 31401 raft_consensus.cc:740] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.446976 31401 consensus_queue.cc:260] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.447710 31591 consensus_queue.cc:1048] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.455502 31401 ts_tablet_manager.cc:1434] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.049s	user 0.005s	sys 0.004s
I20260709 12:20:52.454075 31518 raft_consensus.cc:2749] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.453289 31554 raft_consensus.cc:2804] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.475633 31399 tablet_bootstrap.cc:492] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:52.476292 31399 ts_tablet_manager.cc:1403] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.023s
I20260709 12:20:52.480428 31602 raft_consensus.cc:515] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.483157 31602 leader_election.cc:290] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:52.487447 31021 catalog_manager.cc:5697] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.488646 31401 tablet_bootstrap.cc:492] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
W20260709 12:20:52.489774 31168 leader_election.cc:343] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.489993 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a400868ea34d6287dd1306d2c7456c" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:52.490654 31129 raft_consensus.cc:3060] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.475189 31554 raft_consensus.cc:493] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.515331 31400 tablet_bootstrap.cc:492] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:52.516238 31400 ts_tablet_manager.cc:1403] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.150s	user 0.018s	sys 0.007s
I20260709 12:20:52.517096 31026 catalog_manager.cc:5697] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.523180 31026 catalog_manager.cc:5697] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.478003 31407 raft_consensus.cc:515] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.530424 31400 raft_consensus.cc:359] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.531996 31400 raft_consensus.cc:385] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.505702 31554 raft_consensus.cc:3060] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.532612 31400 raft_consensus.cc:740] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.538535 31400 consensus_queue.cc:260] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.547228 31400 ts_tablet_manager.cc:1434] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 12:20:52.546726 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a400868ea34d6287dd1306d2c7456c" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
W20260709 12:20:52.549878 31168 leader_election.cc:343] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:52.558771 31637 log.cc:927] Time spent T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:20:52.564946 31400 tablet_bootstrap.cc:492] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:52.573520 31399 raft_consensus.cc:359] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.574326 31399 raft_consensus.cc:385] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.574605 31399 raft_consensus.cc:740] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.575913 31399 consensus_queue.cc:260] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.578080 31399 ts_tablet_manager.cc:1434] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.000s
I20260709 12:20:52.579376 31399 tablet_bootstrap.cc:492] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:52.587805 31400 tablet_bootstrap.cc:654] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.588979 31401 tablet_bootstrap.cc:654] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.593925 31399 tablet_bootstrap.cc:654] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.611840 31407 leader_election.cc:290] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:52.613879 31129 raft_consensus.cc:2468] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:52.615540 31168 leader_election.cc:304] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.620544 31602 raft_consensus.cc:2804] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.621086 31602 raft_consensus.cc:697] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:52.622105 31602 consensus_queue.cc:237] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.635736 31407 raft_consensus.cc:493] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.636433 31407 raft_consensus.cc:515] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.638721 31400 tablet_bootstrap.cc:492] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:52.639346 31400 ts_tablet_manager.cc:1403] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.077s	user 0.012s	sys 0.004s
I20260709 12:20:52.648761 31407 leader_election.cc:290] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:52.652469 31402 tablet_bootstrap.cc:654] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.639186 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f6d602e394c848d29df14804fa855" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:52.662320 31400 raft_consensus.cc:359] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.663913 31400 raft_consensus.cc:385] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.658537 31202 raft_consensus.cc:3060] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.664130 31400 raft_consensus.cc:740] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.669018 31400 consensus_queue.cc:260] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.670907 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f9f2ccc422431581e845d7df278107" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.671927 31401 tablet_bootstrap.cc:492] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:52.672492 31401 ts_tablet_manager.cc:1403] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.185s	user 0.017s	sys 0.006s
I20260709 12:20:52.680860 31401 raft_consensus.cc:359] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.681896 31401 raft_consensus.cc:385] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.682284 31401 raft_consensus.cc:740] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.682425 31400 ts_tablet_manager.cc:1434] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.043s	user 0.002s	sys 0.004s
I20260709 12:20:52.684031 31400 tablet_bootstrap.cc:492] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:52.687667 31534 raft_consensus.cc:493] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.688226 31534 raft_consensus.cc:515] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.688838 31464 raft_consensus.cc:493] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.689404 31464 raft_consensus.cc:515] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.691220 31534 leader_election.cc:290] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:52.692625 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e3a964ca446edb98d1ad6c8984716" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.693202 31464 leader_election.cc:290] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
W20260709 12:20:52.694485 31168 leader_election.cc:343] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.692607 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d6fce6e6745b4952d035e0ceccd49" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:52.697089 31202 raft_consensus.cc:2468] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:52.698908 31399 tablet_bootstrap.cc:492] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
W20260709 12:20:52.694595 31317 leader_election.cc:343] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.699791 31554 raft_consensus.cc:515] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.704279 31279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f9f2ccc422431581e845d7df278107" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.701309 31409 raft_consensus.cc:493] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.701967 31399 ts_tablet_manager.cc:1403] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.123s	user 0.024s	sys 0.000s
I20260709 12:20:52.703181 31276 raft_consensus.cc:3060] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.703387 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8d0f6d602e394c848d29df14804fa855" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:52.707289 31401 consensus_queue.cc:260] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.704981 31275 raft_consensus.cc:3060] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.708446 31534 consensus_queue.cc:1048] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:20:52.709614 31409 raft_consensus.cc:515] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.717231 31401 ts_tablet_manager.cc:1434] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.001s
I20260709 12:20:52.711593 31278 raft_consensus.cc:3060] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.709904 31474 raft_consensus.cc:493] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.718395 31407 consensus_queue.cc:1048] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:20:52.729166 31317 leader_election.cc:343] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.729754 31317 leader_election.cc:304] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.730645 31596 raft_consensus.cc:2749] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.731427 31474 raft_consensus.cc:515] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.736861 31554 leader_election.cc:290] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.738477 31474 leader_election.cc:290] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:52.742290 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:52.742611 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.744071 31317 leader_election.cc:304] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:20:52.745133 31640 raft_consensus.cc:2804] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.746026 31640 raft_consensus.cc:697] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:52.746961 31640 consensus_queue.cc:237] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
W20260709 12:20:52.747409 31093 leader_election.cc:343] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.750859 31401 tablet_bootstrap.cc:492] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:52.755402 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e3a964ca446edb98d1ad6c8984716" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:52.756316 31409 leader_election.cc:290] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.767861 31278 raft_consensus.cc:2468] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:52.768958 31402 tablet_bootstrap.cc:492] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:52.769767 31402 ts_tablet_manager.cc:1403] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.346s	user 0.014s	sys 0.012s
I20260709 12:20:52.773691 31402 raft_consensus.cc:359] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.774603 31402 raft_consensus.cc:385] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.774955 31402 raft_consensus.cc:740] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.776173 31402 consensus_queue.cc:260] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.778760 31402 ts_tablet_manager.cc:1434] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:20:52.780197 31402 tablet_bootstrap.cc:492] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:52.781054 31399 raft_consensus.cc:359] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.781896 31399 raft_consensus.cc:385] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.782230 31399 raft_consensus.cc:740] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.783098 31399 consensus_queue.cc:260] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.785732 31399 ts_tablet_manager.cc:1434] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 12:20:52.786494 31400 tablet_bootstrap.cc:654] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.786291 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:52.787315 31354 raft_consensus.cc:2393] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee8bcffe388e4e0796bc17d15b7adcde in current term 1: Already voted for candidate e3b87862f0eb448db7779e995eb84f64 in this term.
I20260709 12:20:52.792115 31399 tablet_bootstrap.cc:492] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:52.793293 31244 leader_election.cc:304] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:52.796460 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.795343 31474 raft_consensus.cc:3060] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.801326 31407 consensus_queue.cc:1048] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.807328 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "702d6fce6e6745b4952d035e0ceccd49" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:52.807832 31401 tablet_bootstrap.cc:654] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.812014 31399 tablet_bootstrap.cc:654] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:52.817035 31169 leader_election.cc:343] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.814635 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:52.825488 31202 raft_consensus.cc:2468] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:52.832350 31402 tablet_bootstrap.cc:654] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:52.833227 31243 leader_election.cc:343] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.838261 31243 leader_election.cc:304] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:52.840555 31608 raft_consensus.cc:2749] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.843165 31534 consensus_queue.cc:1048] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:52.823812 31169 leader_election.cc:304] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.853509 31650 raft_consensus.cc:2749] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.858065 31024 catalog_manager.cc:5697] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:52.869493 31400 tablet_bootstrap.cc:492] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:52.870121 31400 ts_tablet_manager.cc:1403] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.186s	user 0.025s	sys 0.004s
W20260709 12:20:52.863284 31169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.196:36383, user_credentials={real_user=slave}} blocked reactor thread for 46317.2us
I20260709 12:20:52.864045 31640 consensus_queue.cc:1048] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.874644 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:52.875346 31202 raft_consensus.cc:3060] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.877883 31400 raft_consensus.cc:359] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.878685 31400 raft_consensus.cc:385] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.880545 31243 leader_election.cc:304] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:52.882064 31652 raft_consensus.cc:2804] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:52.882601 31652 raft_consensus.cc:493] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:52.882967 31652 raft_consensus.cc:3060] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.884809 31474 raft_consensus.cc:2749] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.884831 31401 tablet_bootstrap.cc:492] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:52.887610 31401 ts_tablet_manager.cc:1403] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.136s	user 0.016s	sys 0.003s
I20260709 12:20:52.907810 31026 catalog_manager.cc:5697] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:52.909319 31591 consensus_queue.cc:1048] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.878950 31400 raft_consensus.cc:740] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.911796 31400 consensus_queue.cc:260] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.914456 31400 ts_tablet_manager.cc:1434] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:20:52.914881 31401 raft_consensus.cc:359] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.915589 31400 tablet_bootstrap.cc:492] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:52.916324 31640 raft_consensus.cc:493] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.916920 31640 raft_consensus.cc:515] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:52.919584 31640 leader_election.cc:290] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.923779 31652 raft_consensus.cc:515] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.926201 31652 leader_election.cc:290] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.928148 31400 tablet_bootstrap.cc:654] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.931205 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.935150 31202 raft_consensus.cc:2468] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:52.943970 31092 leader_election.cc:304] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:52.945215 31591 raft_consensus.cc:2804] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:52.945930 31591 raft_consensus.cc:697] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:52.946765 31640 consensus_queue.cc:1048] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:52.947402 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:52.947145 31591 consensus_queue.cc:237] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
W20260709 12:20:52.948118 31317 leader_election.cc:343] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.948203 31201 raft_consensus.cc:2468] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:52.954916 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:52.958280 31402 tablet_bootstrap.cc:492] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:52.958706 31474 raft_consensus.cc:493] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.959496 31474 raft_consensus.cc:515] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:52.962073 31474 leader_election.cc:290] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:52.915808 31401 raft_consensus.cc:385] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:52.965325 31401 raft_consensus.cc:740] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:52.966113 31401 consensus_queue.cc:260] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:52.968271 31401 ts_tablet_manager.cc:1434] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 12:20:52.969395 31401 tablet_bootstrap.cc:492] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:52.970204 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2005abeeca4984960b64be4b5d532e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:52.972012 31244 leader_election.cc:343] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.975274 31650 raft_consensus.cc:493] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:52.976156 31650 raft_consensus.cc:515] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:52.979259 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de710065f7ad4be19742d79b91324d29" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:52.979852 31650 leader_election.cc:290] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:52.975283 31591 raft_consensus.cc:493] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:52.980890 31168 leader_election.cc:343] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.981845 31401 tablet_bootstrap.cc:654] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:52.985118 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de710065f7ad4be19742d79b91324d29" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:52.985257 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:52.986003 31202 raft_consensus.cc:3060] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:52.958948 31402 ts_tablet_manager.cc:1403] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.179s	user 0.013s	sys 0.006s
W20260709 12:20:52.988514 31168 leader_election.cc:343] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:52.989066 31168 leader_election.cc:304] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:52.995194 31650 raft_consensus.cc:2749] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:52.997100 31399 tablet_bootstrap.cc:492] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:52.999661 31472 consensus_queue.cc:1048] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.002327 31399 ts_tablet_manager.cc:1403] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.210s	user 0.019s	sys 0.000s
I20260709 12:20:52.980904 31591 raft_consensus.cc:515] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
W20260709 12:20:53.004073 31243 leader_election.cc:343] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.011445 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83751ae3dbd4d78add4ddcbf77254a4" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:53.001510 31202 raft_consensus.cc:2468] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:53.015272 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83751ae3dbd4d78add4ddcbf77254a4" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:53.015621 31399 raft_consensus.cc:359] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
W20260709 12:20:53.017012 31093 leader_election.cc:343] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.017316 31400 tablet_bootstrap.cc:492] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:53.017911 31400 ts_tablet_manager.cc:1403] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.103s	user 0.047s	sys 0.036s
W20260709 12:20:53.020756 31317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37949, user_credentials={real_user=slave}} blocked reactor thread for 55800us
I20260709 12:20:53.021608 31317 leader_election.cc:304] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:53.022475 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2005abeeca4984960b64be4b5d532e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:53.034104 31400 raft_consensus.cc:359] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.035801 31650 consensus_queue.cc:1048] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:53.045656 31400 raft_consensus.cc:385] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.045902 31524 raft_consensus.cc:2804] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.046041 31400 raft_consensus.cc:740] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.046365 31524 raft_consensus.cc:493] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.046751 31524 raft_consensus.cc:3060] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.046943 31400 consensus_queue.cc:260] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.049521 31400 ts_tablet_manager.cc:1434] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.004s
I20260709 12:20:53.050608 31400 tablet_bootstrap.cc:492] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:53.037672 31591 leader_election.cc:290] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:53.039542 31243 leader_election.cc:304] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:53.058612 31474 raft_consensus.cc:2804] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.059201 31474 raft_consensus.cc:697] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:53.059805 31129 raft_consensus.cc:2468] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:53.060180 31474 consensus_queue.cc:237] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.016675 31399 raft_consensus.cc:385] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.045095 31401 tablet_bootstrap.cc:492] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
W20260709 12:20:53.037182 31092 leader_election.cc:343] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.068226 31092 leader_election.cc:304] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
W20260709 12:20:53.065635 31317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 44111.3us
I20260709 12:20:53.071555 31524 raft_consensus.cc:515] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.072358 31420 raft_consensus.cc:2749] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.073974 31524 leader_election.cc:290] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:52.990826 31402 raft_consensus.cc:359] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.074935 31400 tablet_bootstrap.cc:654] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.080870 31402 raft_consensus.cc:385] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.081318 31402 raft_consensus.cc:740] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.081715 31275 raft_consensus.cc:3060] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.065955 31399 raft_consensus.cc:740] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.083791 31402 consensus_queue.cc:260] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.084116 31399 consensus_queue.cc:260] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.093592 31243 leader_election.cc:304] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
W20260709 12:20:53.083855 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:53.102476 31399 ts_tablet_manager.cc:1434] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.100s	user 0.009s	sys 0.000s
I20260709 12:20:53.091656 31400 tablet_bootstrap.cc:492] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:53.103250 31400 ts_tablet_manager.cc:1403] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.002s
I20260709 12:20:53.104404 31534 raft_consensus.cc:2804] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.104938 31534 raft_consensus.cc:493] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.105314 31534 raft_consensus.cc:3060] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.108513 31399 tablet_bootstrap.cc:492] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:53.109467 31400 raft_consensus.cc:359] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.110266 31400 raft_consensus.cc:385] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.110533 31400 raft_consensus.cc:740] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.111326 31400 consensus_queue.cc:260] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.074910 31401 ts_tablet_manager.cc:1403] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.106s	user 0.007s	sys 0.006s
I20260709 12:20:53.113592 31400 ts_tablet_manager.cc:1434] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:20:53.114679 31400 tablet_bootstrap.cc:492] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:53.116711 31401 raft_consensus.cc:359] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.117658 31652 raft_consensus.cc:493] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.118209 31652 raft_consensus.cc:515] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.120396 31534 raft_consensus.cc:515] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.120728 31652 leader_election.cc:290] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:53.117450 31401 raft_consensus.cc:385] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.121444 31400 tablet_bootstrap.cc:654] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.122172 31401 raft_consensus.cc:740] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.126499 31402 ts_tablet_manager.cc:1434] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.139s	user 0.008s	sys 0.000s
I20260709 12:20:53.126734 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de710065f7ad4be19742d79b91324d29" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:53.128417 31402 tablet_bootstrap.cc:492] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:53.128226 31401 consensus_queue.cc:260] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.131922 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:53.132532 31201 raft_consensus.cc:3060] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.135434 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:53.135442 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de710065f7ad4be19742d79b91324d29" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:53.139447 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2005abeeca4984960b64be4b5d532e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:53.140061 31354 raft_consensus.cc:3060] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.144310 31401 ts_tablet_manager.cc:1434] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:20:53.136364 31202 raft_consensus.cc:2468] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:53.155349 31201 raft_consensus.cc:2468] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:53.121505 31024 catalog_manager.cc:5697] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.160391 31401 tablet_bootstrap.cc:492] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:53.163784 31243 leader_election.cc:304] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:53.161198 31354 raft_consensus.cc:2468] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
W20260709 12:20:53.161981 31317 leader_election.cc:343] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:53.164786 31243 leader_election.cc:343] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.165668 31474 raft_consensus.cc:2804] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.166738 31244 leader_election.cc:304] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:53.171698 31399 tablet_bootstrap.cc:654] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.171041 31474 raft_consensus.cc:493] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.173905 31474 raft_consensus.cc:3060] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.179395 31409 raft_consensus.cc:2804] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.180035 31409 raft_consensus.cc:697] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:53.181026 31409 consensus_queue.cc:237] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.191846 31317 leader_election.cc:304] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:53.192713 31407 raft_consensus.cc:2804] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.193226 31407 raft_consensus.cc:697] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:53.194136 31407 consensus_queue.cc:237] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.207309 31022 catalog_manager.cc:5697] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.209812 31401 tablet_bootstrap.cc:654] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.211084 31652 raft_consensus.cc:493] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.211822 31534 leader_election.cc:290] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:53.211628 31652 raft_consensus.cc:515] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.216466 31402 tablet_bootstrap.cc:654] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.216403 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a400868ea34d6287dd1306d2c7456c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:53.217793 31652 leader_election.cc:290] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:53.232769 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a400868ea34d6287dd1306d2c7456c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:53.234963 31243 leader_election.cc:304] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:53.238368 31531 raft_consensus.cc:2749] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:53.237156 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a2005abeeca4984960b64be4b5d532e" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:53.240669 31125 raft_consensus.cc:3060] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.242029 31400 tablet_bootstrap.cc:492] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:53.241719 31474 raft_consensus.cc:515] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.242638 31400 ts_tablet_manager.cc:1403] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.039s
I20260709 12:20:53.244019 31650 consensus_queue.cc:1048] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:53.246186 31400 raft_consensus.cc:359] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.246959 31400 raft_consensus.cc:385] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.247671 31400 raft_consensus.cc:740] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.254624 31400 consensus_queue.cc:260] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.260011 31399 tablet_bootstrap.cc:492] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:53.260847 31399 ts_tablet_manager.cc:1403] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.153s	user 0.017s	sys 0.014s
I20260709 12:20:53.272821 31409 raft_consensus.cc:493] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.273535 31409 raft_consensus.cc:515] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.275092 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de710065f7ad4be19742d79b91324d29" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:53.276110 31409 leader_election.cc:290] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:53.278455 31400 ts_tablet_manager.cc:1434] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.003s
I20260709 12:20:53.279397 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e3a964ca446edb98d1ad6c8984716" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:53.279811 31400 tablet_bootstrap.cc:492] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
W20260709 12:20:53.281101 31244 leader_election.cc:343] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:53.282279 31243 leader_election.cc:343] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.283006 31650 raft_consensus.cc:493] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.283588 31650 raft_consensus.cc:515] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.285974 31650 leader_election.cc:290] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:53.287634 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c590f5280eb4ea99fbfbe28c2630d55" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:53.288002 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c590f5280eb4ea99fbfbe28c2630d55" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:53.288388 31354 raft_consensus.cc:2468] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:53.290977 31400 tablet_bootstrap.cc:654] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.294078 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e3a964ca446edb98d1ad6c8984716" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:53.296263 31202 raft_consensus.cc:2468] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:53.297437 31169 leader_election.cc:304] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
W20260709 12:20:53.298218 31168 leader_election.cc:343] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.298964 31243 leader_election.cc:304] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:53.299459 31474 leader_election.cc:290] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:53.300005 31608 raft_consensus.cc:2804] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.300501 31608 raft_consensus.cc:493] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.300863 31608 raft_consensus.cc:3060] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.301326 31602 raft_consensus.cc:2804] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.301774 31602 raft_consensus.cc:493] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.302134 31602 raft_consensus.cc:3060] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.311331 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de710065f7ad4be19742d79b91324d29" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:53.310623 31024 catalog_manager.cc:5697] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.312136 31202 raft_consensus.cc:3060] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.317092 31608 raft_consensus.cc:515] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.317975 31399 raft_consensus.cc:359] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.318136 31524 consensus_queue.cc:1048] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:53.324743 31402 tablet_bootstrap.cc:492] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:53.325454 31402 ts_tablet_manager.cc:1403] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.198s	user 0.009s	sys 0.026s
I20260709 12:20:53.318848 31399 raft_consensus.cc:385] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.329622 31399 raft_consensus.cc:740] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.333063 31399 consensus_queue.cc:260] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.336578 31401 tablet_bootstrap.cc:492] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:53.337958 31608 leader_election.cc:290] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:53.336153 31402 raft_consensus.cc:359] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.340870 31402 raft_consensus.cc:385] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.341308 31402 raft_consensus.cc:740] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.342155 31402 consensus_queue.cc:260] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.340591 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e3a964ca446edb98d1ad6c8984716" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:53.339236 31399 ts_tablet_manager.cc:1434] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.001s
I20260709 12:20:53.343873 31401 ts_tablet_manager.cc:1403] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.009s
I20260709 12:20:53.342909 31125 raft_consensus.cc:2468] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:53.350414 31402 ts_tablet_manager.cc:1434] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.002s
W20260709 12:20:53.351831 31244 leader_election.cc:343] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.355326 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e3a964ca446edb98d1ad6c8984716" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:53.356093 31201 raft_consensus.cc:3060] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.368146 31201 raft_consensus.cc:2468] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:53.370577 31591 raft_consensus.cc:493] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.371335 31591 raft_consensus.cc:515] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.372007 31243 leader_election.cc:304] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:53.372184 31021 catalog_manager.cc:5697] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.374197 31591 leader_election.cc:290] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:53.376477 31534 raft_consensus.cc:2804] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.377100 31534 raft_consensus.cc:697] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:53.378180 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:53.378078 31534 consensus_queue.cc:237] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.342641 31602 raft_consensus.cc:515] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.384761 31399 tablet_bootstrap.cc:492] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:53.389271 31402 tablet_bootstrap.cc:492] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:53.393469 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:53.394646 31201 raft_consensus.cc:2393] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b87862f0eb448db7779e995eb84f64 in current term 1: Already voted for candidate ee8bcffe388e4e0796bc17d15b7adcde in this term.
I20260709 12:20:53.396238 31092 leader_election.cc:304] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
W20260709 12:20:53.396683 31093 consensus_peers.cc:597] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 -> Peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Couldn't send request to peer 9800423c0012421d9ce299e8c180ac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:53.397660 31591 raft_consensus.cc:3060] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.398151 31524 consensus_queue.cc:1048] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.400753 31420 raft_consensus.cc:493] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.401304 31420 raft_consensus.cc:515] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.407793 31420 leader_election.cc:290] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:53.408030 31591 raft_consensus.cc:2749] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.408509 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37a6f0ffae493aa28e03c18d52e48f" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
W20260709 12:20:53.409826 31092 leader_election.cc:343] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.412036 31402 tablet_bootstrap.cc:654] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.414505 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37a6f0ffae493aa28e03c18d52e48f" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:53.416054 31092 leader_election.cc:343] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.417330 31602 leader_election.cc:290] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:53.418188 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c590f5280eb4ea99fbfbe28c2630d55" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:53.419677 31400 tablet_bootstrap.cc:492] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:53.419571 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c590f5280eb4ea99fbfbe28c2630d55" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:53.420295 31354 raft_consensus.cc:3060] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:53.420220 31168 leader_election.cc:343] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.416563 31092 leader_election.cc:304] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:53.421875 31401 raft_consensus.cc:359] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.422679 31401 raft_consensus.cc:385] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.422962 31401 raft_consensus.cc:740] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.420339 31400 ts_tablet_manager.cc:1403] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.141s	user 0.026s	sys 0.021s
I20260709 12:20:53.426285 31401 consensus_queue.cc:260] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.429052 31400 raft_consensus.cc:359] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.429822 31400 raft_consensus.cc:385] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.430367 31400 raft_consensus.cc:740] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.382736 31202 raft_consensus.cc:2468] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:53.434911 31243 leader_election.cc:304] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:53.431192 31400 consensus_queue.cc:260] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.436527 31409 raft_consensus.cc:2804] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.437639 31409 raft_consensus.cc:697] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:53.438663 31409 consensus_queue.cc:237] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.439126 31400 ts_tablet_manager.cc:1434] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:20:53.441594 31354 raft_consensus.cc:2468] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:53.442649 31400 tablet_bootstrap.cc:492] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:53.442914 31169 leader_election.cc:304] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:53.451210 31401 ts_tablet_manager.cc:1434] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.000s
I20260709 12:20:53.452791 31399 tablet_bootstrap.cc:654] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.451300 31464 raft_consensus.cc:2804] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.458491 31464 raft_consensus.cc:697] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:53.459558 31464 consensus_queue.cc:237] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.443266 31591 raft_consensus.cc:2749] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.467008 31401 tablet_bootstrap.cc:492] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:53.486608 31534 consensus_queue.cc:1048] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:53.488440 31400 tablet_bootstrap.cc:654] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.500784 31420 consensus_queue.cc:1048] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:53.509562 31402 tablet_bootstrap.cc:492] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:53.510126 31402 ts_tablet_manager.cc:1403] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.121s	user 0.016s	sys 0.006s
I20260709 12:20:53.509361 31464 raft_consensus.cc:493] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.529047 31474 raft_consensus.cc:493] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.530922 31474 raft_consensus.cc:515] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.533365 31474 leader_election.cc:290] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:53.535246 31464 raft_consensus.cc:515] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.538866 31022 catalog_manager.cc:5697] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:53.540735 31464 leader_election.cc:290] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:53.541071 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f9f2ccc422431581e845d7df278107" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:53.541290 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f9f2ccc422431581e845d7df278107" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:53.541872 31350 raft_consensus.cc:2468] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:53.541632 31022 catalog_manager.cc:5697] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.543651 31244 leader_election.cc:304] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
W20260709 12:20:53.545794 31243 leader_election.cc:343] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.529906 31402 raft_consensus.cc:359] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.548727 31402 raft_consensus.cc:385] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.549065 31402 raft_consensus.cc:740] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.549835 31402 consensus_queue.cc:260] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.550808 31534 raft_consensus.cc:2804] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:53.551342 31534 raft_consensus.cc:493] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:53.553167 31534 raft_consensus.cc:3060] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.555430 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256c4c6b88d240658c96e3d2b37b1d51" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:53.557581 31168 leader_election.cc:343] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.526043 31409 raft_consensus.cc:493] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.562812 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256c4c6b88d240658c96e3d2b37b1d51" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:53.568954 31169 leader_election.cc:343] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.563284 31024 catalog_manager.cc:5697] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:53.570971 31409 raft_consensus.cc:515] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.572562 31169 leader_election.cc:304] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:53.579654 31602 raft_consensus.cc:2749] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.582805 31608 consensus_queue.cc:1048] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:53.586905 31409 leader_election.cc:290] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:53.589790 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c590f5280eb4ea99fbfbe28c2630d55" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:53.591015 31350 raft_consensus.cc:2393] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ee8bcffe388e4e0796bc17d15b7adcde in current term 1: Already voted for candidate 1d5ebd798965493785b198d6e8492c23 in this term.
I20260709 12:20:53.597581 31399 tablet_bootstrap.cc:492] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:53.601775 31399 ts_tablet_manager.cc:1403] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.218s	user 0.013s	sys 0.006s
I20260709 12:20:53.602777 31401 tablet_bootstrap.cc:654] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.605185 31399 raft_consensus.cc:359] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.605962 31399 raft_consensus.cc:385] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.606261 31399 raft_consensus.cc:740] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.552402 31402 ts_tablet_manager.cc:1434] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 12:20:53.599006 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c590f5280eb4ea99fbfbe28c2630d55" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:53.607910 31402 tablet_bootstrap.cc:492] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:53.607625 31399 consensus_queue.cc:260] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.613071 31399 ts_tablet_manager.cc:1434] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:20:53.616039 31399 tablet_bootstrap.cc:492] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:53.609716 31668 raft_consensus.cc:493] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.621867 31668 raft_consensus.cc:515] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.624209 31668 leader_election.cc:290] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:53.624472 31399 tablet_bootstrap.cc:654] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.625466 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:53.626643 31203 raft_consensus.cc:2393] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b87862f0eb448db7779e995eb84f64 in current term 1: Already voted for candidate 9800423c0012421d9ce299e8c180ac96 in this term.
I20260709 12:20:53.629603 31402 tablet_bootstrap.cc:654] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.662089 31243 leader_election.cc:304] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:53.667577 31402 tablet_bootstrap.cc:492] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:53.668735 31402 ts_tablet_manager.cc:1403] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.007s
I20260709 12:20:53.687904 31400 tablet_bootstrap.cc:492] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:53.672787 31608 raft_consensus.cc:3060] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.692348 31400 ts_tablet_manager.cc:1403] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.252s	user 0.021s	sys 0.005s
I20260709 12:20:53.690820 31125 raft_consensus.cc:3060] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.697954 31474 consensus_queue.cc:1048] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:53.702123 31399 tablet_bootstrap.cc:492] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:53.702847 31399 ts_tablet_manager.cc:1403] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.087s	user 0.012s	sys 0.001s
I20260709 12:20:53.707105 31399 raft_consensus.cc:359] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.708088 31399 raft_consensus.cc:385] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.708447 31399 raft_consensus.cc:740] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.710960 31402 raft_consensus.cc:359] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.711803 31402 raft_consensus.cc:385] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.712078 31402 raft_consensus.cc:740] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.712810 31402 consensus_queue.cc:260] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.716056 31402 ts_tablet_manager.cc:1434] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:20:53.692874 31534 raft_consensus.cc:515] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.717746 31399 consensus_queue.cc:260] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.727140 31464 raft_consensus.cc:493] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.742650 31464 raft_consensus.cc:515] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.729300 31518 raft_consensus.cc:493] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:53.744287 31518 raft_consensus.cc:515] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.735630 31402 tablet_bootstrap.cc:492] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:53.747593 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:53.749863 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:53.739384 31407 consensus_queue.cc:1048] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:20:53.751744 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:53.738592 31399 ts_tablet_manager.cc:1434] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.001s
W20260709 12:20:53.753489 31168 leader_election.cc:343] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.754364 31399 tablet_bootstrap.cc:492] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:53.755306 31518 leader_election.cc:290] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
W20260709 12:20:53.757486 31169 leader_election.cc:343] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:53.757982 31169 leader_election.cc:304] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:53.758854 31602 raft_consensus.cc:2749] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.722975 31534 leader_election.cc:290] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:53.761565 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f9f2ccc422431581e845d7df278107" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:53.762248 31351 raft_consensus.cc:3060] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.765156 31464 leader_election.cc:290] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:53.762939 31534 consensus_queue.cc:1048] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:20:53.781656 31401 tablet_bootstrap.cc:492] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:53.782524 31401 ts_tablet_manager.cc:1403] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.325s	user 0.025s	sys 0.037s
I20260709 12:20:53.785930 31401 raft_consensus.cc:359] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.787496 31401 raft_consensus.cc:385] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.787796 31401 raft_consensus.cc:740] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.788537 31401 consensus_queue.cc:260] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:53.790199 31401 ts_tablet_manager.cc:1434] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:20:53.791987 31401 tablet_bootstrap.cc:492] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
W20260709 12:20:53.794554 31244 consensus_peers.cc:597] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Couldn't send request to peer 9800423c0012421d9ce299e8c180ac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:53.785879 31351 raft_consensus.cc:2468] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:53.800539 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:53.804515 31401 tablet_bootstrap.cc:654] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.809454 31317 leader_election.cc:304] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:53.804996 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "76f9f2ccc422431581e845d7df278107" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:53.806720 31402 tablet_bootstrap.cc:654] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.806608 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:53.813890 31518 raft_consensus.cc:2749] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.814297 31128 raft_consensus.cc:3060] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.836459 31244 leader_election.cc:304] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:53.839383 31093 leader_election.cc:304] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:53.840734 31474 raft_consensus.cc:2804] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:53.838758 31608 raft_consensus.cc:2749] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.841522 31474 raft_consensus.cc:697] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:53.842041 31518 consensus_queue.cc:1048] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:53.842567 31474 consensus_queue.cc:237] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:53.852342 31400 raft_consensus.cc:359] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.854606 31400 raft_consensus.cc:385] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.855012 31400 raft_consensus.cc:740] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.856060 31400 consensus_queue.cc:260] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.863116 31400 ts_tablet_manager.cc:1434] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.170s	user 0.008s	sys 0.002s
I20260709 12:20:53.872437 31400 tablet_bootstrap.cc:492] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:53.878933 31402 tablet_bootstrap.cc:492] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:53.879577 31402 ts_tablet_manager.cc:1403] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.144s	user 0.019s	sys 0.002s
I20260709 12:20:53.884594 31399 tablet_bootstrap.cc:654] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.887075 31354 raft_consensus.cc:3060] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:53.891075 31402 raft_consensus.cc:359] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.892149 31402 raft_consensus.cc:385] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.892496 31402 raft_consensus.cc:740] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.893424 31402 consensus_queue.cc:260] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:53.905458 31402 ts_tablet_manager.cc:1434] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.001s
I20260709 12:20:53.908434 31402 tablet_bootstrap.cc:492] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:53.867693 31128 raft_consensus.cc:2468] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:53.927140 31401 tablet_bootstrap.cc:492] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:53.928001 31401 ts_tablet_manager.cc:1403] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.136s	user 0.024s	sys 0.011s
I20260709 12:20:53.932361 31401 raft_consensus.cc:359] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.934091 31401 raft_consensus.cc:385] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:53.934468 31401 raft_consensus.cc:740] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:53.935427 31401 consensus_queue.cc:260] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:53.940637 31402 tablet_bootstrap.cc:654] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.918973 31400 tablet_bootstrap.cc:654] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.942824 31401 ts_tablet_manager.cc:1434] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:20:53.945118 31401 tablet_bootstrap.cc:492] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:53.958333 31696 raft_consensus.cc:2749] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:53.964427 31608 consensus_queue.cc:1048] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:20:53.976195 31401 tablet_bootstrap.cc:654] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:53.996356 31703 consensus_queue.cc:1048] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.048130 31650 consensus_queue.cc:1048] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.064661 31602 consensus_queue.cc:1048] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.065573 31524 raft_consensus.cc:493] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.066241 31524 raft_consensus.cc:515] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.068531 31524 leader_election.cc:290] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:54.070519 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e3a964ca446edb98d1ad6c8984716" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:54.072819 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b70e3a964ca446edb98d1ad6c8984716" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:54.076088 31317 leader_election.cc:304] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:54.078153 31474 raft_consensus.cc:493] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.075022 31022 catalog_manager.cc:5697] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.080292 31400 tablet_bootstrap.cc:492] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:54.080926 31400 ts_tablet_manager.cc:1403] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.217s	user 0.018s	sys 0.009s
I20260709 12:20:54.081064 31401 tablet_bootstrap.cc:492] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:54.081861 31401 ts_tablet_manager.cc:1403] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.137s	user 0.016s	sys 0.003s
W20260709 12:20:54.083295 31243 consensus_peers.cc:597] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:54.078706 31474 raft_consensus.cc:515] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.085659 31640 raft_consensus.cc:2749] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.090137 31400 raft_consensus.cc:359] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.093086 31399 tablet_bootstrap.cc:492] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:54.093386 31400 raft_consensus.cc:385] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.093860 31400 raft_consensus.cc:740] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.093925 31399 ts_tablet_manager.cc:1403] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.340s	user 0.019s	sys 0.015s
I20260709 12:20:54.096612 31400 consensus_queue.cc:260] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.111392 31474 leader_election.cc:290] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:54.106690 31401 raft_consensus.cc:359] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.115792 31401 raft_consensus.cc:385] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.116163 31401 raft_consensus.cc:740] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.117122 31401 consensus_queue.cc:260] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.117369 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37a6f0ffae493aa28e03c18d52e48f" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:54.121909 31399 raft_consensus.cc:359] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
W20260709 12:20:54.123728 31243 leader_election.cc:343] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.124440 31401 ts_tablet_manager.cc:1434] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.042s	user 0.008s	sys 0.000s
I20260709 12:20:54.124641 31399 raft_consensus.cc:385] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.131759 31400 ts_tablet_manager.cc:1434] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.000s
I20260709 12:20:54.131357 31399 raft_consensus.cc:740] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.133572 31399 consensus_queue.cc:260] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.138876 31401 tablet_bootstrap.cc:492] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:54.139318 31399 ts_tablet_manager.cc:1434] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:20:54.143672 31400 tablet_bootstrap.cc:492] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:54.144279 31399 tablet_bootstrap.cc:492] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:54.158459 31602 raft_consensus.cc:493] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.159212 31602 raft_consensus.cc:515] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.162663 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce58073b26274815b7e9542e152bd07c" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:20:54.164151 31168 leader_election.cc:343] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.172169 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce58073b26274815b7e9542e152bd07c" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:54.174466 31169 leader_election.cc:343] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.174966 31169 leader_election.cc:304] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:54.175642 31402 tablet_bootstrap.cc:492] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:54.176407 31650 raft_consensus.cc:2749] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.177603 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37a6f0ffae493aa28e03c18d52e48f" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:54.178387 31127 raft_consensus.cc:2468] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
W20260709 12:20:54.180560 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:54.189088 31243 leader_election.cc:304] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23
I20260709 12:20:54.190316 31531 raft_consensus.cc:2804] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.190732 31531 raft_consensus.cc:493] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.191104 31531 raft_consensus.cc:3060] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.176530 31402 ts_tablet_manager.cc:1403] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.268s	user 0.049s	sys 0.011s
I20260709 12:20:54.195451 31474 raft_consensus.cc:493] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.196018 31474 raft_consensus.cc:515] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.170846 31602 leader_election.cc:290] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:54.203825 31474 leader_election.cc:290] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:54.204283 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256c4c6b88d240658c96e3d2b37b1d51" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:54.205080 31202 raft_consensus.cc:2468] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:54.208361 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256c4c6b88d240658c96e3d2b37b1d51" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:54.207875 31243 leader_election.cc:304] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
W20260709 12:20:54.210328 31244 leader_election.cc:343] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.211333 31531 raft_consensus.cc:515] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.211886 31474 raft_consensus.cc:2804] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.214877 31400 tablet_bootstrap.cc:654] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.215293 31474 raft_consensus.cc:493] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.216118 31474 raft_consensus.cc:3060] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.224628 31474 raft_consensus.cc:515] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.224900 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37a6f0ffae493aa28e03c18d52e48f" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:54.225631 31127 raft_consensus.cc:3060] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.228739 31399 tablet_bootstrap.cc:654] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.215631 31401 tablet_bootstrap.cc:654] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.232334 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256c4c6b88d240658c96e3d2b37b1d51" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:54.232702 31474 leader_election.cc:290] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:54.232441 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256c4c6b88d240658c96e3d2b37b1d51" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:54.233160 31202 raft_consensus.cc:3060] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:54.234453 31244 leader_election.cc:343] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.236140 31640 raft_consensus.cc:493] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.236732 31640 raft_consensus.cc:515] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.238261 31400 tablet_bootstrap.cc:492] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:54.238970 31400 ts_tablet_manager.cc:1403] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.004s
I20260709 12:20:54.239207 31640 leader_election.cc:290] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:54.239449 31402 raft_consensus.cc:359] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.240862 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:54.241181 31402 raft_consensus.cc:385] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.241614 31402 raft_consensus.cc:740] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.242317 31402 consensus_queue.cc:260] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
W20260709 12:20:54.242846 31317 leader_election.cc:343] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.242344 31400 raft_consensus.cc:359] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.244848 31400 raft_consensus.cc:385] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.245110 31400 raft_consensus.cc:740] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.246500 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:54.245782 31400 consensus_queue.cc:260] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
W20260709 12:20:54.248206 31317 leader_election.cc:343] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.248859 31317 leader_election.cc:304] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:54.245745 31402 ts_tablet_manager.cc:1434] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.051s	user 0.008s	sys 0.000s
I20260709 12:20:54.250340 31640 raft_consensus.cc:2749] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.250638 31400 ts_tablet_manager.cc:1434] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:20:54.251217 31402 tablet_bootstrap.cc:492] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:54.251787 31400 tablet_bootstrap.cc:492] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:54.259124 31400 tablet_bootstrap.cc:654] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.260672 31202 raft_consensus.cc:2468] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:54.266896 31602 raft_consensus.cc:493] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.267117 31243 leader_election.cc:304] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:54.267515 31602 raft_consensus.cc:515] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.268004 31474 raft_consensus.cc:2804] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.268627 31474 raft_consensus.cc:697] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:54.269770 31474 consensus_queue.cc:237] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.271337 31602 leader_election.cc:290] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:54.263819 31531 leader_election.cc:290] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:54.265565 31127 raft_consensus.cc:2468] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:54.263566 31402 tablet_bootstrap.cc:654] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.272214 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fcea95aa024b629aecb6d0ff49c9d1" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:54.272591 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fcea95aa024b629aecb6d0ff49c9d1" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:54.263384 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37a6f0ffae493aa28e03c18d52e48f" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
W20260709 12:20:54.274530 31243 leader_election.cc:343] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:54.274655 31168 leader_election.cc:343] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.275696 31125 raft_consensus.cc:2468] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:54.277235 31168 leader_election.cc:304] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:54.278330 31464 raft_consensus.cc:2804] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.278790 31464 raft_consensus.cc:493] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.279172 31464 raft_consensus.cc:3060] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.287998 31400 tablet_bootstrap.cc:492] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:54.288609 31400 ts_tablet_manager.cc:1403] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.006s
I20260709 12:20:54.289261 31352 raft_consensus.cc:3060] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.291929 31400 raft_consensus.cc:359] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.292789 31400 raft_consensus.cc:385] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.293074 31400 raft_consensus.cc:740] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.293787 31400 consensus_queue.cc:260] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.295091 31243 leader_election.cc:304] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23
I20260709 12:20:54.296417 31464 raft_consensus.cc:515] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.296990 31534 raft_consensus.cc:2804] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.298705 31534 raft_consensus.cc:697] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:54.299646 31534 consensus_queue.cc:237] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.305269 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fcea95aa024b629aecb6d0ff49c9d1" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:54.305965 31127 raft_consensus.cc:3060] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.318224 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fcea95aa024b629aecb6d0ff49c9d1" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:54.319645 31464 leader_election.cc:290] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
W20260709 12:20:54.320544 31168 leader_election.cc:343] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.321514 31127 raft_consensus.cc:2468] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:54.322831 31168 leader_election.cc:304] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:54.327318 31640 raft_consensus.cc:493] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.327877 31640 raft_consensus.cc:515] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.328720 31602 raft_consensus.cc:2804] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.329303 31602 raft_consensus.cc:697] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:54.330209 31640 leader_election.cc:290] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:54.332285 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:54.333076 31022 catalog_manager.cc:5697] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:54.333910 31317 leader_election.cc:343] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.330297 31602 consensus_queue.cc:237] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.337188 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:54.338078 31201 raft_consensus.cc:2468] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:54.338922 31400 ts_tablet_manager.cc:1434] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:20:54.340087 31400 tablet_bootstrap.cc:492] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:54.341991 31317 leader_election.cc:304] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:54.344298 31407 raft_consensus.cc:2804] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.344821 31407 raft_consensus.cc:493] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.345194 31407 raft_consensus.cc:3060] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.345645 31402 tablet_bootstrap.cc:492] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:54.346184 31402 ts_tablet_manager.cc:1403] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.095s	user 0.019s	sys 0.001s
I20260709 12:20:54.349702 31400 tablet_bootstrap.cc:654] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.352198 31474 raft_consensus.cc:493] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.352461 31402 raft_consensus.cc:359] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.353310 31402 raft_consensus.cc:385] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.352916 31474 raft_consensus.cc:515] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.353622 31402 raft_consensus.cc:740] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.358464 31402 consensus_queue.cc:260] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.360220 31474 leader_election.cc:290] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:54.361064 31402 ts_tablet_manager.cc:1434] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.000s
I20260709 12:20:54.366039 31402 tablet_bootstrap.cc:492] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:54.370194 31407 raft_consensus.cc:515] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.372536 31407 leader_election.cc:290] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:54.373883 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:54.375820 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce58073b26274815b7e9542e152bd07c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:54.376802 31401 tablet_bootstrap.cc:492] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:54.376605 31202 raft_consensus.cc:2468] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:54.377404 31401 ts_tablet_manager.cc:1403] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.242s	user 0.021s	sys 0.000s
I20260709 12:20:54.374164 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
W20260709 12:20:54.379817 31317 leader_election.cc:343] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.384037 31402 tablet_bootstrap.cc:654] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.384932 31400 tablet_bootstrap.cc:492] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:54.386385 31400 ts_tablet_manager.cc:1403] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.009s
I20260709 12:20:54.390074 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce58073b26274815b7e9542e152bd07c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:54.398427 31399 tablet_bootstrap.cc:492] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:54.399077 31399 ts_tablet_manager.cc:1403] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.258s	user 0.015s	sys 0.008s
W20260709 12:20:54.406109 31244 leader_election.cc:343] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.383211 31201 raft_consensus.cc:3060] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.414871 31399 raft_consensus.cc:359] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.416673 31399 raft_consensus.cc:385] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.416992 31399 raft_consensus.cc:740] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.417768 31399 consensus_queue.cc:260] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.422261 31399 ts_tablet_manager.cc:1434] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.002s
I20260709 12:20:54.424113 31399 tablet_bootstrap.cc:492] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:54.431267 31401 raft_consensus.cc:359] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.430450 31608 consensus_queue.cc:1048] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.432240 31401 raft_consensus.cc:385] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.436964 31401 raft_consensus.cc:740] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
W20260709 12:20:54.432195 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 55541.6us
I20260709 12:20:54.443152 31243 leader_election.cc:304] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:54.446115 31474 raft_consensus.cc:2804] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.446483 31474 raft_consensus.cc:493] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.446878 31474 raft_consensus.cc:3060] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.451426 31401 consensus_queue.cc:260] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.453866 31401 ts_tablet_manager.cc:1434] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.076s	user 0.007s	sys 0.002s
I20260709 12:20:54.484059 31399 tablet_bootstrap.cc:654] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:54.489778 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 46812.3us
I20260709 12:20:54.490593 31401 tablet_bootstrap.cc:492] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:54.505777 31602 raft_consensus.cc:493] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.511372 31591 raft_consensus.cc:493] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.511955 31602 raft_consensus.cc:515] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.512060 31591 raft_consensus.cc:515] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.512969 31402 tablet_bootstrap.cc:492] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:54.513581 31402 ts_tablet_manager.cc:1403] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.148s	user 0.030s	sys 0.057s
I20260709 12:20:54.501478 31474 raft_consensus.cc:515] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.514568 31591 leader_election.cc:290] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:54.515761 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83751ae3dbd4d78add4ddcbf77254a4" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:54.514537 31602 leader_election.cc:290] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:54.515946 31531 consensus_queue.cc:1048] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:20:54.523823 31128 raft_consensus.cc:2468] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:54.515722 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de710065f7ad4be19742d79b91324d29" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:54.518296 31402 raft_consensus.cc:359] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.525516 31402 raft_consensus.cc:385] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.525820 31402 raft_consensus.cc:740] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.526585 31168 leader_election.cc:304] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:54.526779 31402 consensus_queue.cc:260] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.527567 31602 raft_consensus.cc:2804] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.528081 31602 raft_consensus.cc:493] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.528438 31602 raft_consensus.cc:3060] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.532102 31474 leader_election.cc:290] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:54.537015 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce58073b26274815b7e9542e152bd07c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:54.533115 31024 catalog_manager.cc:5697] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:54.535379 31402 ts_tablet_manager.cc:1434] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.002s
W20260709 12:20:54.543710 31244 leader_election.cc:343] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.545549 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83751ae3dbd4d78add4ddcbf77254a4" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:54.546298 31354 raft_consensus.cc:2468] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:54.547606 31402 tablet_bootstrap.cc:492] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:54.548591 31199 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce58073b26274815b7e9542e152bd07c" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:54.549084 31201 raft_consensus.cc:2468] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:54.549398 31199 raft_consensus.cc:3060] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.552173 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de710065f7ad4be19742d79b91324d29" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:54.546473 31021 catalog_manager.cc:5697] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.513736 31400 raft_consensus.cc:359] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.560381 31400 raft_consensus.cc:385] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.560787 31400 raft_consensus.cc:740] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.561535 31402 tablet_bootstrap.cc:654] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.561560 31092 leader_election.cc:304] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:54.561702 31400 consensus_queue.cc:260] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.563217 31696 raft_consensus.cc:2749] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.565249 31400 ts_tablet_manager.cc:1434] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.167s	user 0.011s	sys 0.000s
I20260709 12:20:54.566427 31400 tablet_bootstrap.cc:492] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:54.570652 31401 tablet_bootstrap.cc:654] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.573530 31317 leader_election.cc:304] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:54.574712 31640 raft_consensus.cc:2804] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.575328 31640 raft_consensus.cc:697] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:54.576220 31640 consensus_queue.cc:237] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.607657 31400 tablet_bootstrap.cc:654] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.598529 31602 raft_consensus.cc:515] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.623157 31401 tablet_bootstrap.cc:492] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:54.623888 31401 ts_tablet_manager.cc:1403] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.169s	user 0.010s	sys 0.008s
I20260709 12:20:54.625409 31199 raft_consensus.cc:2468] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:54.638569 31399 tablet_bootstrap.cc:492] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:54.641563 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83751ae3dbd4d78add4ddcbf77254a4" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:54.650004 31125 raft_consensus.cc:3060] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.653597 31401 raft_consensus.cc:359] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.654661 31401 raft_consensus.cc:385] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.655076 31401 raft_consensus.cc:740] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.656198 31402 tablet_bootstrap.cc:492] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:54.656111 31401 consensus_queue.cc:260] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
W20260709 12:20:54.642102 31317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37949, user_credentials={real_user=slave}} blocked reactor thread for 57326.4us
I20260709 12:20:54.656965 31402 ts_tablet_manager.cc:1403] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.052s
I20260709 12:20:54.656864 31128 raft_consensus.cc:3060] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.656353 31399 ts_tablet_manager.cc:1403] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.233s	user 0.019s	sys 0.008s
I20260709 12:20:54.661002 31399 raft_consensus.cc:359] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.661733 31399 raft_consensus.cc:385] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.661351 31402 raft_consensus.cc:359] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.662063 31399 raft_consensus.cc:740] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.662242 31402 raft_consensus.cc:385] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.662640 31402 raft_consensus.cc:740] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.664135 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f83751ae3dbd4d78add4ddcbf77254a4" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:54.662937 31399 consensus_queue.cc:260] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.674391 31354 raft_consensus.cc:3060] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.674911 31243 leader_election.cc:304] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:54.675980 31474 raft_consensus.cc:2804] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.676229 31399 ts_tablet_manager.cc:1434] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:20:54.676489 31474 raft_consensus.cc:697] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:54.677559 31474 consensus_queue.cc:237] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.678112 31399 tablet_bootstrap.cc:492] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:54.666401 31402 consensus_queue.cc:260] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.668378 31400 tablet_bootstrap.cc:492] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:54.682969 31400 ts_tablet_manager.cc:1403] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.117s	user 0.010s	sys 0.007s
I20260709 12:20:54.686156 31399 tablet_bootstrap.cc:654] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.682060 31402 ts_tablet_manager.cc:1434] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:20:54.686818 31464 raft_consensus.cc:493] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.687501 31464 raft_consensus.cc:515] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.690001 31464 leader_election.cc:290] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:54.691699 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37a6f0ffae493aa28e03c18d52e48f" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:54.693205 31354 raft_consensus.cc:2468] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:54.693678 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c37a6f0ffae493aa28e03c18d52e48f" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:54.695205 31127 raft_consensus.cc:2393] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d5ebd798965493785b198d6e8492c23 in current term 1: Already voted for candidate ee8bcffe388e4e0796bc17d15b7adcde in this term.
I20260709 12:20:54.702267 31168 leader_election.cc:304] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:54.704726 31650 raft_consensus.cc:3060] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.710006 31591 raft_consensus.cc:493] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.710839 31591 raft_consensus.cc:515] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.686231 31400 raft_consensus.cc:359] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.715764 31400 raft_consensus.cc:385] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.671002 31401 ts_tablet_manager.cc:1434] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 12:20:54.687955 31402 tablet_bootstrap.cc:492] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:54.717396 31401 tablet_bootstrap.cc:492] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:54.712091 31732 raft_consensus.cc:493] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.719502 31732 raft_consensus.cc:515] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.723315 31640 raft_consensus.cc:493] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.724014 31640 raft_consensus.cc:515] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.725405 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:54.726217 31352 raft_consensus.cc:2468] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:54.671820 31602 leader_election.cc:290] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:54.727567 31640 leader_election.cc:290] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:54.727591 31244 leader_election.cc:304] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:54.729352 31703 raft_consensus.cc:2804] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.729755 31703 raft_consensus.cc:493] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.730110 31703 raft_consensus.cc:3060] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.734402 31591 leader_election.cc:290] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:54.734627 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dda8bf3c6e5443fa3dcaf9b4dbf8417" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:54.716229 31400 raft_consensus.cc:740] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
W20260709 12:20:54.736588 31093 leader_election.cc:343] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.736292 31400 consensus_queue.cc:260] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.739513 31650 raft_consensus.cc:2749] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:54.739787 31703 raft_consensus.cc:515] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.741971 31703 leader_election.cc:290] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:54.743038 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:54.743803 31352 raft_consensus.cc:3060] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.745267 31400 ts_tablet_manager.cc:1434] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.002s
I20260709 12:20:54.739543 31732 leader_election.cc:290] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:54.753856 31400 tablet_bootstrap.cc:492] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:54.758682 31352 raft_consensus.cc:2468] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:54.758846 31169 leader_election.cc:304] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:20:54.759899 31650 raft_consensus.cc:2804] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.760736 31650 raft_consensus.cc:697] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:54.761080 31402 tablet_bootstrap.cc:654] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.766877 31650 consensus_queue.cc:237] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.770285 31732 consensus_queue.cc:1048] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.772570 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:54.775023 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:54.775682 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dda8bf3c6e5443fa3dcaf9b4dbf8417" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:54.776458 31277 raft_consensus.cc:2468] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:54.776466 31244 leader_election.cc:304] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:54.778080 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce58073b26274815b7e9542e152bd07c" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:54.778353 31474 raft_consensus.cc:2804] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.779060 31474 raft_consensus.cc:697] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
W20260709 12:20:54.780202 31243 leader_election.cc:343] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.780203 31474 consensus_queue.cc:237] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
W20260709 12:20:54.781335 31243 leader_election.cc:343] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.780249 31092 leader_election.cc:304] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:54.783319 31401 tablet_bootstrap.cc:654] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.783872 31696 raft_consensus.cc:2804] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:54.784337 31696 raft_consensus.cc:493] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:54.784713 31696 raft_consensus.cc:3060] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.787005 31026 catalog_manager.cc:5697] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.786736 31125 raft_consensus.cc:2468] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:54.793322 31399 tablet_bootstrap.cc:492] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:54.793949 31399 ts_tablet_manager.cc:1403] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.116s	user 0.034s	sys 0.035s
I20260709 12:20:54.788094 31402 tablet_bootstrap.cc:492] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:54.797681 31402 ts_tablet_manager.cc:1403] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.004s
I20260709 12:20:54.801329 31021 catalog_manager.cc:5697] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.802553 31399 raft_consensus.cc:359] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.803292 31399 raft_consensus.cc:385] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.803566 31399 raft_consensus.cc:740] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.810072 31399 consensus_queue.cc:260] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:54.807029 31696 raft_consensus.cc:515] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.812733 31399 ts_tablet_manager.cc:1434] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:20:54.813766 31399 tablet_bootstrap.cc:492] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:54.813723 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dda8bf3c6e5443fa3dcaf9b4dbf8417" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:54.814209 31696 leader_election.cc:290] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:54.814546 31277 raft_consensus.cc:3060] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.819685 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dda8bf3c6e5443fa3dcaf9b4dbf8417" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
W20260709 12:20:54.821621 31093 leader_election.cc:343] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:54.824326 31278 raft_consensus.cc:3060] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:54.846572 31244 consensus_peers.cc:597] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Couldn't send request to peer 9800423c0012421d9ce299e8c180ac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:54.847285 31400 tablet_bootstrap.cc:654] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.850303 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce58073b26274815b7e9542e152bd07c" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:54.851342 31201 raft_consensus.cc:2393] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9800423c0012421d9ce299e8c180ac96 in current term 1: Already voted for candidate ee8bcffe388e4e0796bc17d15b7adcde in this term.
I20260709 12:20:54.852516 31474 consensus_queue.cc:1048] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:54.852911 31277 raft_consensus.cc:2468] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:54.854274 31092 leader_election.cc:304] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:54.855266 31696 raft_consensus.cc:2804] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:54.855553 31402 raft_consensus.cc:359] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.856369 31402 raft_consensus.cc:385] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.856691 31402 raft_consensus.cc:740] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.858042 31402 consensus_queue.cc:260] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:54.856027 31696 raft_consensus.cc:697] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:54.859545 31703 consensus_queue.cc:1048] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.855962 31024 catalog_manager.cc:5697] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:54.861245 31696 consensus_queue.cc:237] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.866739 31401 tablet_bootstrap.cc:492] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:54.867430 31401 ts_tablet_manager.cc:1403] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.004s
I20260709 12:20:54.868149 31402 ts_tablet_manager.cc:1434] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 12:20:54.869143 31402 tablet_bootstrap.cc:492] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:54.889997 31401 raft_consensus.cc:359] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.890756 31401 raft_consensus.cc:385] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.891067 31401 raft_consensus.cc:740] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.902163 31317 leader_election.cc:304] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:54.905382 31401 consensus_queue.cc:260] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.905462 31742 raft_consensus.cc:3060] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:54.917469 31399 tablet_bootstrap.cc:654] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:54.927748 31650 consensus_queue.cc:1048] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.941918 31401 ts_tablet_manager.cc:1434] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.074s	user 0.008s	sys 0.000s
I20260709 12:20:54.949007 31703 raft_consensus.cc:493] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.949918 31703 raft_consensus.cc:515] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:54.951356 31746 consensus_queue.cc:1048] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:54.964061 31401 tablet_bootstrap.cc:492] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:54.978420 31524 raft_consensus.cc:493] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:54.979171 31524 raft_consensus.cc:515] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.981576 31524 leader_election.cc:290] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:54.985713 31703 leader_election.cc:290] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:54.985997 31400 tablet_bootstrap.cc:492] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:54.986526 31400 ts_tablet_manager.cc:1403] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.240s	user 0.014s	sys 0.023s
I20260709 12:20:54.989866 31400 raft_consensus.cc:359] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:54.990559 31400 raft_consensus.cc:385] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:54.990870 31400 raft_consensus.cc:740] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:54.992766 31021 catalog_manager.cc:5697] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.005014 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fcea95aa024b629aecb6d0ff49c9d1" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:55.005404 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20fcea95aa024b629aecb6d0ff49c9d1" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:55.006800 31026 catalog_manager.cc:5697] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:55.010687 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dda8bf3c6e5443fa3dcaf9b4dbf8417" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:55.029523 31243 leader_election.cc:304] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:55.029893 31277 raft_consensus.cc:2393] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9800423c0012421d9ce299e8c180ac96 in current term 1: Already voted for candidate e3b87862f0eb448db7779e995eb84f64 in this term.
I20260709 12:20:55.016991 31129 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dda8bf3c6e5443fa3dcaf9b4dbf8417" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:54.991534 31400 consensus_queue.cc:260] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.034741 31400 ts_tablet_manager.cc:1434] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:20:55.040822 31317 leader_election.cc:304] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:55.041712 31400 tablet_bootstrap.cc:492] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:54.990909 31402 tablet_bootstrap.cc:654] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.042873 31524 raft_consensus.cc:3060] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.008895 31696 raft_consensus.cc:493] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.046998 31742 raft_consensus.cc:2749] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.039134 31399 tablet_bootstrap.cc:492] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:55.052958 31399 ts_tablet_manager.cc:1403] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.239s	user 0.055s	sys 0.029s
I20260709 12:20:55.050961 31696 raft_consensus.cc:515] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.074736 31696 leader_election.cc:290] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:55.077303 31400 tablet_bootstrap.cc:654] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.078161 31703 raft_consensus.cc:493] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.078770 31703 raft_consensus.cc:515] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.079591 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66c15cae85a4a45bae00ea0560859d7" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:55.082346 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:55.088197 31244 leader_election.cc:343] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:55.091373 31092 leader_election.cc:343] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.102027 31399 raft_consensus.cc:359] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.103425 31399 raft_consensus.cc:385] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.103811 31399 raft_consensus.cc:740] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.112041 31402 tablet_bootstrap.cc:492] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:55.108964 31399 consensus_queue.cc:260] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.115839 31402 ts_tablet_manager.cc:1403] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.247s	user 0.009s	sys 0.009s
W20260709 12:20:55.105268 31757 log.cc:927] Time spent T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 12:20:55.107110 31761 raft_consensus.cc:493] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.105538 31703 leader_election.cc:290] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:55.129441 31399 ts_tablet_manager.cc:1434] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.076s	user 0.009s	sys 0.002s
I20260709 12:20:55.131278 31399 tablet_bootstrap.cc:492] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:55.116793 31531 raft_consensus.cc:2749] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:55.139736 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66c15cae85a4a45bae00ea0560859d7" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:55.144209 31401 tablet_bootstrap.cc:654] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.131080 31761 raft_consensus.cc:515] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.172101 31746 raft_consensus.cc:493] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.174870 31746 raft_consensus.cc:515] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.176184 31129 raft_consensus.cc:3060] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:55.176319 31093 leader_election.cc:343] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.176915 31093 leader_election.cc:304] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:55.177177 31746 leader_election.cc:290] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:55.177594 31402 raft_consensus.cc:359] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.178344 31402 raft_consensus.cc:385] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.178618 31402 raft_consensus.cc:740] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.178776 31755 raft_consensus.cc:2749] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.179473 31402 consensus_queue.cc:260] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.180667 31354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:55.181267 31742 consensus_queue.cc:1048] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:55.183075 31400 tablet_bootstrap.cc:492] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:55.183712 31400 ts_tablet_manager.cc:1403] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.142s	user 0.025s	sys 0.005s
I20260709 12:20:55.183856 31402 ts_tablet_manager.cc:1434] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.068s	user 0.008s	sys 0.000s
I20260709 12:20:55.185238 31402 tablet_bootstrap.cc:492] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:20:55.186643 31169 leader_election.cc:343] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.188807 31352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:55.187199 31400 raft_consensus.cc:359] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.187866 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:55.202960 31400 raft_consensus.cc:385] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.203369 31400 raft_consensus.cc:740] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
W20260709 12:20:55.204007 31092 leader_election.cc:343] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.205714 31640 consensus_queue.cc:1048] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:55.195227 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
W20260709 12:20:55.217144 31093 leader_election.cc:343] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.217490 31755 raft_consensus.cc:493] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.217818 31093 leader_election.cc:304] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:55.218176 31755 raft_consensus.cc:515] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.219909 31591 raft_consensus.cc:2749] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.220829 31755 leader_election.cc:290] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:55.171907 31761 leader_election.cc:290] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:55.216696 31400 consensus_queue.cc:260] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.234666 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:55.195832 31524 raft_consensus.cc:2749] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.252372 31732 consensus_queue.cc:1048] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:55.254765 31732 consensus_queue.cc:1048] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:55.257493 31168 leader_election.cc:343] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.258152 31168 leader_election.cc:304] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:55.259097 31464 raft_consensus.cc:2749] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.247766 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:55.262624 31400 ts_tablet_manager.cc:1434] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.079s	user 0.003s	sys 0.005s
I20260709 12:20:55.265065 31400 tablet_bootstrap.cc:492] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:55.278366 31474 consensus_queue.cc:1048] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:55.292577 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:55.285925 31746 raft_consensus.cc:493] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:20:55.285425 31093 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:36383, user_credentials={real_user=slave}} blocked reactor thread for 66514.9us
I20260709 12:20:55.304445 31746 raft_consensus.cc:515] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.333256 31400 tablet_bootstrap.cc:654] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.334362 31399 tablet_bootstrap.cc:654] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.343763 31464 consensus_queue.cc:1048] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:55.351792 31402 tablet_bootstrap.cc:654] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.374163 31401 tablet_bootstrap.cc:492] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:55.374966 31401 ts_tablet_manager.cc:1403] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.411s	user 0.015s	sys 0.008s
I20260709 12:20:55.378794 31401 raft_consensus.cc:359] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.383091 31401 raft_consensus.cc:385] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.383529 31401 raft_consensus.cc:740] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.385763 31401 consensus_queue.cc:260] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.400499 31401 ts_tablet_manager.cc:1434] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260709 12:20:55.407059 31399 tablet_bootstrap.cc:492] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:55.407833 31399 ts_tablet_manager.cc:1403] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.277s	user 0.013s	sys 0.009s
I20260709 12:20:55.412606 31128 raft_consensus.cc:3060] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.414552 31399 raft_consensus.cc:359] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.415428 31399 raft_consensus.cc:385] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.415742 31399 raft_consensus.cc:740] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.417248 31399 consensus_queue.cc:260] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.432894 31399 ts_tablet_manager.cc:1434] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:20:55.434603 31399 tablet_bootstrap.cc:492] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:55.442287 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f45cc601c2c422b933c4fd00560db82" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:55.443396 31277 raft_consensus.cc:2468] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:55.445662 31401 tablet_bootstrap.cc:492] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:55.446165 31746 leader_election.cc:290] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:55.451303 31602 consensus_queue.cc:1048] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:55.450214 31399 tablet_bootstrap.cc:654] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.455389 31349 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:55.467578 31243 leader_election.cc:343] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.470486 31243 leader_election.cc:304] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:55.471956 31474 raft_consensus.cc:2749] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.471246 31351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f45cc601c2c422b933c4fd00560db82" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:55.479923 31402 tablet_bootstrap.cc:492] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:55.480592 31402 ts_tablet_manager.cc:1403] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.296s	user 0.017s	sys 0.002s
I20260709 12:20:55.509137 31402 raft_consensus.cc:359] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.510010 31402 raft_consensus.cc:385] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.510298 31402 raft_consensus.cc:740] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.511847 31402 consensus_queue.cc:260] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.526166 31524 raft_consensus.cc:493] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.527281 31524 raft_consensus.cc:515] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.529663 31524 leader_election.cc:290] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:55.529930 31400 tablet_bootstrap.cc:492] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:55.530638 31400 ts_tablet_manager.cc:1403] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.266s	user 0.022s	sys 0.007s
I20260709 12:20:55.539626 31402 ts_tablet_manager.cc:1434] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.000s
I20260709 12:20:55.540930 31402 tablet_bootstrap.cc:492] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:55.545318 31401 tablet_bootstrap.cc:654] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.557493 31531 consensus_queue.cc:1048] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:55.559257 31400 raft_consensus.cc:359] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.562580 31400 raft_consensus.cc:385] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.563189 31400 raft_consensus.cc:740] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.565718 31400 consensus_queue.cc:260] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.577370 31168 leader_election.cc:304] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:55.578606 31775 raft_consensus.cc:2804] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:55.579061 31775 raft_consensus.cc:493] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.579402 31775 raft_consensus.cc:3060] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.579397 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256c4c6b88d240658c96e3d2b37b1d51" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:55.581732 31400 ts_tablet_manager.cc:1434] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.051s	user 0.005s	sys 0.004s
I20260709 12:20:55.582805 31402 tablet_bootstrap.cc:654] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.583180 31400 tablet_bootstrap.cc:492] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
W20260709 12:20:55.584059 31169 leader_election.cc:343] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.579514 31093 leader_election.cc:304] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:55.596889 31755 raft_consensus.cc:2749] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:55.590613 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "256c4c6b88d240658c96e3d2b37b1d51" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:55.636467 31317 leader_election.cc:304] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:55.659722 31401 tablet_bootstrap.cc:492] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:55.660465 31401 ts_tablet_manager.cc:1403] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.215s	user 0.045s	sys 0.039s
I20260709 12:20:55.662557 31763 raft_consensus.cc:2749] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.663810 31401 raft_consensus.cc:359] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.664674 31401 raft_consensus.cc:385] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.664950 31401 raft_consensus.cc:740] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.650390 31770 consensus_queue.cc:1048] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 12:20:55.665828 31401 consensus_queue.cc:260] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.668690 31401 ts_tablet_manager.cc:1434] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:20:55.681164 31401 tablet_bootstrap.cc:492] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:55.683528 31399 tablet_bootstrap.cc:492] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:55.684158 31399 ts_tablet_manager.cc:1403] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.250s	user 0.024s	sys 0.024s
I20260709 12:20:55.668360 31348 raft_consensus.cc:3060] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.682175 31591 consensus_queue.cc:1048] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:20:55.708240 31400 tablet_bootstrap.cc:654] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.716930 31399 raft_consensus.cc:359] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.717794 31399 raft_consensus.cc:385] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.718067 31399 raft_consensus.cc:740] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.718832 31399 consensus_queue.cc:260] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.719671 31781 raft_consensus.cc:493] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.721127 31781 raft_consensus.cc:515] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.711578 31775 raft_consensus.cc:515] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.723466 31781 leader_election.cc:290] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:55.724279 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d69b4dd96704efb9cb29a41aae2b039" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:55.724788 31775 leader_election.cc:290] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:55.729099 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f45cc601c2c422b933c4fd00560db82" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:55.729956 31277 raft_consensus.cc:3060] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:55.730880 31243 leader_election.cc:343] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.737512 31344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f45cc601c2c422b933c4fd00560db82" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:55.739952 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d69b4dd96704efb9cb29a41aae2b039" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
W20260709 12:20:55.747562 31092 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 45947.3us
W20260709 12:20:55.755219 31169 leader_election.cc:343] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.760856 31401 tablet_bootstrap.cc:654] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.762467 31202 raft_consensus.cc:2468] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:55.765720 31277 raft_consensus.cc:2468] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:55.775377 31399 ts_tablet_manager.cc:1434] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.091s	user 0.009s	sys 0.000s
I20260709 12:20:55.787537 31399 tablet_bootstrap.cc:492] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:55.777129 31243 leader_election.cc:304] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:55.790342 31782 raft_consensus.cc:2804] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:55.790807 31782 raft_consensus.cc:493] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.791242 31782 raft_consensus.cc:3060] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.794795 31399 tablet_bootstrap.cc:654] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.806519 31400 tablet_bootstrap.cc:492] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:55.779215 31402 tablet_bootstrap.cc:492] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:55.808018 31402 ts_tablet_manager.cc:1403] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.267s	user 0.013s	sys 0.009s
I20260709 12:20:55.809464 31400 ts_tablet_manager.cc:1403] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.227s	user 0.014s	sys 0.006s
I20260709 12:20:55.782712 31401 tablet_bootstrap.cc:492] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:55.825789 31464 raft_consensus.cc:493] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.826484 31464 raft_consensus.cc:515] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.827360 31401 ts_tablet_manager.cc:1403] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.146s	user 0.007s	sys 0.008s
I20260709 12:20:55.829672 31464 leader_election.cc:290] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:55.830678 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2929cced2b1543e0aa12f490cb2abbbd" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:55.832084 31399 tablet_bootstrap.cc:492] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:55.832247 31400 raft_consensus.cc:359] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.832651 31168 leader_election.cc:304] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:55.832866 31399 ts_tablet_manager.cc:1403] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.046s	user 0.024s	sys 0.013s
I20260709 12:20:55.833125 31400 raft_consensus.cc:385] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.833499 31400 raft_consensus.cc:740] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.832666 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2929cced2b1543e0aa12f490cb2abbbd" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:55.834309 31400 consensus_queue.cc:260] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.835280 31464 raft_consensus.cc:2804] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:20:55.835713 31168 leader_election.cc:343] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.836272 31399 raft_consensus.cc:359] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.832109 31345 raft_consensus.cc:2468] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:55.837438 31400 ts_tablet_manager.cc:1434] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.003s
I20260709 12:20:55.838521 31169 leader_election.cc:304] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:55.835821 31464 raft_consensus.cc:697] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:55.839425 31775 raft_consensus.cc:2804] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:55.840031 31775 raft_consensus.cc:493] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:55.840571 31775 raft_consensus.cc:3060] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.841399 31791 raft_consensus.cc:493] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.841959 31791 raft_consensus.cc:515] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.842636 31399 raft_consensus.cc:385] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.843096 31399 raft_consensus.cc:740] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.843988 31399 consensus_queue.cc:260] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.845285 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff93479d44174057843c235314d57461" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:55.846529 31399 ts_tablet_manager.cc:1434] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
W20260709 12:20:55.847116 31093 leader_election.cc:343] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.847765 31399 tablet_bootstrap.cc:492] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:55.848384 31791 leader_election.cc:290] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:55.849830 31402 raft_consensus.cc:359] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.850533 31402 raft_consensus.cc:385] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.851775 31400 tablet_bootstrap.cc:492] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:55.856319 31399 tablet_bootstrap.cc:654] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.859231 31650 raft_consensus.cc:493] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.859980 31650 raft_consensus.cc:515] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.860664 31782 raft_consensus.cc:515] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.850780 31402 raft_consensus.cc:740] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.863021 31402 consensus_queue.cc:260] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.868731 31402 ts_tablet_manager.cc:1434] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:20:55.869979 31402 tablet_bootstrap.cc:492] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:55.869741 31775 raft_consensus.cc:515] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.837356 31401 raft_consensus.cc:359] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.874430 31401 raft_consensus.cc:385] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.874508 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d69b4dd96704efb9cb29a41aae2b039" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:55.874809 31401 raft_consensus.cc:740] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.875623 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:55.875891 31401 consensus_queue.cc:260] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
W20260709 12:20:55.876497 31243 leader_election.cc:343] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.878417 31401 ts_tablet_manager.cc:1434] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.000s
I20260709 12:20:55.878927 31782 leader_election.cc:290] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:55.879468 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff93479d44174057843c235314d57461" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
W20260709 12:20:55.881575 31092 leader_election.cc:343] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.882061 31092 leader_election.cc:304] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:55.883668 31791 raft_consensus.cc:2749] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:55.889395 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d69b4dd96704efb9cb29a41aae2b039" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:55.890025 31202 raft_consensus.cc:3060] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.894047 31402 tablet_bootstrap.cc:654] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.848526 31464 consensus_queue.cc:237] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:55.900895 31400 tablet_bootstrap.cc:654] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:55.894282 31168 leader_election.cc:343] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.934764 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2929cced2b1543e0aa12f490cb2abbbd" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:55.939945 31650 leader_election.cc:290] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
W20260709 12:20:55.942485 31168 leader_election.cc:343] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.943248 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:55.944932 31348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2929cced2b1543e0aa12f490cb2abbbd" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:55.950542 31348 raft_consensus.cc:3060] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:55.914131 31402 tablet_bootstrap.cc:492] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:55.955385 31402 ts_tablet_manager.cc:1403] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.086s	user 0.006s	sys 0.013s
I20260709 12:20:55.922281 31399 tablet_bootstrap.cc:492] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:55.957890 31399 ts_tablet_manager.cc:1403] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.110s	user 0.028s	sys 0.021s
I20260709 12:20:55.958722 31402 raft_consensus.cc:359] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.959540 31402 raft_consensus.cc:385] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.907054 31775 leader_election.cc:290] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:55.959815 31402 raft_consensus.cc:740] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.908571 31202 raft_consensus.cc:2468] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:55.960606 31402 consensus_queue.cc:260] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.961072 31399 raft_consensus.cc:359] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:55.961519 31243 leader_election.cc:304] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:55.961859 31399 raft_consensus.cc:385] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:55.962150 31399 raft_consensus.cc:740] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:55.963438 31402 ts_tablet_manager.cc:1434] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:55.963133 31399 consensus_queue.cc:260] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
W20260709 12:20:55.963569 31168 leader_election.cc:343] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:55.964133 31168 leader_election.cc:304] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:55.964982 31399 ts_tablet_manager.cc:1434] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:55.965746 31781 raft_consensus.cc:2804] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:55.966081 31399 tablet_bootstrap.cc:492] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:55.966356 31781 raft_consensus.cc:697] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:55.966779 31402 tablet_bootstrap.cc:492] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:55.967388 31781 consensus_queue.cc:237] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:55.919715 31401 tablet_bootstrap.cc:492] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:55.995211 31770 raft_consensus.cc:493] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:55.995965 31770 raft_consensus.cc:515] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:55.998458 31770 leader_election.cc:290] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:55.999161 31399 tablet_bootstrap.cc:654] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:55.986125 31746 raft_consensus.cc:2749] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.009845 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:56.014798 31093 leader_election.cc:343] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.019428 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:56.020303 31276 raft_consensus.cc:2468] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:56.021696 31092 leader_election.cc:304] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:56.022552 31791 raft_consensus.cc:2804] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:56.024170 31791 raft_consensus.cc:493] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.024606 31791 raft_consensus.cc:3060] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.030121 31400 tablet_bootstrap.cc:492] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:56.030714 31400 ts_tablet_manager.cc:1403] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.179s	user 0.003s	sys 0.012s
I20260709 12:20:56.035250 31742 raft_consensus.cc:493] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.035090 31021 catalog_manager.cc:5697] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.035858 31742 raft_consensus.cc:515] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:56.040241 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f45cc601c2c422b933c4fd00560db82" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:56.042629 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f45cc601c2c422b933c4fd00560db82" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:56.043327 31348 raft_consensus.cc:2468] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:56.043653 31276 raft_consensus.cc:2393] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9800423c0012421d9ce299e8c180ac96 in current term 1: Already voted for candidate 1d5ebd798965493785b198d6e8492c23 in this term.
I20260709 12:20:56.045132 31169 leader_election.cc:304] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:56.046875 31742 leader_election.cc:290] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:56.046630 31025 catalog_manager.cc:5697] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:56.047144 31400 raft_consensus.cc:359] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.048005 31746 raft_consensus.cc:2804] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.056318 31746 raft_consensus.cc:697] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:56.057379 31746 consensus_queue.cc:237] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.058847 31399 tablet_bootstrap.cc:492] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:56.059516 31399 ts_tablet_manager.cc:1403] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.094s	user 0.012s	sys 0.008s
I20260709 12:20:56.050192 31402 tablet_bootstrap.cc:654] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.048051 31317 leader_election.cc:304] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:56.062548 31742 raft_consensus.cc:3060] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.050318 31401 tablet_bootstrap.cc:654] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.063392 31399 raft_consensus.cc:359] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.064430 31399 raft_consensus.cc:385] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.064788 31399 raft_consensus.cc:740] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.050170 31464 raft_consensus.cc:493] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.065439 31464 raft_consensus.cc:515] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.065565 31399 consensus_queue.cc:260] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.068583 31399 ts_tablet_manager.cc:1434] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:20:56.055639 31400 raft_consensus.cc:385] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.069278 31400 raft_consensus.cc:740] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.070101 31464 leader_election.cc:290] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:56.053715 31791 raft_consensus.cc:515] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.071900 31732 raft_consensus.cc:493] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.072599 31732 raft_consensus.cc:515] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.071345 31400 consensus_queue.cc:260] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.075843 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:56.076370 31400 ts_tablet_manager.cc:1434] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 12:20:56.076411 31791 leader_election.cc:290] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:56.076697 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:56.077476 31277 raft_consensus.cc:3060] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.079312 31348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff93479d44174057843c235314d57461" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:56.082928 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ff0dec68504c32b1b5df23cd8f25a0" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:56.085078 31244 leader_election.cc:343] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.069741 31399 tablet_bootstrap.cc:492] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
W20260709 12:20:56.079474 31093 leader_election.cc:343] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.086608 31732 leader_election.cc:290] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:56.069638 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff93479d44174057843c235314d57461" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:56.088371 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ff0dec68504c32b1b5df23cd8f25a0" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
W20260709 12:20:56.088826 31169 leader_election.cc:343] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:56.089938 31243 leader_election.cc:343] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.088388 31125 raft_consensus.cc:2468] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:56.091022 31243 leader_election.cc:304] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:56.093984 31732 raft_consensus.cc:2749] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.096073 31168 leader_election.cc:304] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:56.098730 31775 raft_consensus.cc:2804] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:56.099370 31775 raft_consensus.cc:493] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.099828 31775 raft_consensus.cc:3060] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.077508 31400 tablet_bootstrap.cc:492] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:56.109762 31399 tablet_bootstrap.cc:654] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.115649 31402 tablet_bootstrap.cc:492] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:56.116356 31402 ts_tablet_manager.cc:1403] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.009s
I20260709 12:20:56.119514 31402 raft_consensus.cc:359] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.120163 31402 raft_consensus.cc:385] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.120458 31402 raft_consensus.cc:740] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.121186 31402 consensus_queue.cc:260] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.126102 31742 raft_consensus.cc:2749] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.127086 31277 raft_consensus.cc:2468] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:56.133149 31092 leader_election.cc:304] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:56.133317 31775 raft_consensus.cc:515] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.134537 31791 raft_consensus.cc:2804] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.135293 31791 raft_consensus.cc:697] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:56.151048 31770 raft_consensus.cc:493] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.151926 31770 raft_consensus.cc:515] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.172291 31770 leader_election.cc:290] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:56.208086 31402 ts_tablet_manager.cc:1434] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.091s	user 0.007s	sys 0.000s
I20260709 12:20:56.208109 31791 consensus_queue.cc:237] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.210577 31400 tablet_bootstrap.cc:654] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.211815 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:56.212164 31401 tablet_bootstrap.cc:492] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:56.212749 31276 raft_consensus.cc:2468] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:56.213320 31401 ts_tablet_manager.cc:1403] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.294s	user 0.021s	sys 0.020s
I20260709 12:20:56.215119 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:56.215807 31202 raft_consensus.cc:2468] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:56.218178 31401 raft_consensus.cc:359] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.218935 31401 raft_consensus.cc:385] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.219259 31401 raft_consensus.cc:740] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.219971 31401 consensus_queue.cc:260] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.221728 31401 ts_tablet_manager.cc:1434] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:20:56.222822 31401 tablet_bootstrap.cc:492] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:56.236063 31092 leader_election.cc:304] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:56.239019 31696 raft_consensus.cc:2804] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:56.239522 31696 raft_consensus.cc:493] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.239944 31696 raft_consensus.cc:3060] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.244752 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff93479d44174057843c235314d57461" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:56.245718 31127 raft_consensus.cc:3060] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.247726 31401 tablet_bootstrap.cc:654] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.224057 31775 leader_election.cc:290] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:56.224757 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff93479d44174057843c235314d57461" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:56.229486 31025 catalog_manager.cc:5697] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:56.234899 31399 tablet_bootstrap.cc:492] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:56.260114 31399 ts_tablet_manager.cc:1403] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.191s	user 0.001s	sys 0.030s
W20260709 12:20:56.260727 31169 leader_election.cc:343] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.266006 31399 raft_consensus.cc:359] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:56.269394 31399 raft_consensus.cc:385] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.269662 31399 raft_consensus.cc:740] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.270474 31399 consensus_queue.cc:260] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:56.272467 31399 ts_tablet_manager.cc:1434] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.003s
I20260709 12:20:56.273447 31399 tablet_bootstrap.cc:492] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:56.275714 31402 tablet_bootstrap.cc:492] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:56.284902 31696 raft_consensus.cc:515] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.291137 31400 tablet_bootstrap.cc:492] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:56.291486 31399 tablet_bootstrap.cc:654] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.291792 31400 ts_tablet_manager.cc:1403] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.215s	user 0.020s	sys 0.025s
I20260709 12:20:56.295789 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:56.296512 31202 raft_consensus.cc:3060] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.301487 31791 raft_consensus.cc:493] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.302119 31791 raft_consensus.cc:515] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.304675 31791 leader_election.cc:290] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:56.308187 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d69b4dd96704efb9cb29a41aae2b039" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:56.306640 31202 raft_consensus.cc:2468] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:56.308894 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d69b4dd96704efb9cb29a41aae2b039" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:56.309281 31201 raft_consensus.cc:2393] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3b87862f0eb448db7779e995eb84f64 in current term 1: Already voted for candidate ee8bcffe388e4e0796bc17d15b7adcde in this term.
I20260709 12:20:56.309334 31402 tablet_bootstrap.cc:654] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.291057 31401 tablet_bootstrap.cc:492] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:56.312170 31401 ts_tablet_manager.cc:1403] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.004s
I20260709 12:20:56.313568 31400 raft_consensus.cc:359] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:56.319635 31400 raft_consensus.cc:385] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.319864 31774 raft_consensus.cc:493] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.320151 31400 raft_consensus.cc:740] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.320575 31774 raft_consensus.cc:515] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.325971 31774 leader_election.cc:290] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:56.328265 31092 leader_election.cc:304] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:56.332424 31791 raft_consensus.cc:3060] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.328331 31348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:56.335817 31400 consensus_queue.cc:260] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:56.336907 31092 leader_election.cc:304] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:56.337829 31770 raft_consensus.cc:2804] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.338387 31770 raft_consensus.cc:697] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:56.339126 31401 raft_consensus.cc:359] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.339397 31770 consensus_queue.cc:237] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.346135 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:56.346937 31128 raft_consensus.cc:2468] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:56.348982 31168 leader_election.cc:304] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:56.350164 31746 raft_consensus.cc:2804] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:56.350596 31746 raft_consensus.cc:493] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.350929 31746 raft_consensus.cc:3060] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.352981 31524 raft_consensus.cc:493] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.353531 31524 raft_consensus.cc:515] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.355767 31524 leader_election.cc:290] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:56.361742 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:56.362730 31276 raft_consensus.cc:2393] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9800423c0012421d9ce299e8c180ac96 in current term 1: Already voted for candidate e3b87862f0eb448db7779e995eb84f64 in this term.
I20260709 12:20:56.363219 31401 raft_consensus.cc:385] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.365554 31401 raft_consensus.cc:740] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.367314 31400 ts_tablet_manager.cc:1434] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.075s	user 0.010s	sys 0.002s
I20260709 12:20:56.369014 31400 tablet_bootstrap.cc:492] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:56.373490 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
W20260709 12:20:56.381621 31169 leader_election.cc:343] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.387540 31317 leader_election.cc:304] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:56.391752 31696 leader_election.cc:290] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:56.393168 31763 raft_consensus.cc:3060] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.395974 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:56.396756 31127 raft_consensus.cc:2468] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:56.397043 31276 raft_consensus.cc:3060] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.398583 31168 leader_election.cc:304] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:56.399708 31746 raft_consensus.cc:515] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.400081 31775 raft_consensus.cc:2804] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.400861 31775 raft_consensus.cc:697] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:56.402108 31746 leader_election.cc:290] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:56.401897 31775 consensus_queue.cc:237] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.377348 31401 consensus_queue.cc:260] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.404464 31399 tablet_bootstrap.cc:492] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:56.408301 31399 ts_tablet_manager.cc:1403] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.135s	user 0.039s	sys 0.070s
I20260709 12:20:56.409912 31348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:56.410241 31276 raft_consensus.cc:2468] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:56.416368 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:56.417173 31127 raft_consensus.cc:3060] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.423952 31791 raft_consensus.cc:2749] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:56.430896 31169 leader_election.cc:343] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.431377 31401 ts_tablet_manager.cc:1434] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.002s
I20260709 12:20:56.435761 31401 tablet_bootstrap.cc:492] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:56.437095 31742 raft_consensus.cc:493] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.437704 31742 raft_consensus.cc:515] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.440331 31742 leader_election.cc:290] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:56.442636 31399 raft_consensus.cc:359] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.443542 31399 raft_consensus.cc:385] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.443852 31399 raft_consensus.cc:740] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.444664 31399 consensus_queue.cc:260] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.450555 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66c15cae85a4a45bae00ea0560859d7" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:56.449395 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66c15cae85a4a45bae00ea0560859d7" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:56.451473 31125 raft_consensus.cc:2468] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:56.458122 31317 leader_election.cc:304] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:56.459885 31640 raft_consensus.cc:2804] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:56.460342 31640 raft_consensus.cc:493] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.460737 31640 raft_consensus.cc:3060] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.472412 31400 tablet_bootstrap.cc:654] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:56.478802 31317 leader_election.cc:343] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.482188 31763 raft_consensus.cc:2749] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.479050 31399 ts_tablet_manager.cc:1434] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.070s	user 0.008s	sys 0.001s
I20260709 12:20:56.479080 31402 tablet_bootstrap.cc:492] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:56.490383 31399 tablet_bootstrap.cc:492] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23: Bootstrap starting.
I20260709 12:20:56.482744 31768 raft_consensus.cc:493] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.493935 31768 raft_consensus.cc:515] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:56.478307 31401 tablet_bootstrap.cc:654] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.495167 31400 tablet_bootstrap.cc:492] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:56.495822 31400 ts_tablet_manager.cc:1403] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.127s	user 0.015s	sys 0.001s
I20260709 12:20:56.497404 31402 ts_tablet_manager.cc:1403] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.222s	user 0.003s	sys 0.017s
I20260709 12:20:56.486083 31746 consensus_queue.cc:1048] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.481355 31640 raft_consensus.cc:515] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.495621 31781 consensus_queue.cc:1048] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.486805 31127 raft_consensus.cc:2468] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:56.501197 31168 leader_election.cc:304] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:56.502439 31746 raft_consensus.cc:2804] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.505237 31348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:56.508175 31746 raft_consensus.cc:697] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
W20260709 12:20:56.508525 31244 leader_election.cc:343] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.509474 31746 consensus_queue.cc:237] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.511600 31402 raft_consensus.cc:359] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.512434 31402 raft_consensus.cc:385] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:20:56.512588 31168 consensus_peers.cc:597] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:56.512780 31402 raft_consensus.cc:740] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.501202 31640 leader_election.cc:290] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:56.506485 31399 tablet_bootstrap.cc:654] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.513734 31402 consensus_queue.cc:260] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.510751 31768 leader_election.cc:290] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:56.515337 31400 raft_consensus.cc:359] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.515661 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:56.516556 31201 raft_consensus.cc:2468] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:56.518782 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66c15cae85a4a45bae00ea0560859d7" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:56.519620 31125 raft_consensus.cc:3060] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.521447 31021 catalog_manager.cc:5697] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:56.548287 31021 catalog_manager.cc:5697] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.525987 31243 leader_election.cc:304] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:56.555912 31399 tablet_bootstrap.cc:492] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23: No bootstrap required, opened a new log
I20260709 12:20:56.556581 31399 ts_tablet_manager.cc:1403] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.000s
I20260709 12:20:56.528806 31775 consensus_queue.cc:1048] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s
I20260709 12:20:56.535116 31400 raft_consensus.cc:385] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.558481 31400 raft_consensus.cc:740] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.559288 31400 consensus_queue.cc:260] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.560850 31401 tablet_bootstrap.cc:492] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:56.561455 31401 ts_tablet_manager.cc:1403] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.126s	user 0.011s	sys 0.005s
I20260709 12:20:56.562951 31746 consensus_queue.cc:1048] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.545930 31402 ts_tablet_manager.cc:1434] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:20:56.565397 31768 raft_consensus.cc:2804] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:56.565862 31768 raft_consensus.cc:493] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.566237 31768 raft_consensus.cc:3060] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.566423 31402 tablet_bootstrap.cc:492] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:56.564795 31401 raft_consensus.cc:359] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.540513 31125 raft_consensus.cc:2468] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:56.573858 31400 ts_tablet_manager.cc:1434] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.078s	user 0.004s	sys 0.003s
I20260709 12:20:56.574965 31400 tablet_bootstrap.cc:492] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:56.575698 31402 tablet_bootstrap.cc:654] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
W20260709 12:20:56.579557 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 53672.6us
I20260709 12:20:56.580319 31399 raft_consensus.cc:359] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.581172 31399 raft_consensus.cc:385] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.581489 31399 raft_consensus.cc:740] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.586325 31782 consensus_queue.cc:1048] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:56.586787 31399 consensus_queue.cc:260] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.589140 31399 ts_tablet_manager.cc:1434] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:20:56.592430 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66c15cae85a4a45bae00ea0560859d7" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:56.593170 31276 raft_consensus.cc:3060] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.601758 31768 raft_consensus.cc:515] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:56.603848 31276 raft_consensus.cc:2468] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:56.605037 31768 leader_election.cc:290] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:56.589025 31317 leader_election.cc:304] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:56.609295 31640 raft_consensus.cc:2804] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.609822 31640 raft_consensus.cc:697] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:56.610759 31640 consensus_queue.cc:237] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.627967 31344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
W20260709 12:20:56.629431 31244 leader_election.cc:343] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.641124 31402 tablet_bootstrap.cc:492] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:56.642158 31402 ts_tablet_manager.cc:1403] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.076s	user 0.015s	sys 0.030s
I20260709 12:20:56.645167 31775 raft_consensus.cc:493] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.645809 31775 raft_consensus.cc:515] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:56.646948 31402 raft_consensus.cc:359] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.647940 31402 raft_consensus.cc:385] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.648931 31775 leader_election.cc:290] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:20:56.651168 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399de19748dd4407986684b816a07da9" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:56.651856 31402 raft_consensus.cc:740] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
W20260709 12:20:56.653074 31168 leader_election.cc:343] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.653088 31402 consensus_queue.cc:260] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.656572 31402 ts_tablet_manager.cc:1434] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:20:56.571971 31401 raft_consensus.cc:385] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.664740 31401 raft_consensus.cc:740] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.665483 31401 consensus_queue.cc:260] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.669847 31400 tablet_bootstrap.cc:654] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.671062 31025 catalog_manager.cc:5697] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:56.675475 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:56.691550 31201 raft_consensus.cc:3060] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.692220 31025 catalog_manager.cc:5697] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } }
W20260709 12:20:56.677673 31074 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:20:56.678300 31402 tablet_bootstrap.cc:492] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:20:56.683353 31828 log.cc:927] Time spent T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:20:56.685477 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399de19748dd4407986684b816a07da9" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:56.701086 31791 consensus_queue.cc:1048] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:56.703594 31169 leader_election.cc:343] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.704088 31169 leader_election.cc:304] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:56.711654 31746 raft_consensus.cc:2749] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.719436 31022 catalog_manager.cc:5697] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:56.726408 31774 raft_consensus.cc:493] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.727198 31774 raft_consensus.cc:515] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.728852 31402 tablet_bootstrap.cc:654] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.730206 31774 leader_election.cc:290] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:56.727699 31201 raft_consensus.cc:2468] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:56.737241 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2db72180a343d9a6ee51388b24edd9" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:56.738292 31125 raft_consensus.cc:2468] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 0.
I20260709 12:20:56.743794 31168 leader_election.cc:304] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:56.746513 31775 raft_consensus.cc:2804] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:56.747464 31775 raft_consensus.cc:493] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:56.747910 31775 raft_consensus.cc:3060] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.750705 31402 tablet_bootstrap.cc:492] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:56.751335 31402 ts_tablet_manager.cc:1403] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.073s	user 0.013s	sys 0.000s
I20260709 12:20:56.666906 31401 ts_tablet_manager.cc:1434] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.105s	user 0.006s	sys 0.001s
I20260709 12:20:56.752933 31401 tablet_bootstrap.cc:492] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
W20260709 12:20:56.763221 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:36023, user_credentials={real_user=slave}} blocked reactor thread for 80205.3us
I20260709 12:20:56.775641 31243 leader_election.cc:304] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:56.777513 31781 raft_consensus.cc:2804] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.778255 31781 raft_consensus.cc:697] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:56.781626 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2db72180a343d9a6ee51388b24edd9" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:56.787849 31401 tablet_bootstrap.cc:654] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.789136 31696 consensus_queue.cc:1048] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:56.804199 31781 consensus_queue.cc:237] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:56.813052 31402 raft_consensus.cc:359] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.813932 31402 raft_consensus.cc:385] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.814222 31402 raft_consensus.cc:740] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.816547 31400 tablet_bootstrap.cc:492] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:56.817158 31400 ts_tablet_manager.cc:1403] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.242s	user 0.014s	sys 0.005s
I20260709 12:20:56.820974 31400 raft_consensus.cc:359] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.821676 31400 raft_consensus.cc:385] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.821969 31400 raft_consensus.cc:740] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.822924 31402 consensus_queue.cc:260] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.825835 31402 ts_tablet_manager.cc:1434] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.074s	user 0.007s	sys 0.000s
I20260709 12:20:56.827122 31402 tablet_bootstrap.cc:492] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:56.831063 31696 raft_consensus.cc:493] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.831967 31696 raft_consensus.cc:515] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.832500 31400 consensus_queue.cc:260] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.837512 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:56.844406 31696 leader_election.cc:290] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
W20260709 12:20:56.855542 31168 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:36023, user_credentials={real_user=slave}} blocked reactor thread for 93621.7us
I20260709 12:20:56.877453 31400 ts_tablet_manager.cc:1434] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.002s
I20260709 12:20:56.878554 31400 tablet_bootstrap.cc:492] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:56.858103 31347 raft_consensus.cc:3060] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.874293 31401 tablet_bootstrap.cc:492] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:56.879781 31401 ts_tablet_manager.cc:1403] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.127s	user 0.035s	sys 0.049s
I20260709 12:20:56.886039 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:56.878391 31092 leader_election.cc:343] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:56.889406 31093 leader_election.cc:343] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.889833 31093 leader_election.cc:304] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:56.891044 31791 raft_consensus.cc:2749] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:56.874115 31775 raft_consensus.cc:515] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.896682 31775 leader_election.cc:290] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:56.905030 31022 catalog_manager.cc:5697] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } }
W20260709 12:20:56.917794 31169 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:36383, user_credentials={real_user=slave}} blocked reactor thread for 47098.6us
W20260709 12:20:56.921634 31168 leader_election.cc:343] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:56.882910 31401 raft_consensus.cc:359] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.931805 31401 raft_consensus.cc:385] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.932164 31401 raft_consensus.cc:740] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.932895 31401 consensus_queue.cc:260] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:56.934633 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2db72180a343d9a6ee51388b24edd9" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:56.935421 31127 raft_consensus.cc:3060] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.936789 31402 tablet_bootstrap.cc:654] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.908299 31791 consensus_queue.cc:1048] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:56.953316 31696 consensus_queue.cc:1048] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:56.954233 31127 raft_consensus.cc:2468] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:56.955566 31168 leader_election.cc:304] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:56.956387 31849 raft_consensus.cc:2804] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:56.956907 31849 raft_consensus.cc:697] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:20:56.957827 31849 consensus_queue.cc:237] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:20:56.942763 31400 tablet_bootstrap.cc:654] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.944381 31850 consensus_queue.cc:1048] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:56.949728 31401 ts_tablet_manager.cc:1434] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.001s
I20260709 12:20:56.959860 31401 tablet_bootstrap.cc:492] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:56.942961 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d2db72180a343d9a6ee51388b24edd9" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:56.962255 31275 raft_consensus.cc:3060] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:56.970620 31401 tablet_bootstrap.cc:654] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:56.975905 31402 tablet_bootstrap.cc:492] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:56.976475 31402 ts_tablet_manager.cc:1403] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.150s	user 0.011s	sys 0.001s
I20260709 12:20:56.979555 31402 raft_consensus.cc:359] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.980258 31402 raft_consensus.cc:385] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:56.980554 31402 raft_consensus.cc:740] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:56.983592 31402 consensus_queue.cc:260] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.986114 31402 ts_tablet_manager.cc:1434] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:20:56.987185 31775 raft_consensus.cc:493] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:56.987967 31775 raft_consensus.cc:515] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:56.991882 31775 leader_election.cc:290] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:56.992794 31402 tablet_bootstrap.cc:492] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:20:56.992794 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
W20260709 12:20:56.994515 31168 leader_election.cc:343] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.018929 31022 catalog_manager.cc:5697] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.035946 31400 tablet_bootstrap.cc:492] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:57.036638 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:57.040855 31524 consensus_queue.cc:1048] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:57.047294 31849 consensus_queue.cc:1048] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:20:57.050719 31169 leader_election.cc:343] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.051412 31169 leader_election.cc:304] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:57.052446 31849 raft_consensus.cc:2749] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:20:57.055509 31169 consensus_peers.cc:597] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 -> Peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Couldn't send request to peer 9800423c0012421d9ce299e8c180ac96. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:57.036866 31400 ts_tablet_manager.cc:1403] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.009s
W20260709 12:20:57.071177 31855 log.cc:927] Time spent T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:20:57.073865 31402 tablet_bootstrap.cc:654] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.076004 31401 tablet_bootstrap.cc:492] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:57.076638 31401 ts_tablet_manager.cc:1403] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.117s	user 0.037s	sys 0.038s
I20260709 12:20:57.079808 31401 raft_consensus.cc:359] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.080578 31401 raft_consensus.cc:385] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.080843 31401 raft_consensus.cc:740] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.081066 31791 raft_consensus.cc:493] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.081596 31401 consensus_queue.cc:260] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.081773 31791 raft_consensus.cc:515] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.084105 31401 ts_tablet_manager.cc:1434] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:57.085753 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2929cced2b1543e0aa12f490cb2abbbd" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:20:57.086297 31275 raft_consensus.cc:2468] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:20:57.087905 31401 tablet_bootstrap.cc:492] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:57.094519 31400 raft_consensus.cc:359] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.095363 31400 raft_consensus.cc:385] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.095664 31400 raft_consensus.cc:740] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.096532 31400 consensus_queue.cc:260] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.098033 31402 tablet_bootstrap.cc:492] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: No bootstrap required, opened a new log
I20260709 12:20:57.098654 31402 ts_tablet_manager.cc:1403] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.112s	user 0.009s	sys 0.004s
I20260709 12:20:57.098941 31400 ts_tablet_manager.cc:1434] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:20:57.101778 31402 raft_consensus.cc:359] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.102327 31400 tablet_bootstrap.cc:492] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde: Bootstrap starting.
I20260709 12:20:57.102546 31402 raft_consensus.cc:385] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.102843 31402 raft_consensus.cc:740] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.103792 31402 consensus_queue.cc:260] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.104904 31791 leader_election.cc:290] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:57.106357 31402 ts_tablet_manager.cc:1434] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:20:57.111295 31401 tablet_bootstrap.cc:654] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.114190 31400 tablet_bootstrap.cc:654] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.141880 31775 consensus_queue.cc:1048] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:57.143246 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2929cced2b1543e0aa12f490cb2abbbd" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:57.193794 31524 raft_consensus.cc:493] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.194568 31524 raft_consensus.cc:515] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.197394 31524 leader_election.cc:290] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:57.199452 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ff0dec68504c32b1b5df23cd8f25a0" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:57.200896 31125 raft_consensus.cc:2468] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:57.202522 31317 leader_election.cc:304] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:57.203699 31524 raft_consensus.cc:2804] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.204586 31524 raft_consensus.cc:493] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.205096 31524 raft_consensus.cc:3060] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.225721 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ff0dec68504c32b1b5df23cd8f25a0" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:57.226655 31277 raft_consensus.cc:2468] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:57.228538 31347 raft_consensus.cc:3060] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.239739 31092 leader_election.cc:304] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:57.240959 31696 raft_consensus.cc:2749] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:57.250996 31768 raft_consensus.cc:493] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.251754 31768 raft_consensus.cc:515] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.255111 31768 leader_election.cc:290] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:57.258689 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:57.260206 31244 leader_election.cc:343] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.295745 31859 consensus_queue.cc:1048] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:57.301783 31127 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:57.302538 31127 raft_consensus.cc:2468] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 0.
I20260709 12:20:57.312505 31127 raft_consensus.cc:3060] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.314361 31400 tablet_bootstrap.cc:492] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde: No bootstrap required, opened a new log
I20260709 12:20:57.315351 31400 ts_tablet_manager.cc:1403] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent bootstrapping tablet: real 0.213s	user 0.034s	sys 0.071s
I20260709 12:20:57.319448 31401 tablet_bootstrap.cc:492] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:57.320088 31401 ts_tablet_manager.cc:1403] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.233s	user 0.050s	sys 0.160s
I20260709 12:20:57.329537 31401 raft_consensus.cc:359] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.330395 31401 raft_consensus.cc:385] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.330750 31401 raft_consensus.cc:740] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.331614 31401 consensus_queue.cc:260] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.334465 31401 ts_tablet_manager.cc:1434] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:20:57.335906 31401 tablet_bootstrap.cc:492] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:57.340261 31400 raft_consensus.cc:359] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.340979 31400 raft_consensus.cc:385] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.341246 31400 raft_consensus.cc:740] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.341912 31400 consensus_queue.cc:260] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.344812 31400 ts_tablet_manager.cc:1434] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.003s
I20260709 12:20:57.334049 31524 raft_consensus.cc:515] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.351094 31401 tablet_bootstrap.cc:654] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.355445 31696 raft_consensus.cc:493] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.356016 31696 raft_consensus.cc:515] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.358783 31696 leader_election.cc:290] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:57.360298 31348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:20:57.361629 31093 leader_election.cc:343] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.361404 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:57.362484 31202 raft_consensus.cc:2468] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 0.
I20260709 12:20:57.365142 31243 leader_election.cc:304] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:57.367563 31092 leader_election.cc:304] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:57.369915 31782 raft_consensus.cc:2804] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.370349 31782 raft_consensus.cc:493] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.370698 31782 raft_consensus.cc:3060] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.371176 31822 raft_consensus.cc:493] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.371245 31770 raft_consensus.cc:2804] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.371851 31770 raft_consensus.cc:493] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.372329 31770 raft_consensus.cc:3060] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.371897 31822 raft_consensus.cc:515] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.375516 31781 consensus_queue.cc:1048] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:57.375919 31822 leader_election.cc:290] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:57.378695 31524 leader_election.cc:290] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:57.381623 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ff0dec68504c32b1b5df23cd8f25a0" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:57.382393 31277 raft_consensus.cc:3060] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.388917 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:57.389678 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28ff0dec68504c32b1b5df23cd8f25a0" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:57.390430 31125 raft_consensus.cc:3060] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.406373 31782 raft_consensus.cc:515] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.419559 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:57.422493 31401 tablet_bootstrap.cc:492] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:57.423130 31782 leader_election.cc:290] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:20:57.423681 31401 ts_tablet_manager.cc:1403] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.088s	user 0.021s	sys 0.015s
W20260709 12:20:57.424222 31244 leader_election.cc:343] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:20:57.427211 31401 raft_consensus.cc:359] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.428068 31401 raft_consensus.cc:385] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.428427 31401 raft_consensus.cc:740] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.435626 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:57.436324 31202 raft_consensus.cc:2468] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:57.436111 31125 raft_consensus.cc:2468] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:57.438606 31317 leader_election.cc:304] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:20:57.441383 31317 leader_election.cc:304] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:57.446277 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
I20260709 12:20:57.448624 31125 raft_consensus.cc:3060] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.454672 31125 raft_consensus.cc:2468] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:20:57.455479 31401 consensus_queue.cc:260] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.458811 31524 raft_consensus.cc:2804] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:20:57.455870 31822 raft_consensus.cc:2804] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.463438 31524 raft_consensus.cc:493] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ee8bcffe388e4e0796bc17d15b7adcde)
I20260709 12:20:57.463871 31524 raft_consensus.cc:3060] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:57.466423 31401 ts_tablet_manager.cc:1434] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.042s	user 0.003s	sys 0.005s
I20260709 12:20:57.467922 31401 tablet_bootstrap.cc:492] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:57.467192 31822 raft_consensus.cc:697] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:57.487998 31524 raft_consensus.cc:515] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.479321 31770 raft_consensus.cc:515] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.498904 31277 raft_consensus.cc:2468] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:57.505281 31770 leader_election.cc:290] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:57.507123 31347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:20:57.517729 31524 leader_election.cc:290] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:57.510504 31200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:57.541318 31200 raft_consensus.cc:3060] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:20:57.542748 31093 leader_election.cc:343] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:20:57.535164 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 74154.7us
I20260709 12:20:57.536846 31401 tablet_bootstrap.cc:654] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.537099 31775 consensus_queue.cc:1048] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 12:20:57.520040 31317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 54909.1us
I20260709 12:20:57.508280 31822 consensus_queue.cc:237] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.555238 31243 leader_election.cc:304] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:57.556716 31781 raft_consensus.cc:2804] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.557219 31781 raft_consensus.cc:697] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:57.558130 31781 consensus_queue.cc:237] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.559855 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:57.560738 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26a6299c5cfa4197a694ae06c6e07e4f" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:57.561466 31203 raft_consensus.cc:3060] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:57.564376 31775 consensus_queue.cc:1048] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:57.579380 31347 raft_consensus.cc:1240] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Rejecting Update request from peer ee8bcffe388e4e0796bc17d15b7adcde for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:57.596220 31781 consensus_queue.cc:1059] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:57.598013 31870 raft_consensus.cc:3055] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:20:57.598419 31870 raft_consensus.cc:740] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:20:57.599356 31870 consensus_queue.cc:260] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.599318 31021 catalog_manager.cc:5697] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 0 to 1, leader changed from <none> to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 1 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.600705 31870 raft_consensus.cc:3060] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:20:57.625907 31200 raft_consensus.cc:2468] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 1.
I20260709 12:20:57.630815 31203 raft_consensus.cc:2468] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 2.
I20260709 12:20:57.654443 31350 raft_consensus.cc:3060] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.675137 31822 raft_consensus.cc:493] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:57.675848 31822 raft_consensus.cc:515] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.678342 31822 leader_election.cc:290] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:57.680816 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399de19748dd4407986684b816a07da9" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:20:57.681576 31277 raft_consensus.cc:2468] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:57.682826 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399de19748dd4407986684b816a07da9" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:57.683591 31201 raft_consensus.cc:2468] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 0.
I20260709 12:20:57.684515 31317 leader_election.cc:304] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:57.685356 31822 raft_consensus.cc:2804] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:20:57.685763 31822 raft_consensus.cc:493] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:20:57.686101 31822 raft_consensus.cc:3060] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.693425 31202 raft_consensus.cc:1240] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Rejecting Update request from peer ee8bcffe388e4e0796bc17d15b7adcde for earlier term 1. Current term is 2. Ops: []
I20260709 12:20:57.695875 31822 raft_consensus.cc:515] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.696892 31317 leader_election.cc:304] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:20:57.697858 31873 raft_consensus.cc:2804] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:20:57.698347 31873 raft_consensus.cc:697] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:57.698907 31092 leader_election.cc:304] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 9800423c0012421d9ce299e8c180ac96
I20260709 12:20:57.699676 31873 consensus_queue.cc:237] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.700076 31770 raft_consensus.cc:2804] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.702600 31770 raft_consensus.cc:697] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:20:57.703994 31770 consensus_queue.cc:237] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.722261 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399de19748dd4407986684b816a07da9" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:20:57.730947 31203 raft_consensus.cc:3060] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.733013 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "399de19748dd4407986684b816a07da9" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:20:57.733784 31277 raft_consensus.cc:3060] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:57.749809 31401 tablet_bootstrap.cc:492] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:57.750536 31401 ts_tablet_manager.cc:1403] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.283s	user 0.083s	sys 0.078s
I20260709 12:20:57.762094 31822 leader_election.cc:290] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:20:57.754899 31401 raft_consensus.cc:359] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.763932 31401 raft_consensus.cc:385] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.764246 31401 raft_consensus.cc:740] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.765232 31401 consensus_queue.cc:260] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.772053 31277 raft_consensus.cc:2468] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:57.772938 31401 ts_tablet_manager.cc:1434] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.000s
I20260709 12:20:57.774096 31401 tablet_bootstrap.cc:492] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96: Bootstrap starting.
I20260709 12:20:57.779557 31317 leader_election.cc:304] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:20:57.781082 31401 tablet_bootstrap.cc:654] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96: Neither blocks nor log segments found. Creating new log.
I20260709 12:20:57.781821 31822 raft_consensus.cc:2804] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:20:57.791097 31822 raft_consensus.cc:697] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:20:57.792142 31822 consensus_queue.cc:237] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } }
I20260709 12:20:57.801127 31026 catalog_manager.cc:5697] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.811419 31022 catalog_manager.cc:5697] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:20:57.785351 31203 raft_consensus.cc:2468] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:20:57.789733 31524 raft_consensus.cc:493] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1d5ebd798965493785b198d6e8492c23)
I20260709 12:20:57.856112 31524 raft_consensus.cc:515] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:57.863227 31524 leader_election.cc:290] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:57.868320 31125 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:57.871642 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:57.873325 31317 leader_election.cc:304] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:57.874553 31524 raft_consensus.cc:2749] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:20:57.877900 31401 tablet_bootstrap.cc:492] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96: No bootstrap required, opened a new log
I20260709 12:20:57.878530 31401 ts_tablet_manager.cc:1403] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96: Time spent bootstrapping tablet: real 0.105s	user 0.034s	sys 0.044s
I20260709 12:20:57.879917 31021 catalog_manager.cc:5697] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 1 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.881560 31401 raft_consensus.cc:359] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.882467 31401 raft_consensus.cc:385] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:20:57.881769 31021 catalog_manager.cc:5697] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 1 to 2, leader changed from ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195) to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } }
I20260709 12:20:57.882727 31401 raft_consensus.cc:740] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Initialized, Role: FOLLOWER
I20260709 12:20:57.883639 31401 consensus_queue.cc:260] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:20:57.885775 31401 ts_tablet_manager.cc:1434] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:20:57.943485 31524 consensus_queue.cc:1048] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:57.950946 31875 consensus_queue.cc:1048] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:57.977926 31871 consensus_queue.cc:1048] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:58.031736 31350 raft_consensus.cc:3060] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.048198 31768 consensus_queue.cc:1048] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:58.095813 31875 raft_consensus.cc:493] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:20:58.096436 31875 raft_consensus.cc:515] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:20:58.098325 31875 leader_election.cc:290] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:20:58.099232 31128 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e3b87862f0eb448db7779e995eb84f64" is_pre_election: true
I20260709 12:20:58.099575 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:20:58.100472 31201 raft_consensus.cc:2393] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9800423c0012421d9ce299e8c180ac96 in current term 1: Already voted for candidate e3b87862f0eb448db7779e995eb84f64 in this term.
I20260709 12:20:58.101706 31317 leader_election.cc:304] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:20:58.102571 31875 raft_consensus.cc:3060] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:20:58.110738 31875 raft_consensus.cc:2749] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:20:58.128397 31696 consensus_queue.cc:1048] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.139586 31770 consensus_queue.cc:1048] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:58.168373 31203 raft_consensus.cc:1275] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer 9800423c0012421d9ce299e8c180ac96: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:58.179579 31875 consensus_queue.cc:1048] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:20:58.199368 31276 raft_consensus.cc:1275] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer 9800423c0012421d9ce299e8c180ac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:20:58.205363 31524 consensus_queue.cc:1048] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:20:58.233971 31524 consensus_queue.cc:1048] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:20:58.255393 31874 consensus_queue.cc:1048] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:20:58.731498 31317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37949, user_credentials={real_user=slave}} blocked reactor thread for 69500.2us
I20260709 12:20:58.967094 22903 tablet_server.cc:179] TabletServer@127.22.93.193:0 shutting down...
W20260709 12:20:58.984557 31243 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 29 similar messages]
W20260709 12:20:59.009394 31168 consensus_peers.cc:597] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.020900 31243 consensus_peers.cc:597] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.023679 31168 consensus_peers.cc:597] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.028023 31243 consensus_peers.cc:597] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.063261 31243 consensus_peers.cc:597] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.067524 31168 consensus_peers.cc:597] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.075790 31317 consensus_peers.cc:597] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.082674 31243 consensus_peers.cc:597] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.093039 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:20:59.096380 22903 tablet_replica.cc:333] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.097631 22903 raft_consensus.cc:2243] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.098388 22903 raft_consensus.cc:2272] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.101812 22903 tablet_replica.cc:333] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.102778 22903 raft_consensus.cc:2243] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:20:59.102953 31168 consensus_peers.cc:597] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.103453 22903 raft_consensus.cc:2272] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.107676 22903 tablet_replica.cc:333] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
W20260709 12:20:59.108784 31317 consensus_peers.cc:597] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.108966 22903 raft_consensus.cc:2243] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.109726 22903 raft_consensus.cc:2272] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.113289 22903 tablet_replica.cc:333] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.114216 22903 raft_consensus.cc:2243] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.114909 22903 raft_consensus.cc:2272] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.118600 22903 tablet_replica.cc:333] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.119705 22903 raft_consensus.cc:2243] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.121031 22903 raft_consensus.cc:2272] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.123272 31243 consensus_peers.cc:597] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.125624 22903 tablet_replica.cc:333] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
W20260709 12:20:59.126329 31168 consensus_peers.cc:597] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.127440 22903 raft_consensus.cc:2243] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.128226 22903 raft_consensus.cc:2272] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.131750 31317 consensus_peers.cc:597] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.132050 22903 tablet_replica.cc:333] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.133005 22903 raft_consensus.cc:2243] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.133596 22903 raft_consensus.cc:2272] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.134876 31168 consensus_peers.cc:597] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.137173 22903 tablet_replica.cc:333] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.138381 22903 raft_consensus.cc:2243] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.139851 22903 raft_consensus.cc:2272] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.143392 31317 consensus_peers.cc:597] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.143802 22903 tablet_replica.cc:333] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.144712 22903 raft_consensus.cc:2243] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.145285 22903 raft_consensus.cc:2272] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.148428 22903 tablet_replica.cc:333] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.149508 22903 raft_consensus.cc:2243] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.150219 22903 raft_consensus.cc:2272] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.154488 22903 tablet_replica.cc:333] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.155432 22903 raft_consensus.cc:2243] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.156049 22903 raft_consensus.cc:2272] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.157027 31317 consensus_peers.cc:597] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.159085 22903 tablet_replica.cc:333] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.159966 22903 raft_consensus.cc:2243] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.160558 22903 raft_consensus.cc:2272] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.163877 22903 tablet_replica.cc:333] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.164795 22903 raft_consensus.cc:2243] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.165397 22903 raft_consensus.cc:2272] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.168761 22903 tablet_replica.cc:333] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.169688 22903 raft_consensus.cc:2243] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.170241 22903 raft_consensus.cc:2272] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.172819 22903 tablet_replica.cc:333] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.173540 22903 raft_consensus.cc:2243] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.174131 22903 raft_consensus.cc:2272] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.176756 22903 tablet_replica.cc:333] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.177513 22903 raft_consensus.cc:2243] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.178038 22903 raft_consensus.cc:2272] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.180858 22903 tablet_replica.cc:333] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.181560 22903 raft_consensus.cc:2243] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.182076 22903 raft_consensus.cc:2272] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.184777 22903 tablet_replica.cc:333] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.185482 22903 raft_consensus.cc:2243] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.185990 22903 raft_consensus.cc:2272] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.188573 22903 tablet_replica.cc:333] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.189257 22903 raft_consensus.cc:2243] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.190372 22903 raft_consensus.cc:2272] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.193209 22903 tablet_replica.cc:333] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.193850 22903 raft_consensus.cc:2243] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.194355 22903 raft_consensus.cc:2272] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.197044 22903 tablet_replica.cc:333] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.197746 22903 raft_consensus.cc:2243] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.198225 22903 raft_consensus.cc:2272] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.200917 22903 tablet_replica.cc:333] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.201541 22903 raft_consensus.cc:2243] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.202013 22903 raft_consensus.cc:2272] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.204582 22903 tablet_replica.cc:333] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.205247 22903 raft_consensus.cc:2243] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.206287 22903 raft_consensus.cc:2272] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.209640 22903 tablet_replica.cc:333] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.210304 22903 raft_consensus.cc:2243] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.211084 22903 raft_consensus.cc:2272] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.214665 22903 tablet_replica.cc:333] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.215553 22903 raft_consensus.cc:2243] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.216238 22903 raft_consensus.cc:2272] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.220024 22903 tablet_replica.cc:333] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.220973 22903 raft_consensus.cc:2243] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.221625 22903 raft_consensus.cc:2272] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.222931 31168 consensus_peers.cc:597] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.225060 22903 tablet_replica.cc:333] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.226199 22903 raft_consensus.cc:2243] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.226838 22903 raft_consensus.cc:2272] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.229853 31168 consensus_peers.cc:597] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.230537 22903 tablet_replica.cc:333] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.231717 22903 raft_consensus.cc:2243] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.232458 22903 raft_consensus.cc:2272] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.233971 31317 consensus_peers.cc:597] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.235836 22903 tablet_replica.cc:333] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.236574 22903 raft_consensus.cc:2243] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.237177 22903 raft_consensus.cc:2272] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.240643 22903 tablet_replica.cc:333] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.241573 22903 raft_consensus.cc:2243] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.243031 22903 raft_consensus.cc:2272] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.246709 22903 tablet_replica.cc:333] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
W20260709 12:20:59.246889 31243 consensus_peers.cc:597] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.247668 22903 raft_consensus.cc:2243] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.249157 22903 raft_consensus.cc:2272] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.249604 31317 consensus_peers.cc:597] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.252892 22903 tablet_replica.cc:333] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
W20260709 12:20:59.253419 31168 consensus_peers.cc:597] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.253943 22903 raft_consensus.cc:2243] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.255587 22903 raft_consensus.cc:2272] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.258709 22903 tablet_replica.cc:333] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.259879 22903 raft_consensus.cc:2243] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.260622 22903 raft_consensus.cc:2272] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.266528 22903 tablet_replica.cc:333] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.268186 22903 raft_consensus.cc:2243] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.269249 22903 raft_consensus.cc:2272] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.271829 22903 tablet_replica.cc:333] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.272503 22903 raft_consensus.cc:2243] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.273020 22903 raft_consensus.cc:2272] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.276405 22903 tablet_replica.cc:333] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.277300 22903 raft_consensus.cc:2243] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.277940 22903 raft_consensus.cc:2272] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.279747 31243 consensus_peers.cc:597] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.281519 22903 tablet_replica.cc:333] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.282565 22903 raft_consensus.cc:2243] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.283288 22903 raft_consensus.cc:2272] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.284091 31243 consensus_peers.cc:597] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.286448 22903 tablet_replica.cc:333] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.287261 22903 raft_consensus.cc:2243] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.287923 22903 raft_consensus.cc:2272] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.291128 22903 tablet_replica.cc:333] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.291955 22903 raft_consensus.cc:2243] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.293252 22903 raft_consensus.cc:2272] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.295233 31243 consensus_peers.cc:597] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.296672 22903 tablet_replica.cc:333] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.297560 22903 raft_consensus.cc:2243] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.298862 22903 raft_consensus.cc:2272] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.303613 22903 tablet_replica.cc:333] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.304474 22903 raft_consensus.cc:2243] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.306380 22903 raft_consensus.cc:2272] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.310007 22903 tablet_replica.cc:333] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.310804 22903 raft_consensus.cc:2243] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.311437 22903 raft_consensus.cc:2272] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.314774 22903 tablet_replica.cc:333] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.315536 22903 raft_consensus.cc:2243] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:20:59.316808 22903 raft_consensus.cc:2272] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.320150 22903 tablet_replica.cc:333] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.320745 22903 raft_consensus.cc:2243] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.321354 22903 raft_consensus.cc:2272] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:20:59.324100 22903 tablet_replica.cc:333] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: stopping tablet replica
I20260709 12:20:59.324640 22903 raft_consensus.cc:2243] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:20:59.325119 22903 raft_consensus.cc:2272] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:20:59.335599 31243 consensus_peers.cc:597] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.366748 31243 consensus_peers.cc:597] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.398638 31317 consensus_peers.cc:597] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.406913 31317 consensus_peers.cc:597] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.416684 31168 consensus_peers.cc:597] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.433890 22903 tablet_server.cc:196] TabletServer@127.22.93.193:0 shutdown complete.
W20260709 12:20:59.444741 31317 consensus_peers.cc:597] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.471120 31243 consensus_peers.cc:597] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.507769 31168 consensus_peers.cc:597] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:20:59.592219 31243 consensus_peers.cc:597] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:20:59.600950 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:20:59.611300 31925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:20:59.635211 31926 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:59.650095 22903 server_base.cc:1061] running on GCE node
W20260709 12:20:59.650384 31928 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:20:59.655701 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:20:59.655977 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:20:59.656148 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599659656135 us; error 0 us; skew 500 ppm
I20260709 12:20:59.656893 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:20:59.700901 22903 webserver.cc:533] Webserver started at http://127.22.93.193:44567/ using document root <none> and password file <none>
I20260709 12:20:59.701784 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:20:59.702105 22903 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:20:59.707396 22903 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:20:59.718120 31933 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:20:59.719223 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:20:59.719580 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "e3b87862f0eb448db7779e995eb84f64"
format_stamp: "Formatted at 2026-07-09 12:20:45 on dist-test-slave-k289"
I20260709 12:20:59.720249 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:20:59.740978 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:20:59.742975 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:20:59.745932 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:20:59.754855 31940 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:21:00.121860 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:21:00.122346 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.369s	user 0.008s	sys 0.004s
I20260709 12:21:00.122776 22903 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:21:00.135185 31940 tablet_bootstrap.cc:492] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.151572 31940 tablet_bootstrap.cc:492] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.152688 31940 tablet_bootstrap.cc:492] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.153645 31940 ts_tablet_manager.cc:1403] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 12:21:00.156263 31940 raft_consensus.cc:359] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.157019 31940 raft_consensus.cc:740] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.157949 31940 consensus_queue.cc:260] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.161101 31940 ts_tablet_manager.cc:1434] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:00.161957 31940 tablet_bootstrap.cc:492] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.177212 31904 raft_consensus.cc:493] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.177991 31904 raft_consensus.cc:515] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.185139 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
W20260709 12:21:00.191530 31243 leader_election.cc:336] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.192212 31243 leader_election.cc:304] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.180665 31904 leader_election.cc:290] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:00.193838 31904 raft_consensus.cc:2749] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.200659 31940 tablet_bootstrap.cc:492] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.201733 31940 tablet_bootstrap.cc:492] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.202473 31940 ts_tablet_manager.cc:1403] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.041s	user 0.016s	sys 0.016s
I20260709 12:21:00.207335 31940 raft_consensus.cc:359] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.208074 31940 raft_consensus.cc:740] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.209352 31940 consensus_queue.cc:260] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.211498 31940 ts_tablet_manager.cc:1434] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:21:00.212389 31940 tablet_bootstrap.cc:492] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.225919 31911 raft_consensus.cc:493] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.226861 31911 raft_consensus.cc:515] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.230149 31911 leader_election.cc:290] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.232748 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cb701e3ab34e60b09c279e2bcfe26a" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:21:00.237952 31940 tablet_bootstrap.cc:492] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.239204 31940 tablet_bootstrap.cc:492] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.240027 31940 ts_tablet_manager.cc:1403] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.008s
W20260709 12:21:00.242677 31168 leader_election.cc:336] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.243328 31168 leader_election.cc:304] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.243287 31940 raft_consensus.cc:359] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.244234 31940 raft_consensus.cc:740] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.244421 31911 raft_consensus.cc:2749] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.244519 31922 raft_consensus.cc:493] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.245258 31922 raft_consensus.cc:515] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.245416 31940 consensus_queue.cc:260] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.247762 31940 ts_tablet_manager.cc:1434] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:00.248804 31940 tablet_bootstrap.cc:492] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.249622 31922 leader_election.cc:290] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
W20260709 12:21:00.254135 31317 leader_election.cc:336] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.258136 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dda8bf3c6e5443fa3dcaf9b4dbf8417" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:00.261062 31317 leader_election.cc:304] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:00.262284 31922 raft_consensus.cc:2749] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.271371 31944 raft_consensus.cc:493] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.272192 31944 raft_consensus.cc:515] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.272914 31904 raft_consensus.cc:493] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.273962 31904 raft_consensus.cc:515] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.274813 31944 leader_election.cc:290] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:00.277168 31904 leader_election.cc:290] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.279186 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:00.279492 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da571cacd7e4c87b7615361589e46db" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:21:00.286684 31243 leader_election.cc:336] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.287243 31243 leader_election.cc:304] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.288146 31944 raft_consensus.cc:2749] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:00.289546 31243 leader_election.cc:336] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.290020 31243 leader_election.cc:304] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.291888 31944 raft_consensus.cc:2749] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.293344 31923 raft_consensus.cc:493] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.294015 31923 raft_consensus.cc:515] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.297935 31940 tablet_bootstrap.cc:492] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.299250 31940 tablet_bootstrap.cc:492] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.299311 31923 leader_election.cc:290] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:00.299340 31944 raft_consensus.cc:493] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.300209 31940 ts_tablet_manager.cc:1403] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.052s	user 0.020s	sys 0.027s
I20260709 12:21:00.300166 31944 raft_consensus.cc:515] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.302579 31944 leader_election.cc:290] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.303470 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dda8bf3c6e5443fa3dcaf9b4dbf8417" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:21:00.304173 31350 raft_consensus.cc:2468] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:21:00.303519 31940 raft_consensus.cc:359] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.305318 31940 raft_consensus.cc:740] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.305717 31244 leader_election.cc:304] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:00.306088 31940 consensus_queue.cc:260] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.306855 31944 raft_consensus.cc:2804] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.307103 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:00.307349 31944 raft_consensus.cc:493] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.307919 31944 raft_consensus.cc:3060] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.308481 31940 ts_tablet_manager.cc:1434] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:00.309469 31940 tablet_bootstrap.cc:492] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.317304 31944 raft_consensus.cc:515] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
W20260709 12:21:00.318229 31243 leader_election.cc:336] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
W20260709 12:21:00.314385 31317 leader_election.cc:336] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.319494 31317 leader_election.cc:304] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.321113 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8dda8bf3c6e5443fa3dcaf9b4dbf8417" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:00.321471 31922 raft_consensus.cc:2749] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.321791 31350 raft_consensus.cc:3060] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.334856 31911 raft_consensus.cc:493] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.335625 31911 raft_consensus.cc:515] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.337921 31911 leader_election.cc:290] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:00.338958 31944 leader_election.cc:290] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.343497 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:00.344494 31276 raft_consensus.cc:2468] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
W20260709 12:21:00.346297 31168 leader_election.cc:336] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.347759 31350 raft_consensus.cc:2468] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 2.
I20260709 12:21:00.351583 31244 leader_election.cc:304] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:00.352908 31944 raft_consensus.cc:2804] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.353660 31944 raft_consensus.cc:697] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:00.355122 31944 consensus_queue.cc:237] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.351771 31168 leader_election.cc:304] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.361060 31911 raft_consensus.cc:2804] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:21:00.361202 31243 leader_election.cc:336] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.361775 31911 raft_consensus.cc:493] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.362335 31911 raft_consensus.cc:3060] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.391775 31911 raft_consensus.cc:515] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.392913 31940 tablet_bootstrap.cc:492] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.394332 31940 tablet_bootstrap.cc:492] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.395216 31940 ts_tablet_manager.cc:1403] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.086s	user 0.036s	sys 0.037s
I20260709 12:21:00.397153 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d8eed6a3bca469facb370f6293185b7" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:00.397933 31276 raft_consensus.cc:3060] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.398629 31940 raft_consensus.cc:359] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.399598 31940 raft_consensus.cc:740] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.400429 31940 consensus_queue.cc:260] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.399972 31022 catalog_manager.cc:5697] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 2 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.402931 31940 ts_tablet_manager.cc:1434] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:00.403736 31923 raft_consensus.cc:493] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.403924 31940 tablet_bootstrap.cc:492] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.404392 31923 raft_consensus.cc:515] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.394341 31911 leader_election.cc:290] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:00.412267 31276 raft_consensus.cc:2468] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 2.
I20260709 12:21:00.416680 31923 leader_election.cc:290] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.425801 31168 leader_election.cc:304] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:00.427145 31911 raft_consensus.cc:2804] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.428547 31911 raft_consensus.cc:697] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 2 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:21:00.429548 31911 consensus_queue.cc:237] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.436234 31940 tablet_bootstrap.cc:492] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.437517 31940 tablet_bootstrap.cc:492] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.438315 31940 ts_tablet_manager.cc:1403] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.035s	user 0.027s	sys 0.003s
I20260709 12:21:00.441361 31940 raft_consensus.cc:359] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.442464 31940 raft_consensus.cc:740] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.443286 31940 consensus_queue.cc:260] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.446287 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:21:00.465220 31168 leader_election.cc:336] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.466015 31940 ts_tablet_manager.cc:1434] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260709 12:21:00.467960 31920 raft_consensus.cc:493] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.468657 31940 tablet_bootstrap.cc:492] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.468636 31920 raft_consensus.cc:515] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.470925 31920 leader_election.cc:290] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.478689 31026 catalog_manager.cc:5697] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.484712 31912 raft_consensus.cc:493] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.485337 31924 raft_consensus.cc:493] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.485903 31924 raft_consensus.cc:515] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.486620 31911 raft_consensus.cc:493] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.487174 31911 raft_consensus.cc:515] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.488210 31924 leader_election.cc:290] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.485364 31912 raft_consensus.cc:515] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.489290 31911 leader_election.cc:290] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.492090 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:21:00.492550 31912 leader_election.cc:290] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
W20260709 12:21:00.502679 31317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 47742.9us
I20260709 12:21:00.508358 31348 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:21:00.508553 31317 leader_election.cc:336] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.509176 31317 leader_election.cc:304] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:00.510510 31922 raft_consensus.cc:2749] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.511830 22903 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:21:00.512331 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.390s	user 0.307s	sys 0.009s
I20260709 12:21:00.508849 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
W20260709 12:21:00.515148 31317 leader_election.cc:336] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.519433 31940 tablet_bootstrap.cc:492] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.520637 31940 tablet_bootstrap.cc:492] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.521479 31940 ts_tablet_manager.cc:1403] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.005s
I20260709 12:21:00.524863 31940 raft_consensus.cc:359] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.527115 31940 raft_consensus.cc:740] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.528072 31940 consensus_queue.cc:260] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.530860 31911 raft_consensus.cc:493] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.531512 31911 raft_consensus.cc:515] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.531704 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da571cacd7e4c87b7615361589e46db" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:00.532714 31277 raft_consensus.cc:2468] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:21:00.533371 31940 ts_tablet_manager.cc:1434] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:21:00.533787 31911 leader_election.cc:290] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.534912 31940 tablet_bootstrap.cc:492] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.537411 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:21:00.538162 31345 raft_consensus.cc:2468] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:21:00.539032 31922 raft_consensus.cc:493] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.539361 31169 leader_election.cc:304] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:21:00.539677 31922 raft_consensus.cc:515] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.541450 31909 raft_consensus.cc:2804] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.541854 31909 raft_consensus.cc:493] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.542032 31922 leader_election.cc:290] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:00.542289 31909 raft_consensus.cc:3060] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:00.543751 31168 leader_election.cc:336] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.544288 31168 leader_election.cc:304] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.545104 31924 raft_consensus.cc:2749] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:00.546327 31168 leader_election.cc:336] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.546766 31168 leader_election.cc:304] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.547523 31924 raft_consensus.cc:2749] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.549196 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:00.549944 31202 raft_consensus.cc:2468] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
W20260709 12:21:00.553478 31243 leader_election.cc:336] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.554085 31243 leader_election.cc:304] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.556509 31904 raft_consensus.cc:2749] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.562862 31317 leader_election.cc:304] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:21:00.561744 31909 raft_consensus.cc:515] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.563949 31922 raft_consensus.cc:2804] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.564123 31317 leader_election.cc:304] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.564401 31922 raft_consensus.cc:493] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
W20260709 12:21:00.564693 31168 leader_election.cc:336] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.564801 31922 raft_consensus.cc:3060] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.565840 31909 leader_election.cc:290] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.569535 31952 raft_consensus.cc:2804] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.570040 31952 raft_consensus.cc:493] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.570423 31952 raft_consensus.cc:3060] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.570863 31920 raft_consensus.cc:493] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.571468 31920 raft_consensus.cc:515] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.573722 31920 leader_election.cc:290] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
W20260709 12:21:00.575755 31168 leader_election.cc:336] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.584524 31952 raft_consensus.cc:515] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.587864 31922 raft_consensus.cc:515] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.590866 31952 leader_election.cc:290] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.592231 31922 leader_election.cc:290] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
W20260709 12:21:00.593814 31317 leader_election.cc:336] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.597837 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0da571cacd7e4c87b7615361589e46db" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:00.598318 31909 raft_consensus.cc:493] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.598475 31277 raft_consensus.cc:3060] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.599004 31909 raft_consensus.cc:515] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.599723 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e8a7095a2544957b3d93c160aebdad6" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:00.600386 31345 raft_consensus.cc:3060] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.601369 31909 leader_election.cc:290] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:00.601912 31940 tablet_bootstrap.cc:492] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.602262 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:00.602914 31202 raft_consensus.cc:2468] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:21:00.603180 31940 tablet_bootstrap.cc:492] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.603799 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:00.604142 31940 ts_tablet_manager.cc:1403] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.019s
I20260709 12:21:00.604502 31201 raft_consensus.cc:3060] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.607333 31940 raft_consensus.cc:359] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.607895 31277 raft_consensus.cc:2468] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 2.
I20260709 12:21:00.608111 31940 raft_consensus.cc:740] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.608994 31940 consensus_queue.cc:260] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.610417 31922 raft_consensus.cc:493] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.611021 31922 raft_consensus.cc:515] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.612012 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:00.612725 31940 ts_tablet_manager.cc:1434] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:21:00.612633 31277 raft_consensus.cc:2468] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 1.
I20260709 12:21:00.613799 31940 tablet_bootstrap.cc:492] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.616271 31922 leader_election.cc:290] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.619812 31168 leader_election.cc:304] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:00.622148 31909 raft_consensus.cc:2804] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.622766 31909 raft_consensus.cc:493] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.623237 31909 raft_consensus.cc:3060] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.625324 31345 raft_consensus.cc:2468] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 2.
W20260709 12:21:00.626189 31168 leader_election.cc:336] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.631270 31944 raft_consensus.cc:493] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.632087 31944 raft_consensus.cc:515] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.635464 31944 leader_election.cc:290] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.637231 31350 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:21:00.637988 31350 raft_consensus.cc:2468] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:21:00.640074 31244 leader_election.cc:304] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:00.641436 31912 raft_consensus.cc:2804] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.641929 31912 raft_consensus.cc:493] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.642354 31912 raft_consensus.cc:3060] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:00.643260 31243 leader_election.cc:336] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.640305 31201 raft_consensus.cc:2468] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 2.
I20260709 12:21:00.649712 31169 leader_election.cc:304] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.641425 31940 tablet_bootstrap.cc:492] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.651609 31924 raft_consensus.cc:2804] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.652115 31940 tablet_bootstrap.cc:492] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.652999 31940 ts_tablet_manager.cc:1403] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.012s
I20260709 12:21:00.656001 31940 raft_consensus.cc:359] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.656776 31940 raft_consensus.cc:740] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.655493 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:00.660070 31912 raft_consensus.cc:515] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.663412 31912 leader_election.cc:290] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.664170 31922 raft_consensus.cc:493] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.664395 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:00.665122 31345 raft_consensus.cc:3060] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.664932 31922 raft_consensus.cc:515] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.664554 31909 raft_consensus.cc:515] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.667891 31924 raft_consensus.cc:697] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 2 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:21:00.668785 31922 leader_election.cc:290] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.669922 31909 leader_election.cc:290] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:00.671386 31940 consensus_queue.cc:260] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.669304 31924 consensus_queue.cc:237] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
W20260709 12:21:00.674266 31168 leader_election.cc:336] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.672717 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "1d5ebd798965493785b198d6e8492c23" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:00.675443 31277 raft_consensus.cc:3060] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.676040 31940 ts_tablet_manager.cc:1434] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:21:00.677227 31940 tablet_bootstrap.cc:492] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:21:00.683142 31243 leader_election.cc:336] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.685833 31345 raft_consensus.cc:2468] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 2.
I20260709 12:21:00.687268 31244 leader_election.cc:304] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.687407 31277 raft_consensus.cc:2468] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d5ebd798965493785b198d6e8492c23 in term 2.
I20260709 12:21:00.688853 31168 leader_election.cc:304] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.688249 31944 raft_consensus.cc:2804] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.690346 31944 raft_consensus.cc:697] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:00.690688 31909 raft_consensus.cc:2804] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.691260 31909 raft_consensus.cc:697] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 2 LEADER]: Becoming Leader. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:21:00.691342 31944 consensus_queue.cc:237] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.692457 31909 consensus_queue.cc:237] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.693638 31317 leader_election.cc:304] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:21:00.695434 31317 leader_election.cc:304] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:21:00.696657 31317 leader_election.cc:304] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:00.699186 31923 raft_consensus.cc:2804] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.699719 31923 raft_consensus.cc:697] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:21:00.696333 31922 raft_consensus.cc:2804] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.700637 31923 consensus_queue.cc:237] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.701292 31922 raft_consensus.cc:493] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.701871 31922 raft_consensus.cc:3060] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.697043 31952 raft_consensus.cc:2804] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:21:00.713321 31317 leader_election.cc:336] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
W20260709 12:21:00.714293 31317 leader_election.cc:336] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
W20260709 12:21:00.715021 31317 leader_election.cc:336] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.723794 31022 catalog_manager.cc:5697] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:00.726411 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:00.727173 31277 raft_consensus.cc:2468] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:21:00.730185 31026 catalog_manager.cc:5697] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 2 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:00.732718 31317 leader_election.cc:336] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.733268 31317 leader_election.cc:304] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:00.734161 31962 raft_consensus.cc:2749] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:00.751526 31317 leader_election.cc:304] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:00.756878 31922 raft_consensus.cc:515] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.760068 31922 leader_election.cc:290] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:00.763289 31962 raft_consensus.cc:2804] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.763504 31920 raft_consensus.cc:493] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.763873 31962 raft_consensus.cc:493] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.764330 31962 raft_consensus.cc:3060] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.764189 31920 raft_consensus.cc:515] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.766595 31920 leader_election.cc:290] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:00.781234 31962 raft_consensus.cc:515] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
W20260709 12:21:00.784403 31317 leader_election.cc:336] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.798034 31201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:00.798784 31201 raft_consensus.cc:3060] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.800906 31904 raft_consensus.cc:493] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.801625 31904 raft_consensus.cc:515] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.803426 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cb701e3ab34e60b09c279e2bcfe26a" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:00.804163 31202 raft_consensus.cc:2468] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 1.
I20260709 12:21:00.806471 31952 raft_consensus.cc:697] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:21:00.806957 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:21:00.807628 31952 consensus_queue.cc:237] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.809191 31904 leader_election.cc:290] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:00.808002 31345 raft_consensus.cc:2468] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 1.
I20260709 12:21:00.811602 31244 leader_election.cc:304] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:00.812460 31904 raft_consensus.cc:2804] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.812870 31904 raft_consensus.cc:493] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.813238 31904 raft_consensus.cc:3060] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.818504 31345 raft_consensus.cc:1275] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer ee8bcffe388e4e0796bc17d15b7adcde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:00.820698 31944 consensus_queue.cc:1048] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:00.824919 31962 leader_election.cc:290] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
W20260709 12:21:00.825253 31243 leader_election.cc:336] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.821239 31940 tablet_bootstrap.cc:492] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:00.834460 31940 tablet_bootstrap.cc:492] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:00.835399 31940 ts_tablet_manager.cc:1403] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.158s	user 0.020s	sys 0.007s
I20260709 12:21:00.837432 31317 leader_election.cc:304] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:21:00.838335 31962 raft_consensus.cc:2804] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:00.838737 31962 raft_consensus.cc:493] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:00.839165 31962 raft_consensus.cc:3060] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.838577 31026 catalog_manager.cc:5697] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.841907 31276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a8c6d0d195714cae8e83d74d668f13fe" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:00.842742 31276 raft_consensus.cc:3060] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.849126 31940 raft_consensus.cc:359] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.849961 31940 raft_consensus.cc:740] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:00.850169 31022 catalog_manager.cc:5697] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to 1d5ebd798965493785b198d6e8492c23 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1d5ebd798965493785b198d6e8492c23" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.851153 31276 raft_consensus.cc:2468] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 2.
W20260709 12:21:00.854688 31317 leader_election.cc:336] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
W20260709 12:21:00.855523 31317 leader_election.cc:336] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.850713 31940 consensus_queue.cc:260] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:00.860704 31940 ts_tablet_manager.cc:1434] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:21:00.862015 31940 tablet_bootstrap.cc:492] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:00.865643 31277 raft_consensus.cc:1275] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer 1d5ebd798965493785b198d6e8492c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:00.867974 31909 consensus_queue.cc:1048] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:00.868216 31962 raft_consensus.cc:515] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.871866 31962 leader_election.cc:290] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Requested vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:00.879202 31201 raft_consensus.cc:2468] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 2.
I20260709 12:21:00.883111 31317 leader_election.cc:304] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:00.882844 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77cb701e3ab34e60b09c279e2bcfe26a" candidate_uuid: "9800423c0012421d9ce299e8c180ac96" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:00.884892 31203 raft_consensus.cc:3060] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:00.885720 31972 raft_consensus.cc:2804] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.886547 31972 raft_consensus.cc:697] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
W20260709 12:21:00.888942 31317 leader_election.cc:336] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.896145 31317 leader_election.cc:304] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:00.887671 31972 consensus_queue.cc:237] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.899071 31962 raft_consensus.cc:2804] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.901151 31962 raft_consensus.cc:697] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:21:00.905638 31962 consensus_queue.cc:237] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.910219 31203 raft_consensus.cc:2468] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9800423c0012421d9ce299e8c180ac96 in term 2.
I20260709 12:21:00.912894 31317 leader_election.cc:304] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96; no voters: 
I20260709 12:21:00.923401 31904 raft_consensus.cc:515] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:00.933228 31904 leader_election.cc:290] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
W20260709 12:21:00.935158 31317 leader_election.cc:336] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:00.921257 31952 raft_consensus.cc:2804] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:00.955111 31022 catalog_manager.cc:5697] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:00.954658 31952 raft_consensus.cc:697] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Becoming Leader. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:21:00.982156 31952 consensus_queue.cc:237] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:00.998324 31347 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:00.999332 31347 raft_consensus.cc:3060] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:01.003479 31940 tablet_bootstrap.cc:492] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:01.004725 31940 tablet_bootstrap.cc:492] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:01.005506 31940 ts_tablet_manager.cc:1403] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.144s	user 0.019s	sys 0.005s
W20260709 12:21:01.011045 31243 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:42481, user_credentials={real_user=slave}} blocked reactor thread for 80501.4us
W20260709 12:21:01.026293 31243 leader_election.cc:336] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:01.031419 31940 raft_consensus.cc:359] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:01.032344 31940 raft_consensus.cc:740] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
W20260709 12:21:01.030692 31243 consensus_peers.cc:597] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.034479 31022 catalog_manager.cc:5697] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.036510 31022 catalog_manager.cc:5697] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.038662 31940 consensus_queue.cc:260] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
W20260709 12:21:01.052951 31168 consensus_peers.cc:597] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.061275 31940 ts_tablet_manager.cc:1434] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.055s	user 0.009s	sys 0.000s
I20260709 12:21:01.062453 31940 tablet_bootstrap.cc:492] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:01.101231 31347 raft_consensus.cc:2468] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ee8bcffe388e4e0796bc17d15b7adcde in term 2.
I20260709 12:21:01.102123 31022 catalog_manager.cc:5697] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to 9800423c0012421d9ce299e8c180ac96 (127.22.93.196). New cstate: current_term: 2 leader_uuid: "9800423c0012421d9ce299e8c180ac96" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.104990 31940 tablet_bootstrap.cc:492] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:01.106163 31940 tablet_bootstrap.cc:492] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:01.106920 31940 ts_tablet_manager.cc:1403] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.045s	user 0.019s	sys 0.011s
I20260709 12:21:01.120224 31347 raft_consensus.cc:1275] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer 1d5ebd798965493785b198d6e8492c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.127789 31244 leader_election.cc:304] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, ee8bcffe388e4e0796bc17d15b7adcde; no voters: e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:01.125545 31940 raft_consensus.cc:359] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:01.129340 31940 raft_consensus.cc:740] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:01.129617 31968 consensus_queue.cc:1048] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:01.131821 31985 raft_consensus.cc:2804] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:01.132474 31985 raft_consensus.cc:697] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Becoming Leader. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:01.133466 31985 consensus_queue.cc:237] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
W20260709 12:21:01.134763 31168 consensus_peers.cc:597] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.130209 31940 consensus_queue.cc:260] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:01.140552 31940 ts_tablet_manager.cc:1434] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260709 12:21:01.141496 31940 tablet_bootstrap.cc:492] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:01.172492 31022 catalog_manager.cc:5697] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde reported cstate change: term changed from 1 to 2, leader changed from e3b87862f0eb448db7779e995eb84f64 (127.22.93.193) to ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195). New cstate: current_term: 2 leader_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:01.188481 31277 raft_consensus.cc:1275] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer 9800423c0012421d9ce299e8c180ac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:21:01.197516 31168 consensus_peers.cc:597] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.200135 31920 consensus_queue.cc:1048] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20260709 12:21:01.223731 31317 consensus_peers.cc:597] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.240051 31940 tablet_bootstrap.cc:492] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:01.243373 31940 tablet_bootstrap.cc:492] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:01.243484 31277 raft_consensus.cc:1275] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer 1d5ebd798965493785b198d6e8492c23: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.244865 31940 ts_tablet_manager.cc:1403] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.104s	user 0.014s	sys 0.021s
I20260709 12:21:01.247327 31924 consensus_queue.cc:1048] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:01.249430 31940 raft_consensus.cc:359] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:01.250265 31940 raft_consensus.cc:740] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:01.251109 31940 consensus_queue.cc:260] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:01.259383 31940 ts_tablet_manager.cc:1434] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:01.260422 31940 tablet_bootstrap.cc:492] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:21:01.270191 31317 consensus_peers.cc:597] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.290511 31347 raft_consensus.cc:1275] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer ee8bcffe388e4e0796bc17d15b7adcde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.292649 31987 consensus_queue.cc:1048] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:01.296566 31202 raft_consensus.cc:1275] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer 9800423c0012421d9ce299e8c180ac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.300240 31922 consensus_queue.cc:1048] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:01.328953 31243 consensus_peers.cc:597] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.394248 31201 raft_consensus.cc:1275] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer 9800423c0012421d9ce299e8c180ac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.402132 31201 raft_consensus.cc:1275] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer 9800423c0012421d9ce299e8c180ac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.434604 31920 consensus_queue.cc:1048] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:01.458729 31168 consensus_peers.cc:597] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.472124 31922 consensus_queue.cc:1048] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:01.504674 31942 raft_consensus.cc:493] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.505453 31942 raft_consensus.cc:515] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:01.511150 31942 leader_election.cc:290] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:01.516034 31942 raft_consensus.cc:493] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.516644 31942 raft_consensus.cc:515] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
W20260709 12:21:01.527468 31168 consensus_peers.cc:597] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.530012 31942 leader_election.cc:290] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:01.532409 31942 raft_consensus.cc:493] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.542304 31347 raft_consensus.cc:1275] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer ee8bcffe388e4e0796bc17d15b7adcde: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.544433 31944 consensus_queue.cc:1048] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:21:01.551750 31243 consensus_peers.cc:597] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.550586 31168 consensus_peers.cc:597] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.561105 31168 consensus_peers.cc:597] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.564810 31940 tablet_bootstrap.cc:492] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:01.568384 31940 tablet_bootstrap.cc:492] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:01.532979 31942 raft_consensus.cc:515] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:01.587379 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f5e32511d244df9299237b280d2405" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:01.589702 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:01.603195 31942 leader_election.cc:290] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:01.607746 31940 ts_tablet_manager.cc:1403] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.348s	user 0.066s	sys 0.090s
I20260709 12:21:01.609601 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
W20260709 12:21:01.594262 31317 consensus_peers.cc:597] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:01.615406 31317 consensus_peers.cc:597] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.625372 31344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:21:01.627723 31936 leader_election.cc:304] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:21:01.629319 31942 raft_consensus.cc:2749] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:01.636341 31940 raft_consensus.cc:359] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:01.647775 31940 raft_consensus.cc:740] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
W20260709 12:21:01.658450 31168 consensus_peers.cc:597] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.672227 31317 consensus_peers.cc:597] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.673185 31317 consensus_peers.cc:597] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:01.687179 31277 raft_consensus.cc:1275] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer 9800423c0012421d9ce299e8c180ac96: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:01.658522 31940 consensus_queue.cc:260] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:01.694105 31940 ts_tablet_manager.cc:1434] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.000s
I20260709 12:21:01.695165 31940 tablet_bootstrap.cc:492] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:21:01.698452 31243 consensus_peers.cc:597] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:01.706969 31168 consensus_peers.cc:597] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.738714 31317 consensus_peers.cc:597] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:01.745009 31317 consensus_peers.cc:597] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.745543 31317 consensus_peers.cc:597] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.748945 31243 consensus_peers.cc:597] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.749363 31940 tablet_bootstrap.cc:492] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:21:01.749614 31243 consensus_peers.cc:597] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.752213 31940 tablet_bootstrap.cc:492] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:01.753394 31940 ts_tablet_manager.cc:1403] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.059s	user 0.029s	sys 0.000s
I20260709 12:21:01.756142 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89f5e32511d244df9299237b280d2405" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:01.756472 31940 raft_consensus.cc:359] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:01.757402 31940 raft_consensus.cc:740] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:01.757879 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:01.758589 31940 consensus_queue.cc:260] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:01.766562 31940 ts_tablet_manager.cc:1434] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:21:01.756016 31923 consensus_queue.cc:1048] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:01.767731 31940 tablet_bootstrap.cc:492] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:01.772470 31935 leader_election.cc:304] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:01.774722 31935 leader_election.cc:304] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:01.776420 31942 raft_consensus.cc:2749] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:01.777366 31942 raft_consensus.cc:2749] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:21:01.784581 31243 consensus_peers.cc:597] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.785364 31243 consensus_peers.cc:597] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.805406 31243 consensus_peers.cc:597] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.806285 31243 consensus_peers.cc:597] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.826363 32043 raft_consensus.cc:493] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.827417 32043 raft_consensus.cc:515] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:01.831991 32043 leader_election.cc:290] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:01.833288 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
W20260709 12:21:01.834903 31317 consensus_peers.cc:597] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.841892 31317 consensus_peers.cc:597] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.858394 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:01.863902 32043 raft_consensus.cc:493] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:01.864923 32043 raft_consensus.cc:515] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:01.867954 31935 leader_election.cc:304] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:01.869571 31942 raft_consensus.cc:2749] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:01.871874 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:21:01.873894 32043 leader_election.cc:290] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:01.877473 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23ff1489a95143b79e3d3c4aa6dc7523" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:01.878732 31940 tablet_bootstrap.cc:492] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:21:01.878829 31168 consensus_peers.cc:597] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.879989 31940 tablet_bootstrap.cc:492] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:01.880018 31935 leader_election.cc:304] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:21:01.888015 31940 ts_tablet_manager.cc:1403] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.121s	user 0.044s	sys 0.050s
I20260709 12:21:01.888581 32043 raft_consensus.cc:2749] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:01.891184 31940 raft_consensus.cc:359] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:01.891898 31940 raft_consensus.cc:740] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:01.892635 31940 consensus_queue.cc:260] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:01.894860 31940 ts_tablet_manager.cc:1434] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 12:21:01.898764 31940 tablet_bootstrap.cc:492] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:21:01.900410 31243 consensus_peers.cc:597] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.900997 31317 consensus_peers.cc:597] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.901688 31317 consensus_peers.cc:597] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.918776 31243 consensus_peers.cc:597] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:01.920905 31168 consensus_peers.cc:597] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.940191 31940 tablet_bootstrap.cc:492] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:01.941429 31940 tablet_bootstrap.cc:492] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:01.942595 31940 ts_tablet_manager.cc:1403] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.008s
I20260709 12:21:01.945717 31940 raft_consensus.cc:359] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:01.946518 31940 raft_consensus.cc:740] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:01.947959 31940 consensus_queue.cc:260] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:01.951664 31940 ts_tablet_manager.cc:1434] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:21:01.952605 31940 tablet_bootstrap.cc:492] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:21:01.965190 31168 consensus_peers.cc:597] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.976754 31940 tablet_bootstrap.cc:492] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:21:01.977162 31243 consensus_peers.cc:597] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:01.978200 31940 tablet_bootstrap.cc:492] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:01.979261 31940 ts_tablet_manager.cc:1403] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.004s
I20260709 12:21:01.982002 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:36023
I20260709 12:21:01.982172 32063 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:36023 every 8 connection(s)
I20260709 12:21:01.982736 31940 raft_consensus.cc:359] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:01.983522 31940 raft_consensus.cc:740] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:01.984293 31940 consensus_queue.cc:260] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:01.986446 31940 ts_tablet_manager.cc:1434] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:01.987274 31940 tablet_bootstrap.cc:492] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.016739 31940 tablet_bootstrap.cc:492] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.017947 31940 tablet_bootstrap.cc:492] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.018791 31940 ts_tablet_manager.cc:1403] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.006s
I20260709 12:21:02.030000 31940 raft_consensus.cc:359] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.030824 31940 raft_consensus.cc:740] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.031605 31940 consensus_queue.cc:260] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.036643 31940 ts_tablet_manager.cc:1434] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:21:02.037637 31940 tablet_bootstrap.cc:492] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:21:02.054327 31317 consensus_peers.cc:597] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:02.055837 32030 raft_consensus.cc:3060] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.057488 32027 raft_consensus.cc:3060] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.062494 32043 raft_consensus.cc:493] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.063160 32043 raft_consensus.cc:515] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.065719 32043 leader_election.cc:290] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:02.068053 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
W20260709 12:21:02.068373 31317 consensus_peers.cc:597] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:02.070367 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:02.076861 31935 leader_election.cc:304] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:02.078111 31940 tablet_bootstrap.cc:492] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.078258 32043 raft_consensus.cc:2749] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:02.079324 31940 tablet_bootstrap.cc:492] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.080156 31940 ts_tablet_manager.cc:1403] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.043s	user 0.019s	sys 0.007s
I20260709 12:21:02.083863 32064 heartbeater.cc:344] Connected to a master server at 127.22.93.254:46353
I20260709 12:21:02.083369 31940 raft_consensus.cc:359] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.084440 32064 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:02.084609 31940 raft_consensus.cc:740] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.085597 32064 heartbeater.cc:507] Master 127.22.93.254:46353 requested a full tablet report, sending...
I20260709 12:21:02.085402 31940 consensus_queue.cc:260] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.088256 31940 ts_tablet_manager.cc:1434] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:02.089181 31940 tablet_bootstrap.cc:492] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:21:02.093662 31168 consensus_peers.cc:597] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:02.115207 32043 raft_consensus.cc:493] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.115928 32043 raft_consensus.cc:515] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.118088 32043 leader_election.cc:290] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:02.119333 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:02.121516 31203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:02.123822 31935 leader_election.cc:304] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:02.125664 32043 raft_consensus.cc:2749] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:02.127291 31940 tablet_bootstrap.cc:492] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.128867 31940 tablet_bootstrap.cc:492] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.130910 31940 ts_tablet_manager.cc:1403] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.004s
I20260709 12:21:02.136961 32027 raft_consensus.cc:3060] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.138373 31940 raft_consensus.cc:359] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.141325 31940 raft_consensus.cc:740] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.142200 31940 consensus_queue.cc:260] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.144815 31940 ts_tablet_manager.cc:1434] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:21:02.145771 31940 tablet_bootstrap.cc:492] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.162514 31022 ts_manager.cc:194] Re-registered known tserver with Master: e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:02.165329 31940 tablet_bootstrap.cc:492] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.167112 31940 tablet_bootstrap.cc:492] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.167352 32027 raft_consensus.cc:3060] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.167861 31940 ts_tablet_manager.cc:1403] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:21:02.170166 31940 raft_consensus.cc:359] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.170728 31940 raft_consensus.cc:740] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.171646 31940 consensus_queue.cc:260] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.174315 31940 ts_tablet_manager.cc:1434] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:02.175215 31940 tablet_bootstrap.cc:492] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
W20260709 12:21:02.177497 31168 consensus_peers.cc:597] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:21:02.187852 32043 raft_consensus.cc:493] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.188906 32043 raft_consensus.cc:515] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.206101 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9800423c0012421d9ce299e8c180ac96" is_pre_election: true
I20260709 12:21:02.206544 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ddcff546cb345c98b79aff0049e96f1" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:02.209056 31935 leader_election.cc:304] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, 9800423c0012421d9ce299e8c180ac96
I20260709 12:21:02.210361 31942 raft_consensus.cc:2749] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:02.225482 32043 leader_election.cc:290] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:02.235680 32043 raft_consensus.cc:493] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:02.236280 32043 raft_consensus.cc:515] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.240392 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a400868ea34d6287dd1306d2c7456c" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1d5ebd798965493785b198d6e8492c23" is_pre_election: true
I20260709 12:21:02.240900 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "89a400868ea34d6287dd1306d2c7456c" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" is_pre_election: true
I20260709 12:21:02.240904 32043 leader_election.cc:290] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:02.243279 31935 leader_election.cc:304] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64; no voters: 1d5ebd798965493785b198d6e8492c23, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:02.244910 32043 raft_consensus.cc:2749] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:21:02.269050 31940 tablet_bootstrap.cc:492] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.270272 31940 tablet_bootstrap.cc:492] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.271049 31940 ts_tablet_manager.cc:1403] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.096s	user 0.039s	sys 0.018s
I20260709 12:21:02.272945 31022 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34374
I20260709 12:21:02.273743 31940 raft_consensus.cc:359] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.274386 31940 raft_consensus.cc:740] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.283056 32030 raft_consensus.cc:3060] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.291875 32064 heartbeater.cc:499] Master 127.22.93.254:46353 was elected leader, sending a full tablet report...
I20260709 12:21:02.323939 31940 consensus_queue.cc:260] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.326243 31940 ts_tablet_manager.cc:1434] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.001s
I20260709 12:21:02.327293 31940 tablet_bootstrap.cc:492] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.358639 31940 tablet_bootstrap.cc:492] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.359862 31940 tablet_bootstrap.cc:492] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.360739 31940 ts_tablet_manager.cc:1403] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.034s	user 0.027s	sys 0.004s
I20260709 12:21:02.364315 31940 raft_consensus.cc:359] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.365175 31940 raft_consensus.cc:740] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.366102 31940 consensus_queue.cc:260] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.368238 31940 ts_tablet_manager.cc:1434] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:21:02.369129 31940 tablet_bootstrap.cc:492] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.385782 31940 tablet_bootstrap.cc:492] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.386693 31940 tablet_bootstrap.cc:492] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.387408 31940 ts_tablet_manager.cc:1403] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:21:02.389652 31940 raft_consensus.cc:359] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.390241 31940 raft_consensus.cc:740] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.390893 31940 consensus_queue.cc:260] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.392710 31940 ts_tablet_manager.cc:1434] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:02.393548 31940 tablet_bootstrap.cc:492] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.412274 31940 tablet_bootstrap.cc:492] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.413537 31940 tablet_bootstrap.cc:492] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.414194 31940 ts_tablet_manager.cc:1403] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 12:21:02.416750 31940 raft_consensus.cc:359] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.417385 31940 raft_consensus.cc:740] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.418035 31940 consensus_queue.cc:260] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.420478 31940 ts_tablet_manager.cc:1434] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:02.421375 31940 tablet_bootstrap.cc:492] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.439671 31940 tablet_bootstrap.cc:492] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.440793 31940 tablet_bootstrap.cc:492] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.441717 31940 ts_tablet_manager.cc:1403] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.000s
I20260709 12:21:02.445036 31940 raft_consensus.cc:359] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.445674 31940 raft_consensus.cc:740] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.446231 31940 consensus_queue.cc:260] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.447968 31940 ts_tablet_manager.cc:1434] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:21:02.449085 31940 tablet_bootstrap.cc:492] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.467187 31940 tablet_bootstrap.cc:492] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.468374 31940 tablet_bootstrap.cc:492] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.469332 31940 ts_tablet_manager.cc:1403] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:21:02.473346 31940 raft_consensus.cc:359] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.477576 31940 raft_consensus.cc:740] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.478547 31940 consensus_queue.cc:260] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.481154 31940 ts_tablet_manager.cc:1434] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:21:02.482546 31940 tablet_bootstrap.cc:492] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.501257 32030 raft_consensus.cc:3060] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.505591 31940 tablet_bootstrap.cc:492] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.506748 31940 tablet_bootstrap.cc:492] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.507766 31940 ts_tablet_manager.cc:1403] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 12:21:02.510974 31940 raft_consensus.cc:359] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.511706 31940 raft_consensus.cc:740] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.512421 31940 consensus_queue.cc:260] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.515203 31940 ts_tablet_manager.cc:1434] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:02.516078 31940 tablet_bootstrap.cc:492] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.561389 31940 tablet_bootstrap.cc:492] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.562577 31940 tablet_bootstrap.cc:492] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.563401 31940 ts_tablet_manager.cc:1403] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.048s	user 0.017s	sys 0.012s
I20260709 12:21:02.587990 31940 raft_consensus.cc:359] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.588845 31940 raft_consensus.cc:740] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.590252 31940 consensus_queue.cc:260] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.592281 31940 ts_tablet_manager.cc:1434] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:21:02.593240 31940 tablet_bootstrap.cc:492] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.598701 32030 raft_consensus.cc:3060] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:02.630038 31940 tablet_bootstrap.cc:492] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.631263 31940 tablet_bootstrap.cc:492] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.632038 31940 ts_tablet_manager.cc:1403] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.004s
I20260709 12:21:02.634899 31940 raft_consensus.cc:359] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.635641 31940 raft_consensus.cc:740] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.636408 31940 consensus_queue.cc:260] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.644593 31940 ts_tablet_manager.cc:1434] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:21:02.649588 31940 tablet_bootstrap.cc:492] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.677626 31940 tablet_bootstrap.cc:492] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.678782 31940 tablet_bootstrap.cc:492] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.680780 31940 ts_tablet_manager.cc:1403] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.031s	user 0.023s	sys 0.000s
I20260709 12:21:02.685324 31940 raft_consensus.cc:359] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.686096 31940 raft_consensus.cc:740] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.687021 31940 consensus_queue.cc:260] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.689432 31940 ts_tablet_manager.cc:1434] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:21:02.690441 31940 tablet_bootstrap.cc:492] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.731493 31940 tablet_bootstrap.cc:492] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.732543 31940 tablet_bootstrap.cc:492] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.733266 31940 ts_tablet_manager.cc:1403] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.004s
I20260709 12:21:02.736133 31940 raft_consensus.cc:359] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.736819 31940 raft_consensus.cc:740] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.737646 31940 consensus_queue.cc:260] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.740111 31940 ts_tablet_manager.cc:1434] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:21:02.741185 31940 tablet_bootstrap.cc:492] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.768966 31940 tablet_bootstrap.cc:492] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.770126 31940 tablet_bootstrap.cc:492] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.771037 31940 ts_tablet_manager.cc:1403] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.003s
I20260709 12:21:02.774601 31940 raft_consensus.cc:359] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.775344 31940 raft_consensus.cc:740] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.776206 31940 consensus_queue.cc:260] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.781250 31940 ts_tablet_manager.cc:1434] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:21:02.782258 31940 tablet_bootstrap.cc:492] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.799680 31940 tablet_bootstrap.cc:492] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.801045 31940 tablet_bootstrap.cc:492] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.801843 31940 ts_tablet_manager.cc:1403] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:21:02.806296 31940 raft_consensus.cc:359] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.808194 31940 raft_consensus.cc:740] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.808992 31940 consensus_queue.cc:260] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.811574 31940 ts_tablet_manager.cc:1434] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:02.812413 31940 tablet_bootstrap.cc:492] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.831372 31940 tablet_bootstrap.cc:492] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.832427 31940 tablet_bootstrap.cc:492] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.833180 31940 ts_tablet_manager.cc:1403] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:21:02.836154 31940 raft_consensus.cc:359] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.836879 31940 raft_consensus.cc:740] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.837591 31940 consensus_queue.cc:260] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.840159 31940 ts_tablet_manager.cc:1434] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:21:02.841259 31940 tablet_bootstrap.cc:492] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.869738 31940 tablet_bootstrap.cc:492] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.870878 31940 tablet_bootstrap.cc:492] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.871686 31940 ts_tablet_manager.cc:1403] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.031s	user 0.021s	sys 0.004s
I20260709 12:21:02.874650 31940 raft_consensus.cc:359] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.875373 31940 raft_consensus.cc:740] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.876109 31940 consensus_queue.cc:260] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.878872 31940 ts_tablet_manager.cc:1434] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:02.881042 31940 tablet_bootstrap.cc:492] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.914048 31940 tablet_bootstrap.cc:492] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.915359 31940 tablet_bootstrap.cc:492] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.916744 31940 ts_tablet_manager.cc:1403] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.036s	user 0.024s	sys 0.008s
I20260709 12:21:02.919693 31940 raft_consensus.cc:359] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.920439 31940 raft_consensus.cc:740] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.921258 31940 consensus_queue.cc:260] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:02.923468 31940 ts_tablet_manager.cc:1434] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:21:02.925139 31940 tablet_bootstrap.cc:492] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.950335 31940 tablet_bootstrap.cc:492] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.951507 31940 tablet_bootstrap.cc:492] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.952296 31940 ts_tablet_manager.cc:1403] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.010s
I20260709 12:21:02.955240 31940 raft_consensus.cc:359] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.955752 31940 raft_consensus.cc:740] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.956341 31940 consensus_queue.cc:260] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:02.958125 31940 ts_tablet_manager.cc:1434] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:21:02.958956 31940 tablet_bootstrap.cc:492] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:02.979683 31940 tablet_bootstrap.cc:492] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:02.982046 31940 tablet_bootstrap.cc:492] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:02.982867 31940 ts_tablet_manager.cc:1403] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 12:21:02.985124 31940 raft_consensus.cc:359] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.985663 31940 raft_consensus.cc:740] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:02.986229 31940 consensus_queue.cc:260] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:02.988440 31940 ts_tablet_manager.cc:1434] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:02.989526 31940 tablet_bootstrap.cc:492] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:03.013324 31940 tablet_bootstrap.cc:492] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:03.014394 31940 tablet_bootstrap.cc:492] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:03.015198 31940 ts_tablet_manager.cc:1403] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.026s	user 0.020s	sys 0.000s
I20260709 12:21:03.017340 31940 raft_consensus.cc:359] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:03.017886 31940 raft_consensus.cc:740] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:03.018537 31940 consensus_queue.cc:260] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:03.021070 31940 ts_tablet_manager.cc:1434] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:03.022398 31940 tablet_bootstrap.cc:492] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:03.042207 31940 tablet_bootstrap.cc:492] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:03.043483 31940 tablet_bootstrap.cc:492] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:03.044376 31940 ts_tablet_manager.cc:1403] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.008s
I20260709 12:21:03.046824 31940 raft_consensus.cc:359] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:03.047534 31940 raft_consensus.cc:740] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:03.048235 31940 consensus_queue.cc:260] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:03.050619 31940 ts_tablet_manager.cc:1434] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:21:03.051497 31940 tablet_bootstrap.cc:492] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:03.069584 31940 tablet_bootstrap.cc:492] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:03.071700 31940 tablet_bootstrap.cc:492] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:03.072602 31940 ts_tablet_manager.cc:1403] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 12:21:03.075567 31940 raft_consensus.cc:359] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:03.076275 31940 raft_consensus.cc:740] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:03.077047 31940 consensus_queue.cc:260] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:03.079412 31940 ts_tablet_manager.cc:1434] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:03.081161 31940 tablet_bootstrap.cc:492] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:03.097564 31940 tablet_bootstrap.cc:492] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:03.098730 31940 tablet_bootstrap.cc:492] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:03.099454 31940 ts_tablet_manager.cc:1403] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:21:03.101935 31940 raft_consensus.cc:359] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:03.102681 31940 raft_consensus.cc:740] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:03.103614 31940 consensus_queue.cc:260] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:03.106038 31940 ts_tablet_manager.cc:1434] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:03.107390 31940 tablet_bootstrap.cc:492] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: Bootstrap starting.
I20260709 12:21:03.128460 31940 tablet_bootstrap.cc:492] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:03.129859 31940 tablet_bootstrap.cc:492] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: Bootstrap complete.
I20260709 12:21:03.130712 31940 ts_tablet_manager.cc:1403] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: Time spent bootstrapping tablet: real 0.024s	user 0.019s	sys 0.000s
I20260709 12:21:03.133808 31940 raft_consensus.cc:359] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:03.134572 31940 raft_consensus.cc:740] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Initialized, Role: FOLLOWER
I20260709 12:21:03.135344 31940 consensus_queue.cc:260] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:03.137043 31940 ts_tablet_manager.cc:1434] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:03.149910 32026 raft_consensus.cc:3060] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.271360 32026 raft_consensus.cc:3060] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.345077 32028 raft_consensus.cc:3060] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:03.511565 32030 raft_consensus.cc:3060] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:05.504177 31057 debug-util.cc:398] Leaking SignalData structure 0x7b080032f180 after lost signal to thread 22906
W20260709 12:21:05.506084 31057 debug-util.cc:398] Leaking SignalData structure 0x7b0800217520 after lost signal to thread 31060
W20260709 12:21:05.507939 31057 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5000 after lost signal to thread 31229
W20260709 12:21:05.509434 31057 debug-util.cc:398] Leaking SignalData structure 0x7b08002ad100 after lost signal to thread 31303
W20260709 12:21:05.510869 31057 debug-util.cc:398] Leaking SignalData structure 0x7b08001f2780 after lost signal to thread 31378
W20260709 12:21:05.512485 31057 debug-util.cc:398] Leaking SignalData structure 0x7b08001727c0 after lost signal to thread 32063
I20260709 12:21:12.043689 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:12.128139 31346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e"
dest_uuid: "9800423c0012421d9ce299e8c180ac96"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:55870
I20260709 12:21:12.129355 31346 raft_consensus.cc:606] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:12.133122 31346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467"
dest_uuid: "9800423c0012421d9ce299e8c180ac96"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:55870
I20260709 12:21:12.133834 31346 raft_consensus.cc:606] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:12.161288 31202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b"
dest_uuid: "1d5ebd798965493785b198d6e8492c23"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:35860
I20260709 12:21:12.162017 31202 raft_consensus.cc:606] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 2 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:12.175871 31275 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a"
dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:21:12.176501 31275 raft_consensus.cc:606] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:12.179414 31346 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef66344d4a1a4900832a1486db956576"
dest_uuid: "9800423c0012421d9ce299e8c180ac96"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:55870
I20260709 12:21:12.180030 31346 raft_consensus.cc:606] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:12.182852 31202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff93479d44174057843c235314d57461"
dest_uuid: "1d5ebd798965493785b198d6e8492c23"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:35860
I20260709 12:21:12.183450 31202 raft_consensus.cc:606] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:12.184880 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:21:12.187317 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:12.188405 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:12.273180 32149 raft_consensus.cc:993] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.275023 32137 raft_consensus.cc:1081] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.291265 32028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39908
I20260709 12:21:12.292078 32028 raft_consensus.cc:493] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.292937 32028 raft_consensus.cc:3060] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.304418 32028 raft_consensus.cc:515] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.308579 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:12.309682 31345 raft_consensus.cc:3055] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:12.309948 31196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13829eeeec8d43728320a1237d93b27e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:12.310035 31345 raft_consensus.cc:740] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:21:12.308521 32028 leader_election.cc:290] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:12.310879 31196 raft_consensus.cc:3060] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.311705 31345 consensus_queue.cc:260] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.313338 31345 raft_consensus.cc:3060] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.322971 31345 raft_consensus.cc:2468] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:12.323367 31196 raft_consensus.cc:2468] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:12.324498 31936 leader_election.cc:304] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:12.326844 32159 raft_consensus.cc:2804] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:12.329329 32159 raft_consensus.cc:697] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:12.330668 32159 consensus_queue.cc:237] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.345536 31021 catalog_manager.cc:5697] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 2 to 3, leader changed from 9800423c0012421d9ce299e8c180ac96 (127.22.93.196) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.390889 32151 raft_consensus.cc:993] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.391507 32151 raft_consensus.cc:1081] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.393024 32028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff93479d44174057843c235314d57461"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39932
I20260709 12:21:12.393602 32028 raft_consensus.cc:493] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.393965 32028 raft_consensus.cc:3060] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.402878 32028 raft_consensus.cc:515] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.405359 32028 leader_election.cc:290] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:12.406325 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff93479d44174057843c235314d57461" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:12.407174 31345 raft_consensus.cc:3060] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.407292 31196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff93479d44174057843c235314d57461" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:12.408016 31196 raft_consensus.cc:3055] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.408375 31196 raft_consensus.cc:740] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:21:12.409392 31196 consensus_queue.cc:260] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.411113 31196 raft_consensus.cc:3060] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.418601 31345 raft_consensus.cc:2468] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:12.420356 31936 leader_election.cc:304] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:12.420542 31196 raft_consensus.cc:2468] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:12.421481 32159 raft_consensus.cc:2804] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.422098 32159 raft_consensus.cc:697] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:12.423282 32159 consensus_queue.cc:237] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.424943 32139 raft_consensus.cc:993] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.425506 32151 raft_consensus.cc:1081] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 2 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.427126 32028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39932
I20260709 12:21:12.427696 32028 raft_consensus.cc:493] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.428120 32028 raft_consensus.cc:3060] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.436180 32028 raft_consensus.cc:515] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:12.437374 31021 catalog_manager.cc:5697] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 1 to 2, leader changed from 1d5ebd798965493785b198d6e8492c23 (127.22.93.194) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.439271 32028 leader_election.cc:290] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:12.438799 31196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:12.440193 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d70b39511ff4d30b5b30ea93e6d471b" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:12.440825 31277 raft_consensus.cc:3060] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.440223 31196 raft_consensus.cc:3055] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:12.441973 31196 raft_consensus.cc:740] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1d5ebd798965493785b198d6e8492c23, State: Running, Role: LEADER
I20260709 12:21:12.443038 31196 consensus_queue.cc:260] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:12.446766 31196 raft_consensus.cc:3060] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.450310 31277 raft_consensus.cc:2468] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:12.451776 31935 leader_election.cc:304] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:12.452587 32159 raft_consensus.cc:2804] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:12.453058 32159 raft_consensus.cc:697] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:12.454406 32159 consensus_queue.cc:237] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:12.459106 31196 raft_consensus.cc:2468] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:12.470894 31021 catalog_manager.cc:5697] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 2 to 3, leader changed from 1d5ebd798965493785b198d6e8492c23 (127.22.93.194) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.522593 32158 raft_consensus.cc:993] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.523314 32149 raft_consensus.cc:1081] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.525032 32028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39908
I20260709 12:21:12.525554 32028 raft_consensus.cc:493] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.525863 32028 raft_consensus.cc:3060] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.533474 32028 raft_consensus.cc:515] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.535382 32028 leader_election.cc:290] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:12.536177 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:12.536631 31196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24d785aaedd448a7bc9ddde9d573d467" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:12.536899 31345 raft_consensus.cc:3055] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.537235 31196 raft_consensus.cc:3060] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.537403 31345 raft_consensus.cc:740] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:21:12.538296 31345 consensus_queue.cc:260] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.539487 31345 raft_consensus.cc:3060] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.545259 31196 raft_consensus.cc:2468] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:12.546639 31935 leader_election.cc:304] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:12.547588 32159 raft_consensus.cc:2804] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.548066 32159 raft_consensus.cc:697] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:12.549042 32159 consensus_queue.cc:237] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.550171 31345 raft_consensus.cc:2468] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:12.564541 31021 catalog_manager.cc:5697] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 1 to 2, leader changed from 9800423c0012421d9ce299e8c180ac96 (127.22.93.196) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.606236 32131 raft_consensus.cc:993] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.607607 32150 raft_consensus.cc:1081] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.609501 32030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39916
I20260709 12:21:12.610168 32030 raft_consensus.cc:493] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.610539 32030 raft_consensus.cc:3060] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.619699 32030 raft_consensus.cc:515] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:12.622771 31275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:12.623540 31275 raft_consensus.cc:3055] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:12.623926 32030 leader_election.cc:290] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:21:12.623937 31275 raft_consensus.cc:740] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:12.625385 31275 consensus_queue.cc:260] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:12.626330 31275 raft_consensus.cc:3060] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.634025 32158 raft_consensus.cc:993] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.634718 32149 raft_consensus.cc:1081] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:12.637122 32030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef66344d4a1a4900832a1486db956576"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39908
I20260709 12:21:12.637799 32030 raft_consensus.cc:493] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:12.638345 32030 raft_consensus.cc:3060] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.623325 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d181ab9ed7ab4e54ac19b4cdad63a90a" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:12.651453 31345 raft_consensus.cc:3060] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:12.656029 32030 raft_consensus.cc:515] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.660169 31346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:12.660907 31346 raft_consensus.cc:3055] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:12.661298 31346 raft_consensus.cc:740] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:21:12.662281 31346 consensus_queue.cc:260] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.662299 32030 leader_election.cc:290] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:12.670194 31196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef66344d4a1a4900832a1486db956576" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:12.671181 31196 raft_consensus.cc:3060] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.671634 31346 raft_consensus.cc:3060] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:12.681457 31346 raft_consensus.cc:2468] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:12.681649 31196 raft_consensus.cc:2468] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:12.650799 31275 raft_consensus.cc:2468] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:12.688962 31935 leader_election.cc:304] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:12.690311 32159 raft_consensus.cc:2804] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:12.690850 32159 raft_consensus.cc:697] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:12.660796 31345 raft_consensus.cc:2468] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:12.693939 32159 consensus_queue.cc:237] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:12.694404 31936 leader_election.cc:304] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:12.695613 32160 raft_consensus.cc:2804] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:12.696862 32160 raft_consensus.cc:697] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:12.697876 32160 consensus_queue.cc:237] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:12.705955 31021 catalog_manager.cc:5697] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 2 to 3, leader changed from 9800423c0012421d9ce299e8c180ac96 (127.22.93.196) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:12.727504 31021 catalog_manager.cc:5697] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 1 to 2, leader changed from ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:12.802505 31345 raft_consensus.cc:1275] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:12.803997 32160 consensus_queue.cc:1048] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.810417 31346 raft_consensus.cc:1275] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:12.812171 32160 consensus_queue.cc:1048] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:12.832540 31202 raft_consensus.cc:1275] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:12.833142 31196 raft_consensus.cc:1275] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:12.836629 32177 consensus_queue.cc:1048] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:12.837060 32169 consensus_queue.cc:1048] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:12.934747 31198 raft_consensus.cc:1275] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:12.936206 32177 consensus_queue.cc:1048] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:12.955353 31275 raft_consensus.cc:1275] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:12.956971 32159 consensus_queue.cc:1048] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:13.080009 31345 raft_consensus.cc:1275] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.081413 32159 consensus_queue.cc:1048] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.098932 31198 raft_consensus.cc:1275] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.100706 32159 consensus_queue.cc:1048] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.164849 31345 raft_consensus.cc:1275] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:13.166504 32159 consensus_queue.cc:1048] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:13.179358 31198 raft_consensus.cc:1275] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:13.182139 32159 consensus_queue.cc:1048] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:13.236873 31345 raft_consensus.cc:1275] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.238792 32159 consensus_queue.cc:1048] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.248402 31275 raft_consensus.cc:1275] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.251142 32159 consensus_queue.cc:1048] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.254106 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:13.343964 31345 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "25d1fa74ba5e44c194b27640def09ef5"
dest_uuid: "9800423c0012421d9ce299e8c180ac96"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:55870
I20260709 12:21:13.344807 31345 raft_consensus.cc:606] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:13.348310 31278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57753c60b8424c90bfc222514285d338"
dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:21:13.349028 31278 raft_consensus.cc:606] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:13.352139 31278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc"
dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:21:13.352892 31278 raft_consensus.cc:606] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:13.356724 31278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164"
dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:21:13.357321 31278 raft_consensus.cc:606] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:13.361793 31278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c"
dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:21:13.362346 31278 raft_consensus.cc:606] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:13.363651 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:21:13.366050 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:13.366972 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:13.400550 32158 raft_consensus.cc:993] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.401173 32158 raft_consensus.cc:1081] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.406405 32016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "25d1fa74ba5e44c194b27640def09ef5"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39908
I20260709 12:21:13.407207 32016 raft_consensus.cc:493] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:13.407676 32016 raft_consensus.cc:3060] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.418838 32016 raft_consensus.cc:515] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:13.421758 32016 leader_election.cc:290] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Requested vote from peers 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:13.422362 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d1fa74ba5e44c194b27640def09ef5" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:13.422698 32150 raft_consensus.cc:993] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.423183 31202 raft_consensus.cc:3060] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.423735 32188 raft_consensus.cc:1081] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.427116 32016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39916
I20260709 12:21:13.427783 32016 raft_consensus.cc:493] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:13.428222 32016 raft_consensus.cc:3060] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.423231 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "25d1fa74ba5e44c194b27640def09ef5" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:13.434783 31345 raft_consensus.cc:3055] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:13.435173 31345 raft_consensus.cc:740] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9800423c0012421d9ce299e8c180ac96, State: Running, Role: LEADER
I20260709 12:21:13.436081 31345 consensus_queue.cc:260] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:13.437520 31345 raft_consensus.cc:3060] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.437430 32016 raft_consensus.cc:515] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:13.438277 31202 raft_consensus.cc:2468] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:13.439915 31935 leader_election.cc:304] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:13.440984 32177 raft_consensus.cc:2804] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:13.441522 32177 raft_consensus.cc:697] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:13.444875 32177 consensus_queue.cc:237] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:13.449241 32016 leader_election.cc:290] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:21:13.449800 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:13.450675 31278 raft_consensus.cc:3055] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:13.450568 31346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4622853e390489ebd01e9f3ace8f0fc" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:13.451280 31278 raft_consensus.cc:740] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:13.451504 31346 raft_consensus.cc:3060] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.452263 31278 consensus_queue.cc:260] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:13.455220 31278 raft_consensus.cc:3060] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.457314 31345 raft_consensus.cc:2468] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:13.460932 31021 catalog_manager.cc:5697] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 1 to 2, leader changed from 9800423c0012421d9ce299e8c180ac96 (127.22.93.196) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:13.462023 31346 raft_consensus.cc:2468] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:13.463399 31936 leader_election.cc:304] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:13.464411 32177 raft_consensus.cc:2804] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:13.464972 32177 raft_consensus.cc:697] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:13.465116 31278 raft_consensus.cc:2468] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:13.466024 32177 consensus_queue.cc:237] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:13.487006 31021 catalog_manager.cc:5697] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 2 to 3, leader changed from ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:13.594264 32131 raft_consensus.cc:993] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.594908 32150 raft_consensus.cc:1081] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.596812 32016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39916
I20260709 12:21:13.597386 32016 raft_consensus.cc:493] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:13.597787 32016 raft_consensus.cc:3060] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.604470 32016 raft_consensus.cc:515] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:13.606572 32016 leader_election.cc:290] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:21:13.607545 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:13.607826 31345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ac4ef802a3d14adfb4774a8841d34164" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:13.608316 31278 raft_consensus.cc:3055] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:13.608394 31345 raft_consensus.cc:3060] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.608697 31278 raft_consensus.cc:740] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:13.609655 31278 consensus_queue.cc:260] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:13.611078 31278 raft_consensus.cc:3060] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:13.616729 31345 raft_consensus.cc:2468] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:13.618103 31936 leader_election.cc:304] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:13.619060 32177 raft_consensus.cc:2804] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:13.619478 31278 raft_consensus.cc:2468] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 3.
I20260709 12:21:13.619650 32177 raft_consensus.cc:697] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:13.621678 32177 consensus_queue.cc:237] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:13.634091 31021 catalog_manager.cc:5697] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 2 to 3, leader changed from ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 3 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:13.667762 32131 raft_consensus.cc:993] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.668298 32188 raft_consensus.cc:1081] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.669900 32016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39916
I20260709 12:21:13.670480 32016 raft_consensus.cc:493] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:13.670838 32016 raft_consensus.cc:3060] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.678035 32016 raft_consensus.cc:515] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:13.679930 32016 leader_election.cc:290] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:13.681078 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:13.681360 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d56e60fa30c74545837b808553cb3e3c" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:13.681833 31202 raft_consensus.cc:3060] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.681933 31277 raft_consensus.cc:3055] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:13.682351 31277 raft_consensus.cc:740] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:13.683457 31277 consensus_queue.cc:260] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:13.685025 31277 raft_consensus.cc:3060] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.691257 31202 raft_consensus.cc:2468] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:13.692030 31277 raft_consensus.cc:2468] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:13.692473 31935 leader_election.cc:304] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:13.693473 32177 raft_consensus.cc:2804] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:13.693912 32177 raft_consensus.cc:697] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:13.694811 32177 consensus_queue.cc:237] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:13.706416 31021 catalog_manager.cc:5697] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 1 to 2, leader changed from ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:13.842458 32131 raft_consensus.cc:993] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.843108 32131 raft_consensus.cc:1081] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:13.845431 32030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57753c60b8424c90bfc222514285d338"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39916
I20260709 12:21:13.846037 32030 raft_consensus.cc:493] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:13.846410 32030 raft_consensus.cc:3060] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.854089 32030 raft_consensus.cc:515] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:13.856061 32030 leader_election.cc:290] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:13.857293 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:13.858032 31202 raft_consensus.cc:3060] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.858019 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57753c60b8424c90bfc222514285d338" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:13.860363 31277 raft_consensus.cc:3055] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:13.860689 31277 raft_consensus.cc:740] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:13.861598 31277 consensus_queue.cc:260] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:13.864465 31277 raft_consensus.cc:3060] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:13.868175 31202 raft_consensus.cc:2468] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:13.869382 31935 leader_election.cc:304] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:13.870182 32169 raft_consensus.cc:2804] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:13.870666 32169 raft_consensus.cc:697] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:13.871908 31277 raft_consensus.cc:2468] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:13.871724 32169 consensus_queue.cc:237] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:13.883854 31021 catalog_manager.cc:5697] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 1 to 2, leader changed from ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:13.911268 31345 raft_consensus.cc:1275] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:13.912685 32169 consensus_queue.cc:1048] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:13.916174 31346 raft_consensus.cc:1275] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.918064 32177 consensus_queue.cc:1048] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:13.931902 31277 raft_consensus.cc:1275] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:13.937558 32169 consensus_queue.cc:1048] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:13.945849 31202 raft_consensus.cc:1275] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:13.949451 32159 consensus_queue.cc:1048] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:14.091572 31278 raft_consensus.cc:1275] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:14.093039 32169 consensus_queue.cc:1048] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:14.111872 31202 raft_consensus.cc:1275] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:14.114111 32177 consensus_queue.cc:1048] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:14.162927 31277 raft_consensus.cc:1275] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:14.164573 32177 consensus_queue.cc:1048] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:14.165548 31345 raft_consensus.cc:1275] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:14.167127 32177 consensus_queue.cc:1048] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:14.330374 31202 raft_consensus.cc:1275] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:14.332038 32177 consensus_queue.cc:1048] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:14.348176 31277 raft_consensus.cc:1275] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:14.412698 32159 consensus_queue.cc:1048] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:14.417824 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:14.423625 31935 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37949, user_credentials={real_user=slave}} blocked reactor thread for 73708.7us
I20260709 12:21:14.507702 31277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e"
dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:21:14.508426 31277 raft_consensus.cc:606] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:14.511971 31277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988"
dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:21:14.512589 31277 raft_consensus.cc:606] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:14.515426 31277 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2"
dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
mode: GRACEFUL
new_leader_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:37296
I20260709 12:21:14.516005 31277 raft_consensus.cc:606] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Received request to transfer leadership to TS e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:14.517375 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:21:14.519331 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:14.520150 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:14.896899 32188 raft_consensus.cc:993] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:14.897426 32214 raft_consensus.cc:1081] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:14.898902 32030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39916
I20260709 12:21:14.899494 32030 raft_consensus.cc:493] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:14.899803 32030 raft_consensus.cc:3060] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:14.909165 32030 raft_consensus.cc:515] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:14.910946 32030 leader_election.cc:290] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:14.911934 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:14.912644 31202 raft_consensus.cc:3060] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:14.913187 31277 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c051d29b0624a46be22221fba1d500e" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:14.913902 31277 raft_consensus.cc:3055] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:14.914208 31277 raft_consensus.cc:740] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:14.915263 31277 consensus_queue.cc:260] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:14.916600 31277 raft_consensus.cc:3060] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:14.924352 31202 raft_consensus.cc:2468] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:14.924574 31277 raft_consensus.cc:2468] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:14.926084 31935 leader_election.cc:304] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde; no voters: 
I20260709 12:21:14.926955 32169 raft_consensus.cc:2804] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:14.927537 32169 raft_consensus.cc:697] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:14.928534 32169 consensus_queue.cc:237] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:14.940649 31026 catalog_manager.cc:5697] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 1 to 2, leader changed from ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:14.949031 32188 raft_consensus.cc:993] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:14.949878 32214 raft_consensus.cc:1081] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:14.952096 32016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39916
I20260709 12:21:14.952862 32016 raft_consensus.cc:493] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:14.953300 32016 raft_consensus.cc:3060] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:14.968569 32016 raft_consensus.cc:515] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:14.971511 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:14.972257 31278 raft_consensus.cc:3055] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:14.972574 31278 raft_consensus.cc:740] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:14.972616 32016 leader_election.cc:290] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Requested vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), 9800423c0012421d9ce299e8c180ac96 (127.22.93.196:36383)
I20260709 12:21:14.972728 31346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2de9d20cb0f14f9e95f678bcf8c59988" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9800423c0012421d9ce299e8c180ac96"
I20260709 12:21:14.973665 31346 raft_consensus.cc:3060] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:14.973474 31278 consensus_queue.cc:260] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:14.974753 31278 raft_consensus.cc:3060] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:14.986192 31346 raft_consensus.cc:2468] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:14.988147 31936 leader_election.cc:304] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:14.990115 32177 raft_consensus.cc:2804] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:14.990620 32177 raft_consensus.cc:697] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:14.991582 32177 consensus_queue.cc:237] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:14.994024 31278 raft_consensus.cc:2468] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:15.007889 31026 catalog_manager.cc:5697] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 1 to 2, leader changed from ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:15.093787 32214 raft_consensus.cc:993] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde: : Instructing follower e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:15.094386 32226 raft_consensus.cc:1081] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Signalling peer e3b87862f0eb448db7779e995eb84f64 to start an election
I20260709 12:21:15.096311 32016 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2"
dest_uuid: "e3b87862f0eb448db7779e995eb84f64"
 from {username='slave'} at 127.0.0.1:39916
I20260709 12:21:15.097024 32016 raft_consensus.cc:493] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:15.097476 32016 raft_consensus.cc:3060] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:15.109485 32016 raft_consensus.cc:515] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:15.111763 32016 leader_election.cc:290] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Requested vote from peers 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481), ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949)
I20260709 12:21:15.112947 31202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d5ebd798965493785b198d6e8492c23"
I20260709 12:21:15.113685 31202 raft_consensus.cc:3060] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:15.113682 31278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f09b8867a34e32aaa4ae2f232e4fd2" candidate_uuid: "e3b87862f0eb448db7779e995eb84f64" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ee8bcffe388e4e0796bc17d15b7adcde"
I20260709 12:21:15.114508 31278 raft_consensus.cc:3055] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:15.114805 31278 raft_consensus.cc:740] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ee8bcffe388e4e0796bc17d15b7adcde, State: Running, Role: LEADER
I20260709 12:21:15.115690 31278 consensus_queue.cc:260] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:15.117895 31278 raft_consensus.cc:3060] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:15.130396 31202 raft_consensus.cc:2468] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:15.131798 31935 leader_election.cc:304] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64; no voters: 
I20260709 12:21:15.132721 32177 raft_consensus.cc:2804] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:15.133205 31278 raft_consensus.cc:2468] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3b87862f0eb448db7779e995eb84f64 in term 2.
I20260709 12:21:15.133297 32177 raft_consensus.cc:697] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Becoming Leader. State: Replica: e3b87862f0eb448db7779e995eb84f64, State: Running, Role: LEADER
I20260709 12:21:15.134583 32177 consensus_queue.cc:237] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:15.146310 31026 catalog_manager.cc:5697] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 reported cstate change: term changed from 1 to 2, leader changed from ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195) to e3b87862f0eb448db7779e995eb84f64 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "e3b87862f0eb448db7779e995eb84f64" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:15.371628 31201 raft_consensus.cc:1275] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:15.374136 32177 consensus_queue.cc:1048] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:15.418063 31345 raft_consensus.cc:1275] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:15.420825 32169 consensus_queue.cc:1048] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:15.433687 31278 raft_consensus.cc:1275] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:15.437256 32159 consensus_queue.cc:1048] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:15.482148 31278 raft_consensus.cc:1275] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:15.493161 32177 consensus_queue.cc:1048] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:15.586256 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:15.628687 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:15.630641 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:15.631480 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:15.646281 31201 raft_consensus.cc:1275] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:15.648010 32177 consensus_queue.cc:1048] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:15.669595 31278 raft_consensus.cc:1275] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Refusing update from remote peer e3b87862f0eb448db7779e995eb84f64: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:15.680810 32177 consensus_queue.cc:1048] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:15.691908 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:15.749487 22903 tablet_server.cc:179] TabletServer@127.22.93.193:36023 shutting down...
W20260709 12:21:15.753469 31243 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 254 similar messages]
W20260709 12:21:15.757683 31243 consensus_peers.cc:597] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.788949 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:15.790380 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.791504 22903 raft_consensus.cc:2243] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.792161 22903 raft_consensus.cc:2272] T 7d2db72180a343d9a6ee51388b24edd9 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.793023 31317 consensus_peers.cc:597] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.795789 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.797204 22903 raft_consensus.cc:2243] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.798586 22903 raft_consensus.cc:2272] T ac4ef802a3d14adfb4774a8841d34164 P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.799957 31168 consensus_peers.cc:597] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:15.801925 31168 consensus_peers.cc:597] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.802455 22903 tablet_replica.cc:333] stopping tablet replica
W20260709 12:21:15.802559 31168 consensus_peers.cc:597] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.803426 22903 raft_consensus.cc:2243] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.803916 22903 raft_consensus.cc:2272] T 8a2005abeeca4984960b64be4b5d532e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.808383 31168 consensus_peers.cc:597] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.808802 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.810082 22903 raft_consensus.cc:2243] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.810628 22903 raft_consensus.cc:2272] T 6d69b4dd96704efb9cb29a41aae2b039 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.815618 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.816803 22903 raft_consensus.cc:2243] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.818634 22903 raft_consensus.cc:2272] T 28ff0dec68504c32b1b5df23cd8f25a0 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.822278 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.823302 22903 raft_consensus.cc:2243] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:15.823325 31317 consensus_peers.cc:597] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.824023 22903 raft_consensus.cc:2272] T f83751ae3dbd4d78add4ddcbf77254a4 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.824625 31243 consensus_peers.cc:597] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:15.826651 31317 consensus_peers.cc:597] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.827666 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.829931 22903 raft_consensus.cc:2243] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.830518 22903 raft_consensus.cc:2272] T 41c876d87436493a8aaeb3be151cbf9e P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.832712 31243 consensus_peers.cc:597] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.833974 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.835188 22903 raft_consensus.cc:2243] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:21:15.836242 31243 consensus_peers.cc:597] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.836426 22903 raft_consensus.cc:2272] T 24d785aaedd448a7bc9ddde9d573d467 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.839190 31168 consensus_peers.cc:597] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.840159 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.841286 22903 raft_consensus.cc:2243] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.842592 22903 raft_consensus.cc:2272] T 2de9d20cb0f14f9e95f678bcf8c59988 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.847708 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.848862 22903 raft_consensus.cc:2243] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.849426 22903 raft_consensus.cc:2272] T f018fab4f8f24dc18b24bf29b839f828 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.852845 22903 tablet_replica.cc:333] stopping tablet replica
W20260709 12:21:15.853428 31317 consensus_peers.cc:597] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.853798 22903 raft_consensus.cc:2243] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.854728 22903 raft_consensus.cc:2272] T 4b8ec802808248f1bb901b81b304d5ef P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.858721 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.860088 22903 raft_consensus.cc:2243] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.860816 22903 raft_consensus.cc:2272] T 0da571cacd7e4c87b7615361589e46db P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.864966 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.866137 22903 raft_consensus.cc:2243] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.866796 22903 raft_consensus.cc:2272] T a8c6d0d195714cae8e83d74d668f13fe P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.870599 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.871510 22903 raft_consensus.cc:2243] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.872630 22903 raft_consensus.cc:2272] T 25d1fa74ba5e44c194b27640def09ef5 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.874378 31168 consensus_peers.cc:597] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.876151 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.877300 22903 raft_consensus.cc:2243] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.878022 22903 raft_consensus.cc:2272] T fab0948c0d0a4bf4a2d9a762fa77f379 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.881676 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.882718 22903 raft_consensus.cc:2243] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.883328 22903 raft_consensus.cc:2272] T c66c15cae85a4a45bae00ea0560859d7 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.885941 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.886683 22903 raft_consensus.cc:2243] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.887693 22903 raft_consensus.cc:2272] T 9d70b39511ff4d30b5b30ea93e6d471b P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.890594 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.891709 22903 raft_consensus.cc:2243] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.892899 22903 raft_consensus.cc:2272] T ff93479d44174057843c235314d57461 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.896121 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.896793 22903 raft_consensus.cc:2243] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.897188 22903 raft_consensus.cc:2272] T 7188da143a8e4c5fb12f21ff47aa63ea P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.900130 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.901090 22903 raft_consensus.cc:2243] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.902369 22903 raft_consensus.cc:2272] T 13829eeeec8d43728320a1237d93b27e P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.902608 31317 consensus_peers.cc:597] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.905162 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.906268 22903 raft_consensus.cc:2243] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.906747 22903 raft_consensus.cc:2272] T de710065f7ad4be19742d79b91324d29 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.909595 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.910274 22903 raft_consensus.cc:2243] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.910821 22903 raft_consensus.cc:2272] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.914178 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.915027 22903 raft_consensus.cc:2243] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.915616 22903 raft_consensus.cc:2272] T 1e8a7095a2544957b3d93c160aebdad6 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.918344 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.919143 22903 raft_consensus.cc:2243] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.920320 22903 raft_consensus.cc:2272] T a4622853e390489ebd01e9f3ace8f0fc P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.923784 31168 consensus_peers.cc:597] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.924167 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.925036 22903 raft_consensus.cc:2243] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.925503 22903 raft_consensus.cc:2272] T 89a400868ea34d6287dd1306d2c7456c P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.928174 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.928898 22903 raft_consensus.cc:2243] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.929352 22903 raft_consensus.cc:2272] T 20fcea95aa024b629aecb6d0ff49c9d1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.931856 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.932626 22903 raft_consensus.cc:2243] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.933064 22903 raft_consensus.cc:2272] T 2929cced2b1543e0aa12f490cb2abbbd P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.935705 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.936359 22903 raft_consensus.cc:2243] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.937517 22903 raft_consensus.cc:2272] T 2c051d29b0624a46be22221fba1d500e P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.941354 22903 tablet_replica.cc:333] stopping tablet replica
W20260709 12:21:15.942103 31317 consensus_peers.cc:597] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.942219 22903 raft_consensus.cc:2243] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.943568 22903 raft_consensus.cc:2272] T 57753c60b8424c90bfc222514285d338 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.946388 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.947057 22903 raft_consensus.cc:2243] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.947906 22903 raft_consensus.cc:2272] T d181ab9ed7ab4e54ac19b4cdad63a90a P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.950263 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.950852 22903 raft_consensus.cc:2243] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.951344 22903 raft_consensus.cc:2272] T 4c71bd7869d948b4bc36991abb4b71a5 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.953564 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.954358 22903 raft_consensus.cc:2243] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.954907 22903 raft_consensus.cc:2272] T 964ad8a458c2403a9dbdd50be2fd763d P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.958210 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.959056 22903 raft_consensus.cc:2243] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.959731 22903 raft_consensus.cc:2272] T 77cb701e3ab34e60b09c279e2bcfe26a P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.963145 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.963835 22903 raft_consensus.cc:2243] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.964399 22903 raft_consensus.cc:2272] T 4314d275b47a469bafd749deec419c28 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.967880 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.968753 22903 raft_consensus.cc:2243] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.969354 22903 raft_consensus.cc:2272] T 5c37a6f0ffae493aa28e03c18d52e48f P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.972697 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.973287 22903 raft_consensus.cc:2243] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.974421 22903 raft_consensus.cc:2272] T 97f09b8867a34e32aaa4ae2f232e4fd2 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.977567 31317 consensus_peers.cc:597] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.977862 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.978804 22903 raft_consensus.cc:2243] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.979444 22903 raft_consensus.cc:2272] T 23ff1489a95143b79e3d3c4aa6dc7523 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.982820 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.983494 22903 raft_consensus.cc:2243] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.983978 22903 raft_consensus.cc:2272] T 89f5e32511d244df9299237b280d2405 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.986953 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.987759 22903 raft_consensus.cc:2243] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.988305 22903 raft_consensus.cc:2272] T c8ec895126a540df9c9474a9dd420991 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.991094 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.991734 22903 raft_consensus.cc:2243] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:15.992623 22903 raft_consensus.cc:2272] T ef66344d4a1a4900832a1486db956576 P e3b87862f0eb448db7779e995eb84f64 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:15.995277 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:15.996042 22903 raft_consensus.cc:2243] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:15.996520 22903 raft_consensus.cc:2272] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:15.998708 31243 consensus_peers.cc:597] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:15.999590 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:16.000291 22903 raft_consensus.cc:2243] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.000765 22903 raft_consensus.cc:2272] T 3d8eed6a3bca469facb370f6293185b7 P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.003324 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:16.003826 22903 raft_consensus.cc:2243] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.004252 22903 raft_consensus.cc:2272] T 7ddcff546cb345c98b79aff0049e96f1 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.007107 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:16.007793 22903 raft_consensus.cc:2243] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.008358 22903 raft_consensus.cc:2272] T 76f9f2ccc422431581e845d7df278107 P e3b87862f0eb448db7779e995eb84f64 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.011943 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:16.012688 22903 raft_consensus.cc:2243] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:21:16.013417 31168 consensus_peers.cc:597] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.013871 22903 raft_consensus.cc:2272] T d56e60fa30c74545837b808553cb3e3c P e3b87862f0eb448db7779e995eb84f64 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:16.016551 31243 consensus_peers.cc:597] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.024258 31168 consensus_peers.cc:597] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.059888 31317 consensus_peers.cc:597] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.086001 31937 connection.cc:466] server connection from 127.0.0.1:39908 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:39908 (request call id 405) could send its response
W20260709 12:21:16.096166 31317 consensus_peers.cc:597] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.099486 31243 consensus_peers.cc:597] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.103099 22903 tablet_server.cc:196] TabletServer@127.22.93.193:36023 shutdown complete.
W20260709 12:21:16.150372 31168 consensus_peers.cc:597] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.153640 31168 consensus_peers.cc:597] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.157467 31168 consensus_peers.cc:597] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.157734 31243 consensus_peers.cc:597] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.214596 31317 consensus_peers.cc:597] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.225165 22903 tablet_server.cc:179] TabletServer@127.22.93.194:0 shutting down...
W20260709 12:21:16.248914 31243 consensus_peers.cc:597] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.304013 31317 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:37949, user_credentials={real_user=slave}} blocked reactor thread for 46068us
W20260709 12:21:16.306859 31244 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.196:36383, user_credentials={real_user=slave}} blocked reactor thread for 65202.4us
W20260709 12:21:16.315632 31317 consensus_peers.cc:597] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 -> Peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Couldn't send request to peer e3b87862f0eb448db7779e995eb84f64. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.337092 31317 consensus_peers.cc:597] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.343231 31243 consensus_peers.cc:597] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.344038 31243 consensus_peers.cc:597] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.352422 31243 consensus_peers.cc:597] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.353257 31243 consensus_peers.cc:597] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.371381 31243 consensus_peers.cc:597] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.386794 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:16.389070 22903 tablet_replica.cc:333] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.390370 22903 raft_consensus.cc:2243] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.394447 22903 raft_consensus.cc:2272] T 7d2db72180a343d9a6ee51388b24edd9 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:16.399955 31317 consensus_peers.cc:597] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.406373 31243 consensus_peers.cc:597] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.406534 22903 tablet_replica.cc:333] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.410684 22903 raft_consensus.cc:2243] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.412068 22903 raft_consensus.cc:2272] T 23ff1489a95143b79e3d3c4aa6dc7523 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.415822 22903 tablet_replica.cc:333] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.418378 22903 raft_consensus.cc:2243] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.419108 22903 raft_consensus.cc:2272] T ff93479d44174057843c235314d57461 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.423074 22903 tablet_replica.cc:333] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.424053 22903 raft_consensus.cc:2243] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.424683 22903 raft_consensus.cc:2272] T 9d70b39511ff4d30b5b30ea93e6d471b P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.427590 22903 tablet_replica.cc:333] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.428619 22903 raft_consensus.cc:2243] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.429199 22903 raft_consensus.cc:2272] T 6d69b4dd96704efb9cb29a41aae2b039 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.432334 22903 tablet_replica.cc:333] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.433075 22903 raft_consensus.cc:2243] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.433703 22903 raft_consensus.cc:2272] T 5c37a6f0ffae493aa28e03c18d52e48f P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.436884 22903 tablet_replica.cc:333] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.437637 22903 raft_consensus.cc:2243] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.438630 22903 raft_consensus.cc:2272] T f83751ae3dbd4d78add4ddcbf77254a4 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.440987 22903 tablet_replica.cc:333] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.441622 22903 raft_consensus.cc:2243] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.442632 22903 raft_consensus.cc:2272] T 3f45cc601c2c422b933c4fd00560db82 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.445858 22903 tablet_replica.cc:333] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.447043 22903 raft_consensus.cc:2243] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.447746 22903 raft_consensus.cc:2272] T 24d785aaedd448a7bc9ddde9d573d467 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.450696 22903 tablet_replica.cc:333] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.451629 22903 raft_consensus.cc:2243] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.452883 22903 raft_consensus.cc:2272] T 1c590f5280eb4ea99fbfbe28c2630d55 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.456107 22903 tablet_replica.cc:333] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.457059 22903 raft_consensus.cc:2243] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.457635 22903 raft_consensus.cc:2272] T b70e3a964ca446edb98d1ad6c8984716 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.460706 22903 tablet_replica.cc:333] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.461431 22903 raft_consensus.cc:2243] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.462656 22903 raft_consensus.cc:2272] T 89a400868ea34d6287dd1306d2c7456c P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.465447 22903 tablet_replica.cc:333] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.466288 22903 raft_consensus.cc:2243] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.467617 22903 raft_consensus.cc:2272] T 1e8a7095a2544957b3d93c160aebdad6 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.469887 22903 tablet_replica.cc:333] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.470567 22903 raft_consensus.cc:2243] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.471171 22903 raft_consensus.cc:2272] T d56e60fa30c74545837b808553cb3e3c P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.473325 22903 tablet_replica.cc:333] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.473966 22903 raft_consensus.cc:2243] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.474414 22903 raft_consensus.cc:2272] T 7ddcff546cb345c98b79aff0049e96f1 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.476917 22903 tablet_replica.cc:333] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.477540 22903 raft_consensus.cc:2243] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.478073 22903 raft_consensus.cc:2272] T 702d6fce6e6745b4952d035e0ceccd49 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.480473 22903 tablet_replica.cc:333] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.481105 22903 raft_consensus.cc:2243] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.481575 22903 raft_consensus.cc:2272] T 77cb701e3ab34e60b09c279e2bcfe26a P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.483927 22903 tablet_replica.cc:333] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.484624 22903 raft_consensus.cc:2243] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.485575 22903 raft_consensus.cc:2272] T 4c71bd7869d948b4bc36991abb4b71a5 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.488090 22903 tablet_replica.cc:333] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.489245 22903 raft_consensus.cc:2243] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.490448 22903 raft_consensus.cc:2272] T 302d0756616a44fbad812870fbd6d499 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.493405 22903 tablet_replica.cc:333] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.494095 22903 raft_consensus.cc:2243] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.494630 22903 raft_consensus.cc:2272] T 97f09b8867a34e32aaa4ae2f232e4fd2 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.497743 22903 tablet_replica.cc:333] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.498428 22903 raft_consensus.cc:2243] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.498880 22903 raft_consensus.cc:2272] T 256c4c6b88d240658c96e3d2b37b1d51 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.501468 22903 tablet_replica.cc:333] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.502163 22903 raft_consensus.cc:2243] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.502682 22903 raft_consensus.cc:2272] T ef66344d4a1a4900832a1486db956576 P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.505228 22903 tablet_replica.cc:333] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.506032 22903 raft_consensus.cc:2243] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.507258 22903 raft_consensus.cc:2272] T c8ec895126a540df9c9474a9dd420991 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.510146 22903 tablet_replica.cc:333] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.510807 22903 raft_consensus.cc:2243] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.511327 22903 raft_consensus.cc:2272] T 13829eeeec8d43728320a1237d93b27e P 1d5ebd798965493785b198d6e8492c23 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.513839 22903 tablet_replica.cc:333] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.514746 22903 raft_consensus.cc:2243] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.515380 22903 raft_consensus.cc:2272] T de710065f7ad4be19742d79b91324d29 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.518798 22903 tablet_replica.cc:333] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.519752 22903 raft_consensus.cc:2243] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:16.519873 31243 consensus_peers.cc:597] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.520412 22903 raft_consensus.cc:2272] T 7188da143a8e4c5fb12f21ff47aa63ea P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.523478 22903 tablet_replica.cc:333] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.524365 22903 raft_consensus.cc:2243] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.524950 22903 raft_consensus.cc:2272] T f018fab4f8f24dc18b24bf29b839f828 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.527376 22903 tablet_replica.cc:333] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.527971 22903 raft_consensus.cc:2243] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.528417 22903 raft_consensus.cc:2272] T 8d0f6d602e394c848d29df14804fa855 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.530699 22903 tablet_replica.cc:333] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.531322 22903 raft_consensus.cc:2243] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.531757 22903 raft_consensus.cc:2272] T 437143ed6af647b0b4b7a3f240e11346 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.533960 22903 tablet_replica.cc:333] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.534528 22903 raft_consensus.cc:2243] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.535547 22903 raft_consensus.cc:2272] T 89f5e32511d244df9299237b280d2405 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.538498 22903 tablet_replica.cc:333] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.539316 22903 raft_consensus.cc:2243] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.539877 22903 raft_consensus.cc:2272] T 399de19748dd4407986684b816a07da9 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:16.542186 31317 consensus_peers.cc:597] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.542831 22903 tablet_replica.cc:333] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.543708 22903 raft_consensus.cc:2243] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.544236 22903 raft_consensus.cc:2272] T 9f29500f45e14bf3b37916af7a3f4982 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.546815 22903 tablet_replica.cc:333] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.547480 22903 raft_consensus.cc:2243] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.547966 22903 raft_consensus.cc:2272] T 13d247b7758c49c08c20a65227f42b52 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.550411 22903 tablet_replica.cc:333] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.551084 22903 raft_consensus.cc:2243] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.552109 22903 raft_consensus.cc:2272] T 4b8ec802808248f1bb901b81b304d5ef P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.554358 22903 tablet_replica.cc:333] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.554961 22903 raft_consensus.cc:2243] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.556018 22903 raft_consensus.cc:2272] T 3d8eed6a3bca469facb370f6293185b7 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.558971 22903 tablet_replica.cc:333] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.559868 22903 raft_consensus.cc:2243] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.560524 22903 raft_consensus.cc:2272] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.563587 22903 tablet_replica.cc:333] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.564266 22903 raft_consensus.cc:2243] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.565248 22903 raft_consensus.cc:2272] T 2929cced2b1543e0aa12f490cb2abbbd P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.567919 22903 tablet_replica.cc:333] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.568529 22903 raft_consensus.cc:2243] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.569509 22903 raft_consensus.cc:2272] T 20fcea95aa024b629aecb6d0ff49c9d1 P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.572089 22903 tablet_replica.cc:333] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.572692 22903 raft_consensus.cc:2243] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.573169 22903 raft_consensus.cc:2272] T 2c051d29b0624a46be22221fba1d500e P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.575611 22903 tablet_replica.cc:333] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.576458 22903 raft_consensus.cc:2243] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.576996 22903 raft_consensus.cc:2272] T 57753c60b8424c90bfc222514285d338 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:16.577907 31243 consensus_peers.cc:597] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.580015 22903 tablet_replica.cc:333] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.580847 22903 raft_consensus.cc:2243] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.581348 22903 raft_consensus.cc:2272] T 26a6299c5cfa4197a694ae06c6e07e4f P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.583688 22903 tablet_replica.cc:333] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.584254 22903 raft_consensus.cc:2243] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.584743 22903 raft_consensus.cc:2272] T ead9af52f3cb440a823ab640a53caa2d P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.587291 22903 tablet_replica.cc:333] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
I20260709 12:21:16.588047 22903 raft_consensus.cc:2243] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.588642 22903 raft_consensus.cc:2272] T ce58073b26274815b7e9542e152bd07c P 1d5ebd798965493785b198d6e8492c23 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:16.590843 31317 consensus_peers.cc:597] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.591895 22903 tablet_replica.cc:333] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23: stopping tablet replica
W20260709 12:21:16.592497 31317 consensus_peers.cc:597] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.592733 22903 raft_consensus.cc:2243] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.593353 22903 raft_consensus.cc:2272] T 25d1fa74ba5e44c194b27640def09ef5 P 1d5ebd798965493785b198d6e8492c23 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:16.595738 31317 consensus_peers.cc:597] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.627703 31243 consensus_peers.cc:597] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.641858 31243 consensus_peers.cc:597] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.669785 31243 consensus_peers.cc:597] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.693509 22903 tablet_server.cc:196] TabletServer@127.22.93.194:0 shutdown complete.
W20260709 12:21:16.697345 31317 consensus_peers.cc:597] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 -> Peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Couldn't send request to peer 1d5ebd798965493785b198d6e8492c23. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:42481: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.812791 22903 tablet_server.cc:179] TabletServer@127.22.93.195:0 shutting down...
W20260709 12:21:16.827647 31317 consensus_peers.cc:597] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:16.831700 31317 consensus_peers.cc:597] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.888356 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:16.889389 22903 tablet_replica.cc:333] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.890587 22903 raft_consensus.cc:2243] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.891309 22903 raft_consensus.cc:2272] T d181ab9ed7ab4e54ac19b4cdad63a90a P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.893738 22903 tablet_replica.cc:333] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.894480 22903 raft_consensus.cc:2243] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.895061 22903 raft_consensus.cc:2272] T 7d2db72180a343d9a6ee51388b24edd9 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.898304 22903 tablet_replica.cc:333] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.899389 22903 raft_consensus.cc:2243] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.899984 22903 raft_consensus.cc:2272] T 9d70b39511ff4d30b5b30ea93e6d471b P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.902966 22903 tablet_replica.cc:333] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.903658 22903 raft_consensus.cc:2243] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.904088 22903 raft_consensus.cc:2272] T 28ff0dec68504c32b1b5df23cd8f25a0 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.906418 22903 tablet_replica.cc:333] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.907058 22903 raft_consensus.cc:2243] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.907969 22903 raft_consensus.cc:2272] T 6d69b4dd96704efb9cb29a41aae2b039 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.910146 22903 tablet_replica.cc:333] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.910740 22903 raft_consensus.cc:2243] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.911715 22903 raft_consensus.cc:2272] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.914767 22903 tablet_replica.cc:333] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.915513 22903 raft_consensus.cc:2243] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:21:16.915848 31317 consensus_peers.cc:597] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.916671 22903 raft_consensus.cc:2272] T 256c4c6b88d240658c96e3d2b37b1d51 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.919415 22903 tablet_replica.cc:333] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.920109 22903 raft_consensus.cc:2243] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.921121 22903 raft_consensus.cc:2272] T 5c37a6f0ffae493aa28e03c18d52e48f P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.924907 22903 tablet_replica.cc:333] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.928476 22903 raft_consensus.cc:2243] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:16.928872 31317 consensus_peers.cc:597] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.929270 22903 raft_consensus.cc:2272] T 1c590f5280eb4ea99fbfbe28c2630d55 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.932677 22903 tablet_replica.cc:333] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.933421 22903 raft_consensus.cc:2243] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:21:16.934131 31317 consensus_peers.cc:597] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.934603 22903 raft_consensus.cc:2272] T 76f9f2ccc422431581e845d7df278107 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.937420 22903 tablet_replica.cc:333] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.938201 22903 raft_consensus.cc:2243] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.938700 22903 raft_consensus.cc:2272] T 89a400868ea34d6287dd1306d2c7456c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.941183 22903 tablet_replica.cc:333] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.941936 22903 raft_consensus.cc:2243] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.942406 22903 raft_consensus.cc:2272] T 20fcea95aa024b629aecb6d0ff49c9d1 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.944650 32250 raft_consensus.cc:493] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:16.945271 22903 tablet_replica.cc:333] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.945322 32250 raft_consensus.cc:515] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:16.946274 22903 raft_consensus.cc:2243] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.946780 22903 raft_consensus.cc:2272] T 57753c60b8424c90bfc222514285d338 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.947803 32250 leader_election.cc:290] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:16.950333 22903 tablet_replica.cc:333] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
W20260709 12:21:16.950471 31317 consensus_peers.cc:597] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.950974 32226 raft_consensus.cc:493] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:16.951471 32226 raft_consensus.cc:515] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } } peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } }
I20260709 12:21:16.952201 22903 raft_consensus.cc:2243] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.952782 22903 raft_consensus.cc:2272] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:16.953102 31317 leader_election.cc:336] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:21:16.953599 32226 leader_election.cc:290] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
W20260709 12:21:16.954193 31317 leader_election.cc:336] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:16.954646 31317 leader_election.cc:304] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:16.955458 32250 raft_consensus.cc:2749] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:16.958178 22903 tablet_replica.cc:333] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
W20260709 12:21:16.959007 31243 leader_election.cc:336] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:16.959331 22903 raft_consensus.cc:2243] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.960052 22903 raft_consensus.cc:2272] T 3d8eed6a3bca469facb370f6293185b7 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:16.959976 31243 leader_election.cc:336] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Network error: Client connection negotiation failed: client connection to 127.22.93.194:42481: connect: Connection refused (error 111)
I20260709 12:21:16.960630 31243 leader_election.cc:304] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ee8bcffe388e4e0796bc17d15b7adcde; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
W20260709 12:21:16.961318 31243 raft_consensus.cc:2686] T 2c051d29b0624a46be22221fba1d500e P ee8bcffe388e4e0796bc17d15b7adcde: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260709 12:21:16.963841 22903 tablet_replica.cc:333] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.964679 22903 raft_consensus.cc:2243] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.965134 22903 raft_consensus.cc:2272] T d56e60fa30c74545837b808553cb3e3c P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.967351 22903 tablet_replica.cc:333] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.967927 22903 raft_consensus.cc:2243] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.968470 22903 raft_consensus.cc:2272] T c66c15cae85a4a45bae00ea0560859d7 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.971760 22903 tablet_replica.cc:333] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.972585 22903 raft_consensus.cc:2243] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:21:16.973089 31317 consensus_peers.cc:597] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:16.973636 22903 raft_consensus.cc:2272] T b70e3a964ca446edb98d1ad6c8984716 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.976099 22903 tablet_replica.cc:333] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.976873 22903 raft_consensus.cc:2243] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.977356 22903 raft_consensus.cc:2272] T fab0948c0d0a4bf4a2d9a762fa77f379 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.979844 22903 tablet_replica.cc:333] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.980482 22903 raft_consensus.cc:2243] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.980971 22903 raft_consensus.cc:2272] T 26a6299c5cfa4197a694ae06c6e07e4f P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.983330 22903 tablet_replica.cc:333] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.983959 22903 raft_consensus.cc:2243] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:16.984910 22903 raft_consensus.cc:2272] T ead9af52f3cb440a823ab640a53caa2d P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.987085 32250 raft_consensus.cc:493] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:16.987457 22903 tablet_replica.cc:333] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.987737 32250 raft_consensus.cc:515] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:16.988207 22903 raft_consensus.cc:2243] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.988777 22903 raft_consensus.cc:2272] T 3f45cc601c2c422b933c4fd00560db82 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:16.989991 32250 leader_election.cc:290] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:16.991612 22903 tablet_replica.cc:333] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.992579 22903 raft_consensus.cc:2243] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.993144 22903 raft_consensus.cc:2272] T 2de9d20cb0f14f9e95f678bcf8c59988 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:16.994004 31317 leader_election.cc:336] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:21:16.994776 31317 leader_election.cc:336] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:16.995146 31317 leader_election.cc:304] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:16.995833 22903 tablet_replica.cc:333] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:16.995792 32250 raft_consensus.cc:2749] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:16.996691 22903 raft_consensus.cc:2243] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:16.997170 22903 raft_consensus.cc:2272] T 41c876d87436493a8aaeb3be151cbf9e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.000008 22903 tablet_replica.cc:333] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.000871 22903 raft_consensus.cc:2243] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.001371 22903 raft_consensus.cc:2272] T 8d0f6d602e394c848d29df14804fa855 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.004335 22903 tablet_replica.cc:333] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.004976 22903 raft_consensus.cc:2243] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.005786 22903 raft_consensus.cc:2272] T 437143ed6af647b0b4b7a3f240e11346 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.008368 22903 tablet_replica.cc:333] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.008982 22903 raft_consensus.cc:2243] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.009505 22903 raft_consensus.cc:2272] T 89f5e32511d244df9299237b280d2405 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.012645 22903 tablet_replica.cc:333] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.013477 22903 raft_consensus.cc:2243] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.014060 22903 raft_consensus.cc:2272] T 399de19748dd4407986684b816a07da9 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.017344 22903 tablet_replica.cc:333] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.017838 32250 raft_consensus.cc:493] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:17.018234 22903 raft_consensus.cc:2243] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.018548 32250 raft_consensus.cc:515] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:17.019652 22903 raft_consensus.cc:2272] T 9f29500f45e14bf3b37916af7a3f4982 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.021081 32250 leader_election.cc:290] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:17.023118 22903 tablet_replica.cc:333] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.023875 22903 raft_consensus.cc:2243] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.024775 22903 raft_consensus.cc:2272] T 13d247b7758c49c08c20a65227f42b52 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.027220 22903 tablet_replica.cc:333] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.028030 22903 raft_consensus.cc:2243] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.028599 22903 raft_consensus.cc:2272] T a4622853e390489ebd01e9f3ace8f0fc P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:17.031347 31317 leader_election.cc:336] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:17.031934 22903 tablet_replica.cc:333] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
W20260709 12:21:17.032297 31317 leader_election.cc:336] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Network error: Client connection negotiation failed: client connection to 127.22.93.194:42481: connect: Connection refused (error 111)
I20260709 12:21:17.032724 31317 leader_election.cc:304] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:17.032848 22903 raft_consensus.cc:2243] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.033483 32250 raft_consensus.cc:2749] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:17.033500 22903 raft_consensus.cc:2272] T a8c6d0d195714cae8e83d74d668f13fe P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.036613 22903 tablet_replica.cc:333] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.037366 22903 raft_consensus.cc:2243] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.038355 22903 raft_consensus.cc:2272] T ce58073b26274815b7e9542e152bd07c P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.040757 22903 tablet_replica.cc:333] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.041456 22903 raft_consensus.cc:2243] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.041862 22903 raft_consensus.cc:2272] T 0da571cacd7e4c87b7615361589e46db P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.044370 22903 tablet_replica.cc:333] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.045154 22903 raft_consensus.cc:2243] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.045689 22903 raft_consensus.cc:2272] T 97f09b8867a34e32aaa4ae2f232e4fd2 P ee8bcffe388e4e0796bc17d15b7adcde [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.048571 22903 tablet_replica.cc:333] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.049304 22903 raft_consensus.cc:2243] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.049855 22903 raft_consensus.cc:2272] T 302d0756616a44fbad812870fbd6d499 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.052790 22903 tablet_replica.cc:333] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.053544 22903 raft_consensus.cc:2243] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.054682 22903 raft_consensus.cc:2272] T f018fab4f8f24dc18b24bf29b839f828 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.057576 22903 tablet_replica.cc:333] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.058277 22903 raft_consensus.cc:2243] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.059518 22903 raft_consensus.cc:2272] T de710065f7ad4be19742d79b91324d29 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.062382 22903 tablet_replica.cc:333] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.063124 22903 raft_consensus.cc:2243] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.064234 22903 raft_consensus.cc:2272] T 7188da143a8e4c5fb12f21ff47aa63ea P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.066749 22903 tablet_replica.cc:333] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.067356 22903 raft_consensus.cc:2243] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.067821 22903 raft_consensus.cc:2272] T 964ad8a458c2403a9dbdd50be2fd763d P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.070163 22903 tablet_replica.cc:333] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.070703 22903 raft_consensus.cc:2243] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.071621 22903 raft_consensus.cc:2272] T 8a2005abeeca4984960b64be4b5d532e P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.073911 22903 tablet_replica.cc:333] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.074446 22903 raft_consensus.cc:2243] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.074909 22903 raft_consensus.cc:2272] T 702d6fce6e6745b4952d035e0ceccd49 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.077291 22903 tablet_replica.cc:333] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.078047 22903 raft_consensus.cc:2243] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.078544 22903 raft_consensus.cc:2272] T ac4ef802a3d14adfb4774a8841d34164 P ee8bcffe388e4e0796bc17d15b7adcde [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.080967 22903 tablet_replica.cc:333] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde: stopping tablet replica
I20260709 12:21:17.081470 22903 raft_consensus.cc:2243] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.081933 22903 raft_consensus.cc:2272] T 4314d275b47a469bafd749deec419c28 P ee8bcffe388e4e0796bc17d15b7adcde [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:17.127243 31317 consensus_peers.cc:597] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.166040 22903 tablet_server.cc:196] TabletServer@127.22.93.195:0 shutdown complete.
W20260709 12:21:17.212971 31317 consensus_peers.cc:597] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:17.218731 31317 consensus_peers.cc:597] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:17.262544 31317 consensus_peers.cc:597] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.266155 22903 tablet_server.cc:179] TabletServer@127.22.93.196:0 shutting down...
W20260709 12:21:17.281198 31317 consensus_peers.cc:597] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 -> Peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Couldn't send request to peer ee8bcffe388e4e0796bc17d15b7adcde. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.195:37949: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:17.287734 32250 raft_consensus.cc:493] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:17.289058 32250 raft_consensus.cc:515] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:17.292120 32250 leader_election.cc:290] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
W20260709 12:21:17.299219 31317 leader_election.cc:336] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37949: connect: Connection refused (error 111)
W20260709 12:21:17.301117 31317 leader_election.cc:336] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:17.301600 31317 leader_election.cc:304] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:17.302441 32250 raft_consensus.cc:2749] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:17.329381 32250 raft_consensus.cc:493] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:17.330078 32250 raft_consensus.cc:515] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:17.332796 32250 leader_election.cc:290] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
W20260709 12:21:17.337713 31317 leader_election.cc:336] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
W20260709 12:21:17.338534 31317 leader_election.cc:336] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Network error: Client connection negotiation failed: client connection to 127.22.93.194:42481: connect: Connection refused (error 111)
I20260709 12:21:17.339035 31317 leader_election.cc:304] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:17.339920 32250 raft_consensus.cc:2749] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:17.341369 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:17.342471 22903 tablet_replica.cc:333] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.343552 22903 raft_consensus.cc:2243] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.344147 22903 raft_consensus.cc:2272] T d181ab9ed7ab4e54ac19b4cdad63a90a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.346776 22903 tablet_replica.cc:333] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.347584 22903 raft_consensus.cc:2243] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.348109 22903 raft_consensus.cc:2272] T 13829eeeec8d43728320a1237d93b27e P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.351119 22903 tablet_replica.cc:333] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.351987 22903 raft_consensus.cc:2243] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.352593 22903 raft_consensus.cc:2272] T 23ff1489a95143b79e3d3c4aa6dc7523 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.355275 22903 tablet_replica.cc:333] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.356015 22903 raft_consensus.cc:2243] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.357024 22903 raft_consensus.cc:2272] T 28ff0dec68504c32b1b5df23cd8f25a0 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.358235 32149 raft_consensus.cc:493] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:17.358733 32149 raft_consensus.cc:515] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } } peers { permanent_uuid: "1d5ebd798965493785b198d6e8492c23" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 42481 } }
I20260709 12:21:17.360159 22903 tablet_replica.cc:333] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.360737 32149 leader_election.cc:290] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023), 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481)
I20260709 12:21:17.361372 22903 raft_consensus.cc:2243] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.362079 22903 raft_consensus.cc:2272] T ff93479d44174057843c235314d57461 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.365492 22903 tablet_replica.cc:333] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
W20260709 12:21:17.366154 31317 leader_election.cc:336] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:17.366380 22903 raft_consensus.cc:2243] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:21:17.366971 31317 leader_election.cc:336] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1d5ebd798965493785b198d6e8492c23 (127.22.93.194:42481): Network error: Client connection negotiation failed: client connection to 127.22.93.194:42481: connect: Connection refused (error 111)
I20260709 12:21:17.367163 22903 raft_consensus.cc:2272] T 2929cced2b1543e0aa12f490cb2abbbd P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.367460 31317 leader_election.cc:304] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: 1d5ebd798965493785b198d6e8492c23, e3b87862f0eb448db7779e995eb84f64
I20260709 12:21:17.368201 32149 raft_consensus.cc:2749] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:17.370378 22903 tablet_replica.cc:333] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.371253 22903 raft_consensus.cc:2243] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.371762 22903 raft_consensus.cc:2272] T 8dda8bf3c6e5443fa3dcaf9b4dbf8417 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.374300 22903 tablet_replica.cc:333] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.374945 22903 raft_consensus.cc:2243] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.375464 22903 raft_consensus.cc:2272] T f83751ae3dbd4d78add4ddcbf77254a4 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.377794 22903 tablet_replica.cc:333] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.378418 22903 raft_consensus.cc:2243] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.378850 22903 raft_consensus.cc:2272] T 8a2005abeeca4984960b64be4b5d532e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.381188 22903 tablet_replica.cc:333] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.381798 22903 raft_consensus.cc:2243] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.382223 22903 raft_consensus.cc:2272] T 1c590f5280eb4ea99fbfbe28c2630d55 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.382876 32149 raft_consensus.cc:493] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3b87862f0eb448db7779e995eb84f64)
I20260709 12:21:17.383474 32149 raft_consensus.cc:515] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ee8bcffe388e4e0796bc17d15b7adcde" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 37949 } } peers { permanent_uuid: "9800423c0012421d9ce299e8c180ac96" member_type: VOTER last_known_addr { host: "127.22.93.196" port: 36383 } } peers { permanent_uuid: "e3b87862f0eb448db7779e995eb84f64" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 36023 } }
I20260709 12:21:17.385371 22903 tablet_replica.cc:333] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.385939 32149 leader_election.cc:290] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949), e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023)
I20260709 12:21:17.386508 22903 raft_consensus.cc:2243] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.387809 22903 raft_consensus.cc:2272] T 7ddcff546cb345c98b79aff0049e96f1 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:17.390030 31317 leader_election.cc:336] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer ee8bcffe388e4e0796bc17d15b7adcde (127.22.93.195:37949): Network error: Client connection negotiation failed: client connection to 127.22.93.195:37949: connect: Connection refused (error 111)
W20260709 12:21:17.390798 31317 leader_election.cc:336] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer e3b87862f0eb448db7779e995eb84f64 (127.22.93.193:36023): Network error: Client connection negotiation failed: client connection to 127.22.93.193:36023: connect: Connection refused (error 111)
I20260709 12:21:17.390830 22903 tablet_replica.cc:333] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.391242 31317 leader_election.cc:304] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9800423c0012421d9ce299e8c180ac96; no voters: e3b87862f0eb448db7779e995eb84f64, ee8bcffe388e4e0796bc17d15b7adcde
I20260709 12:21:17.392081 32149 raft_consensus.cc:2749] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:21:17.392076 22903 raft_consensus.cc:2243] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.392938 22903 raft_consensus.cc:2272] T 76f9f2ccc422431581e845d7df278107 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.395609 22903 tablet_replica.cc:333] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.396361 22903 raft_consensus.cc:2243] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.396924 22903 raft_consensus.cc:2272] T 256c4c6b88d240658c96e3d2b37b1d51 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.399809 22903 tablet_replica.cc:333] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.400629 22903 raft_consensus.cc:2243] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.401278 22903 raft_consensus.cc:2272] T c8ec895126a540df9c9474a9dd420991 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.404271 22903 tablet_replica.cc:333] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.404932 22903 raft_consensus.cc:2243] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.405364 22903 raft_consensus.cc:2272] T ef66344d4a1a4900832a1486db956576 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.407702 22903 tablet_replica.cc:333] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.408339 22903 raft_consensus.cc:2243] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.409325 22903 raft_consensus.cc:2272] T c66c15cae85a4a45bae00ea0560859d7 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.412096 22903 tablet_replica.cc:333] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.412802 22903 raft_consensus.cc:2243] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.413501 22903 raft_consensus.cc:2272] T b70e3a964ca446edb98d1ad6c8984716 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.416301 22903 tablet_replica.cc:333] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.416996 22903 raft_consensus.cc:2243] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.418023 22903 raft_consensus.cc:2272] T fab0948c0d0a4bf4a2d9a762fa77f379 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.420712 22903 tablet_replica.cc:333] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.421461 22903 raft_consensus.cc:2243] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.422448 22903 raft_consensus.cc:2272] T 77cb701e3ab34e60b09c279e2bcfe26a P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.425006 22903 tablet_replica.cc:333] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.425740 22903 raft_consensus.cc:2243] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.426715 22903 raft_consensus.cc:2272] T 964ad8a458c2403a9dbdd50be2fd763d P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.429149 22903 tablet_replica.cc:333] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.429863 22903 raft_consensus.cc:2243] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.430366 22903 raft_consensus.cc:2272] T 1e8a7095a2544957b3d93c160aebdad6 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.433156 22903 tablet_replica.cc:333] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.433908 22903 raft_consensus.cc:2243] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.434449 22903 raft_consensus.cc:2272] T a4622853e390489ebd01e9f3ace8f0fc P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.436913 22903 tablet_replica.cc:333] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.437736 22903 raft_consensus.cc:2243] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.438390 22903 raft_consensus.cc:2272] T 302d0756616a44fbad812870fbd6d499 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.441143 22903 tablet_replica.cc:333] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.441859 22903 raft_consensus.cc:2243] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.442896 22903 raft_consensus.cc:2272] T a8c6d0d195714cae8e83d74d668f13fe P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.446022 22903 tablet_replica.cc:333] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.446733 22903 raft_consensus.cc:2243] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.447244 22903 raft_consensus.cc:2272] T ce58073b26274815b7e9542e152bd07c P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.449676 22903 tablet_replica.cc:333] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.450356 22903 raft_consensus.cc:2243] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.450857 22903 raft_consensus.cc:2272] T 25d1fa74ba5e44c194b27640def09ef5 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.453284 22903 tablet_replica.cc:333] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.453963 22903 raft_consensus.cc:2243] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.454946 22903 raft_consensus.cc:2272] T 0da571cacd7e4c87b7615361589e46db P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.457595 22903 tablet_replica.cc:333] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.458314 22903 raft_consensus.cc:2243] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.458799 22903 raft_consensus.cc:2272] T 437143ed6af647b0b4b7a3f240e11346 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.461192 22903 tablet_replica.cc:333] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.461894 22903 raft_consensus.cc:2243] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.462910 22903 raft_consensus.cc:2272] T 8d0f6d602e394c848d29df14804fa855 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.465665 22903 tablet_replica.cc:333] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.466365 22903 raft_consensus.cc:2243] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.466862 22903 raft_consensus.cc:2272] T 4c71bd7869d948b4bc36991abb4b71a5 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.469571 22903 tablet_replica.cc:333] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.470542 22903 raft_consensus.cc:2243] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.471912 22903 raft_consensus.cc:2272] T 4314d275b47a469bafd749deec419c28 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.475510 22903 tablet_replica.cc:333] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.476603 22903 raft_consensus.cc:2243] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.477469 22903 raft_consensus.cc:2272] T 26a6299c5cfa4197a694ae06c6e07e4f P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.480657 22903 tablet_replica.cc:333] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.481388 22903 raft_consensus.cc:2243] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.481923 22903 raft_consensus.cc:2272] T ead9af52f3cb440a823ab640a53caa2d P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.484413 22903 tablet_replica.cc:333] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.485074 22903 raft_consensus.cc:2243] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.486017 22903 raft_consensus.cc:2272] T 5b428d9f5e1c4775a6d6ccca23e9f2fa P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.488521 22903 tablet_replica.cc:333] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.489145 22903 raft_consensus.cc:2243] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.489648 22903 raft_consensus.cc:2272] T 3f45cc601c2c422b933c4fd00560db82 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.492089 22903 tablet_replica.cc:333] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.492712 22903 raft_consensus.cc:2243] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.493186 22903 raft_consensus.cc:2272] T 2de9d20cb0f14f9e95f678bcf8c59988 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.495554 22903 tablet_replica.cc:333] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.496212 22903 raft_consensus.cc:2243] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.496698 22903 raft_consensus.cc:2272] T 24d785aaedd448a7bc9ddde9d573d467 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.499218 22903 tablet_replica.cc:333] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.499807 22903 raft_consensus.cc:2243] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.500778 22903 raft_consensus.cc:2272] T 41c876d87436493a8aaeb3be151cbf9e P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.503083 22903 tablet_replica.cc:333] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.503685 22903 raft_consensus.cc:2243] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.504645 22903 raft_consensus.cc:2272] T 399de19748dd4407986684b816a07da9 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.507077 22903 tablet_replica.cc:333] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.507670 22903 raft_consensus.cc:2243] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.508157 22903 raft_consensus.cc:2272] T 9f29500f45e14bf3b37916af7a3f4982 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.510362 22903 tablet_replica.cc:333] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.510931 22903 raft_consensus.cc:2243] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.511436 22903 raft_consensus.cc:2272] T 13d247b7758c49c08c20a65227f42b52 P 9800423c0012421d9ce299e8c180ac96 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.513636 22903 tablet_replica.cc:333] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.514191 22903 raft_consensus.cc:2243] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.515199 22903 raft_consensus.cc:2272] T 702d6fce6e6745b4952d035e0ceccd49 P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.517339 22903 tablet_replica.cc:333] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.517899 22903 raft_consensus.cc:2243] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.518362 22903 raft_consensus.cc:2272] T ac4ef802a3d14adfb4774a8841d34164 P 9800423c0012421d9ce299e8c180ac96 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.520481 22903 tablet_replica.cc:333] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96: stopping tablet replica
I20260709 12:21:17.521001 22903 raft_consensus.cc:2243] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:17.521463 22903 raft_consensus.cc:2272] T 4b8ec802808248f1bb901b81b304d5ef P 9800423c0012421d9ce299e8c180ac96 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.604267 22903 tablet_server.cc:196] TabletServer@127.22.93.196:0 shutdown complete.
I20260709 12:21:17.712805 22903 master.cc:562] Master@127.22.93.254:46353 shutting down...
I20260709 12:21:17.808070 22903 raft_consensus.cc:2243] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:17.809330 22903 raft_consensus.cc:2272] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:17.809738 22903 tablet_replica.cc:333] T 00000000000000000000000000000000 P da7e2688278847a08231f56f537581ee: stopping tablet replica
I20260709 12:21:17.866268 22903 master.cc:584] Master@127.22.93.254:46353 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (32414 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:21:17.992432 22903 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.93.254:41695
I20260709 12:21:17.993921 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:18.000751 32259 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:18.000785 32260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:18.001559 32262 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:18.002939 22903 server_base.cc:1061] running on GCE node
I20260709 12:21:18.004750 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:18.004941 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:18.005143 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599678005119 us; error 0 us; skew 500 ppm
I20260709 12:21:18.005798 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:18.008942 22903 webserver.cc:533] Webserver started at http://127.22.93.254:45877/ using document root <none> and password file <none>
I20260709 12:21:18.009512 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:18.009727 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:18.010041 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:18.011521 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/master-0-root/instance:
uuid: "fbc66332723e402091f6885c4fd7a1eb"
format_stamp: "Formatted at 2026-07-09 12:21:18 on dist-test-slave-k289"
I20260709 12:21:18.017233 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:21:18.021421 32268 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.022298 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:21:18.022651 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/master-0-root
uuid: "fbc66332723e402091f6885c4fd7a1eb"
format_stamp: "Formatted at 2026-07-09 12:21:18 on dist-test-slave-k289"
I20260709 12:21:18.023082 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:18.040416 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:18.042038 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:18.097940 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.254:41695
I20260709 12:21:18.098084 32319 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.254:41695 every 8 connection(s)
I20260709 12:21:18.102698 32320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.117878 32320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb: Bootstrap starting.
I20260709 12:21:18.126260 32320 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:18.133874 32320 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb: No bootstrap required, opened a new log
I20260709 12:21:18.136860 32320 raft_consensus.cc:359] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc66332723e402091f6885c4fd7a1eb" member_type: VOTER }
I20260709 12:21:18.137310 32320 raft_consensus.cc:385] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:18.137590 32320 raft_consensus.cc:740] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fbc66332723e402091f6885c4fd7a1eb, State: Initialized, Role: FOLLOWER
I20260709 12:21:18.138358 32320 consensus_queue.cc:260] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc66332723e402091f6885c4fd7a1eb" member_type: VOTER }
I20260709 12:21:18.138878 32320 raft_consensus.cc:399] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:18.139132 32320 raft_consensus.cc:493] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:18.139454 32320 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:18.145723 32320 raft_consensus.cc:515] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc66332723e402091f6885c4fd7a1eb" member_type: VOTER }
I20260709 12:21:18.146430 32320 leader_election.cc:304] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fbc66332723e402091f6885c4fd7a1eb; no voters: 
I20260709 12:21:18.147938 32320 leader_election.cc:290] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:18.148535 32323 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:18.150383 32323 raft_consensus.cc:697] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 1 LEADER]: Becoming Leader. State: Replica: fbc66332723e402091f6885c4fd7a1eb, State: Running, Role: LEADER
I20260709 12:21:18.151505 32323 consensus_queue.cc:237] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc66332723e402091f6885c4fd7a1eb" member_type: VOTER }
I20260709 12:21:18.152067 32320 sys_catalog.cc:565] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:18.157810 32325 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fbc66332723e402091f6885c4fd7a1eb. Latest consensus state: current_term: 1 leader_uuid: "fbc66332723e402091f6885c4fd7a1eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc66332723e402091f6885c4fd7a1eb" member_type: VOTER } }
I20260709 12:21:18.157989 32324 sys_catalog.cc:455] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fbc66332723e402091f6885c4fd7a1eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fbc66332723e402091f6885c4fd7a1eb" member_type: VOTER } }
I20260709 12:21:18.158878 32325 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:18.159394 32324 sys_catalog.cc:458] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:18.164341 32331 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:18.171365 32331 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:18.174924 22903 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:18.182874 32331 catalog_manager.cc:1383] Generated new cluster ID: 12c7852531634564b8fbe4da4d8fd6dc
I20260709 12:21:18.183302 32331 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:18.206730 32331 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:18.208510 32331 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:18.229563 32331 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb: Generated new TSK 0
I20260709 12:21:18.230542 32331 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:18.242604 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:18.251953 32341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:18.253772 32342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:18.261776 22903 server_base.cc:1061] running on GCE node
W20260709 12:21:18.261813 32344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:18.263602 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:18.263880 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:18.264091 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599678264058 us; error 0 us; skew 500 ppm
I20260709 12:21:18.264758 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:18.267956 22903 webserver.cc:533] Webserver started at http://127.22.93.193:43789/ using document root <none> and password file <none>
I20260709 12:21:18.268540 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:18.268795 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:18.269243 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:18.270792 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-0-root/instance:
uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
format_stamp: "Formatted at 2026-07-09 12:21:18 on dist-test-slave-k289"
I20260709 12:21:18.277416 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:21:18.281641 32349 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.282514 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 12:21:18.282867 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
format_stamp: "Formatted at 2026-07-09 12:21:18 on dist-test-slave-k289"
I20260709 12:21:18.283314 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:18.301707 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:18.303293 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:18.305603 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:18.308673 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:18.309062 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.309494 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:18.309784 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.369877 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:39757
I20260709 12:21:18.370206 32412 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:39757 every 8 connection(s)
I20260709 12:21:18.377885 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:18.387604 32417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:18.391752 32418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:18.398334 32420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:18.400657 22903 server_base.cc:1061] running on GCE node
I20260709 12:21:18.400697 32413 heartbeater.cc:344] Connected to a master server at 127.22.93.254:41695
I20260709 12:21:18.401566 32413 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:18.402594 32413 heartbeater.cc:507] Master 127.22.93.254:41695 requested a full tablet report, sending...
I20260709 12:21:18.402891 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:18.403268 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:18.403465 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599678403446 us; error 0 us; skew 500 ppm
I20260709 12:21:18.404191 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:18.405454 32285 ts_manager.cc:194] Registered new tserver with Master: 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757)
I20260709 12:21:18.407393 22903 webserver.cc:533] Webserver started at http://127.22.93.194:43259/ using document root <none> and password file <none>
I20260709 12:21:18.408062 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:18.408349 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:18.408419 32285 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34626
I20260709 12:21:18.408646 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:18.410353 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-1-root/instance:
uuid: "60e13461b83145e4b52d4b0a53081e9e"
format_stamp: "Formatted at 2026-07-09 12:21:18 on dist-test-slave-k289"
I20260709 12:21:18.416646 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:21:18.422492 32425 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.423427 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:21:18.423779 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-1-root
uuid: "60e13461b83145e4b52d4b0a53081e9e"
format_stamp: "Formatted at 2026-07-09 12:21:18 on dist-test-slave-k289"
I20260709 12:21:18.424146 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:18.438932 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:18.440623 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:18.442597 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:18.445631 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:18.445881 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.446151 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:18.446338 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.504103 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.194:39265
I20260709 12:21:18.504268 32487 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.194:39265 every 8 connection(s)
I20260709 12:21:18.510294 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:18.520175 32491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:18.521963 32492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:18.526368 22903 server_base.cc:1061] running on GCE node
W20260709 12:21:18.527485 32494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:18.529026 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:21:18.529203 32488 heartbeater.cc:344] Connected to a master server at 127.22.93.254:41695
W20260709 12:21:18.529348 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:18.529734 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599678529708 us; error 0 us; skew 500 ppm
I20260709 12:21:18.529806 32488 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:18.530611 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:18.531306 32488 heartbeater.cc:507] Master 127.22.93.254:41695 requested a full tablet report, sending...
I20260709 12:21:18.535138 22903 webserver.cc:533] Webserver started at http://127.22.93.195:38755/ using document root <none> and password file <none>
I20260709 12:21:18.535283 32285 ts_manager.cc:194] Registered new tserver with Master: 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:18.535944 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:18.536273 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:18.536640 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:18.537483 32285 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34628
I20260709 12:21:18.538424 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-2-root/instance:
uuid: "388d1da26cf142e0a6d3089607aafd4a"
format_stamp: "Formatted at 2026-07-09 12:21:18 on dist-test-slave-k289"
I20260709 12:21:18.544241 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:21:18.549438 32500 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.550331 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:21:18.550701 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-2-root
uuid: "388d1da26cf142e0a6d3089607aafd4a"
format_stamp: "Formatted at 2026-07-09 12:21:18 on dist-test-slave-k289"
I20260709 12:21:18.551066 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:18.573585 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:18.575502 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:18.577811 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:18.580708 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:18.581045 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.581516 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:18.581919 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:18.704926 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.195:45119
I20260709 12:21:18.705060 32563 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.195:45119 every 8 connection(s)
I20260709 12:21:18.731184 32564 heartbeater.cc:344] Connected to a master server at 127.22.93.254:41695
I20260709 12:21:18.731703 32564 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:18.732928 32564 heartbeater.cc:507] Master 127.22.93.254:41695 requested a full tablet report, sending...
I20260709 12:21:18.735883 32285 ts_manager.cc:194] Registered new tserver with Master: 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:18.735991 22903 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.025916903s
I20260709 12:21:18.740136 32285 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34642
I20260709 12:21:18.774477 32285 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34658:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:18.778283 32285 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:18.875582 32528 tablet_service.cc:1511] Processing CreateTablet for tablet 366d1b471f1346fb9862751c2b8cd79a (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:21:18.878847 32526 tablet_service.cc:1511] Processing CreateTablet for tablet 92ad0effbe5d4284aba98d69c34aa176 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:21:18.880088 32525 tablet_service.cc:1511] Processing CreateTablet for tablet 80e21b5512fc4213aca00fa0549853df (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:21:18.881372 32526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ad0effbe5d4284aba98d69c34aa176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.881480 32378 tablet_service.cc:1511] Processing CreateTablet for tablet 366d1b471f1346fb9862751c2b8cd79a (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:21:18.882676 32525 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e21b5512fc4213aca00fa0549853df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.878535 32527 tablet_service.cc:1511] Processing CreateTablet for tablet 4c884b79d0314d138e135b0af3751bca (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:21:18.883920 32528 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d1b471f1346fb9862751c2b8cd79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.884967 32527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c884b79d0314d138e135b0af3751bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.885004 32378 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d1b471f1346fb9862751c2b8cd79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.887602 32377 tablet_service.cc:1511] Processing CreateTablet for tablet 4c884b79d0314d138e135b0af3751bca (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:21:18.896868 32377 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c884b79d0314d138e135b0af3751bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.897962 32374 tablet_service.cc:1511] Processing CreateTablet for tablet bc8e2e487c564d0aa2ba283574116dba (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:21:18.890931 32376 tablet_service.cc:1511] Processing CreateTablet for tablet 92ad0effbe5d4284aba98d69c34aa176 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:21:18.894207 32375 tablet_service.cc:1511] Processing CreateTablet for tablet 80e21b5512fc4213aca00fa0549853df (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:21:18.899783 32374 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8e2e487c564d0aa2ba283574116dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.901079 32376 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ad0effbe5d4284aba98d69c34aa176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.904356 32375 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e21b5512fc4213aca00fa0549853df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.907552 32524 tablet_service.cc:1511] Processing CreateTablet for tablet bc8e2e487c564d0aa2ba283574116dba (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:21:18.908062 32523 tablet_service.cc:1511] Processing CreateTablet for tablet acc68aa693c944b29921b861d6f2f595 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:21:18.909461 32524 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8e2e487c564d0aa2ba283574116dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.910779 32523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc68aa693c944b29921b861d6f2f595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.911888 32522 tablet_service.cc:1511] Processing CreateTablet for tablet 230e3fd95b5a4068b2b1acd3af55115a (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:21:18.913612 32522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230e3fd95b5a4068b2b1acd3af55115a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.915722 32373 tablet_service.cc:1511] Processing CreateTablet for tablet acc68aa693c944b29921b861d6f2f595 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:21:18.917622 32373 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc68aa693c944b29921b861d6f2f595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.931528 32372 tablet_service.cc:1511] Processing CreateTablet for tablet 230e3fd95b5a4068b2b1acd3af55115a (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:21:18.933355 32372 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230e3fd95b5a4068b2b1acd3af55115a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.937898 32521 tablet_service.cc:1511] Processing CreateTablet for tablet f4125e9ad07c4073b8daa441a155782d (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:21:18.938405 32371 tablet_service.cc:1511] Processing CreateTablet for tablet f4125e9ad07c4073b8daa441a155782d (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:21:18.939831 32521 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4125e9ad07c4073b8daa441a155782d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.940065 32371 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4125e9ad07c4073b8daa441a155782d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:18.984009 32370 tablet_service.cc:1511] Processing CreateTablet for tablet f32623c47210405286dba09464043595 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:21:18.985972 32370 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32623c47210405286dba09464043595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.004667 32453 tablet_service.cc:1511] Processing CreateTablet for tablet 366d1b471f1346fb9862751c2b8cd79a (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:21:19.006734 32453 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 366d1b471f1346fb9862751c2b8cd79a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.008477 32452 tablet_service.cc:1511] Processing CreateTablet for tablet 4c884b79d0314d138e135b0af3751bca (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:21:19.012368 32450 tablet_service.cc:1511] Processing CreateTablet for tablet 80e21b5512fc4213aca00fa0549853df (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:21:19.017515 32448 tablet_service.cc:1511] Processing CreateTablet for tablet acc68aa693c944b29921b861d6f2f595 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:21:19.010624 32451 tablet_service.cc:1511] Processing CreateTablet for tablet 92ad0effbe5d4284aba98d69c34aa176 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:21:19.019179 32447 tablet_service.cc:1511] Processing CreateTablet for tablet 230e3fd95b5a4068b2b1acd3af55115a (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:21:19.014475 32449 tablet_service.cc:1511] Processing CreateTablet for tablet bc8e2e487c564d0aa2ba283574116dba (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:21:19.022830 32446 tablet_service.cc:1511] Processing CreateTablet for tablet f4125e9ad07c4073b8daa441a155782d (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:21:19.023382 32450 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80e21b5512fc4213aca00fa0549853df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.024857 32449 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc8e2e487c564d0aa2ba283574116dba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.027910 32446 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4125e9ad07c4073b8daa441a155782d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.029732 32369 tablet_service.cc:1511] Processing CreateTablet for tablet c13e2225cb4f40c980e1c8050fc9e951 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:21:19.034047 32445 tablet_service.cc:1511] Processing CreateTablet for tablet f32623c47210405286dba09464043595 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:21:19.031430 32451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92ad0effbe5d4284aba98d69c34aa176. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.036319 32448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acc68aa693c944b29921b861d6f2f595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.037117 32445 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32623c47210405286dba09464043595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.036816 32522 tablet_service.cc:1511] Processing CreateTablet for tablet f32623c47210405286dba09464043595 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:21:19.037875 32447 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 230e3fd95b5a4068b2b1acd3af55115a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.031432 32369 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13e2225cb4f40c980e1c8050fc9e951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.044032 32522 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f32623c47210405286dba09464043595. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.068307 32452 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c884b79d0314d138e135b0af3751bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.069280 32583 tablet_bootstrap.cc:492] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:19.069453 32582 tablet_bootstrap.cc:492] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.091465 32444 tablet_service.cc:1511] Processing CreateTablet for tablet c13e2225cb4f40c980e1c8050fc9e951 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:21:19.093415 32444 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13e2225cb4f40c980e1c8050fc9e951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.104532 32523 tablet_service.cc:1511] Processing CreateTablet for tablet c13e2225cb4f40c980e1c8050fc9e951 (DEFAULT_TABLE table=test-workload [id=503f9e9689634f69aa69ad3512e4fbe2]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:21:19.106225 32523 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c13e2225cb4f40c980e1c8050fc9e951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:19.129436 32582 tablet_bootstrap.cc:654] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.150540 32584 tablet_bootstrap.cc:492] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.154752 32582 tablet_bootstrap.cc:492] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.167985 32582 ts_tablet_manager.cc:1403] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.007s
I20260709 12:21:19.168155 32584 tablet_bootstrap.cc:654] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:19.168130 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:19.172104 32582 raft_consensus.cc:359] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:19.173236 32582 raft_consensus.cc:385] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.173610 32582 raft_consensus.cc:740] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.174367 32583 tablet_bootstrap.cc:654] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.174674 32582 consensus_queue.cc:260] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:19.188339 32583 tablet_bootstrap.cc:492] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:19.189061 32583 ts_tablet_manager.cc:1403] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.120s	user 0.010s	sys 0.007s
I20260709 12:21:19.189687 32564 heartbeater.cc:499] Master 127.22.93.254:41695 was elected leader, sending a full tablet report...
I20260709 12:21:19.190241 32582 ts_tablet_manager.cc:1434] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.008s
I20260709 12:21:19.190299 32584 tablet_bootstrap.cc:492] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.191066 32584 ts_tablet_manager.cc:1403] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.010s
I20260709 12:21:19.191695 32582 tablet_bootstrap.cc:492] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.195075 32584 raft_consensus.cc:359] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.196058 32584 raft_consensus.cc:385] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.196401 32584 raft_consensus.cc:740] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.197319 32584 consensus_queue.cc:260] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.199062 32582 tablet_bootstrap.cc:654] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.199321 32583 raft_consensus.cc:359] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:19.200325 32583 raft_consensus.cc:385] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.200724 32583 raft_consensus.cc:740] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.201936 32583 consensus_queue.cc:260] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:19.210148 32583 ts_tablet_manager.cc:1434] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.004s
W20260709 12:21:19.211556 32565 tablet.cc:2406] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:21:19.211727 32413 heartbeater.cc:499] Master 127.22.93.254:41695 was elected leader, sending a full tablet report...
I20260709 12:21:19.234019 32584 ts_tablet_manager.cc:1434] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.030s
I20260709 12:21:19.233964 32488 heartbeater.cc:499] Master 127.22.93.254:41695 was elected leader, sending a full tablet report...
I20260709 12:21:19.235807 32584 tablet_bootstrap.cc:492] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.244266 32584 tablet_bootstrap.cc:654] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.251502 32583 tablet_bootstrap.cc:492] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:19.255793 32584 tablet_bootstrap.cc:492] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.256652 32584 ts_tablet_manager.cc:1403] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 12:21:19.257745 32582 tablet_bootstrap.cc:492] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.258414 32582 ts_tablet_manager.cc:1403] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.067s	user 0.023s	sys 0.037s
I20260709 12:21:19.260205 32584 raft_consensus.cc:359] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.261135 32584 raft_consensus.cc:385] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.261552 32584 raft_consensus.cc:740] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.262450 32584 consensus_queue.cc:260] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.264220 32582 raft_consensus.cc:359] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.265074 32582 raft_consensus.cc:385] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.265384 32582 raft_consensus.cc:740] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.265564 32584 ts_tablet_manager.cc:1434] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:19.266274 32582 consensus_queue.cc:260] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.266943 32584 tablet_bootstrap.cc:492] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.274932 32582 ts_tablet_manager.cc:1434] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.002s
I20260709 12:21:19.275373 32583 tablet_bootstrap.cc:654] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.276157 32582 tablet_bootstrap.cc:492] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.278177 32587 raft_consensus.cc:493] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.279016 32584 tablet_bootstrap.cc:654] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.278849 32587 raft_consensus.cc:515] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:19.286857 32582 tablet_bootstrap.cc:654] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.287456 32587 leader_election.cc:290] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.297623 32583 tablet_bootstrap.cc:492] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:19.298398 32583 ts_tablet_manager.cc:1403] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.013s
I20260709 12:21:19.299208 32584 tablet_bootstrap.cc:492] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.299829 32584 ts_tablet_manager.cc:1403] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.033s	user 0.015s	sys 0.013s
I20260709 12:21:19.302510 32583 raft_consensus.cc:359] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.304628 32584 raft_consensus.cc:359] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.305491 32584 raft_consensus.cc:385] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.305841 32584 raft_consensus.cc:740] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.306385 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.306844 32584 consensus_queue.cc:260] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.307588 32388 raft_consensus.cc:2468] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 0.
I20260709 12:21:19.309739 32584 ts_tablet_manager.cc:1434] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.005s
I20260709 12:21:19.310245 32504 leader_election.cc:304] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:19.310842 32584 tablet_bootstrap.cc:492] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.311633 32583 raft_consensus.cc:385] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.312215 32583 raft_consensus.cc:740] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.313131 32583 consensus_queue.cc:260] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.313696 32587 raft_consensus.cc:493] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.314283 32587 raft_consensus.cc:515] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.315830 32583 ts_tablet_manager.cc:1434] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.006s
I20260709 12:21:19.316771 32587 leader_election.cc:290] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.317116 32583 tablet_bootstrap.cc:492] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:19.320519 32584 tablet_bootstrap.cc:654] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.322641 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.324644 32587 raft_consensus.cc:2804] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.325106 32587 raft_consensus.cc:493] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.325641 32587 raft_consensus.cc:3060] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.326792 32582 tablet_bootstrap.cc:492] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.327638 32582 ts_tablet_manager.cc:1403] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.013s
I20260709 12:21:19.329843 32583 tablet_bootstrap.cc:654] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.331403 32582 raft_consensus.cc:359] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.332233 32582 raft_consensus.cc:385] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.332571 32582 raft_consensus.cc:740] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.333068 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:19.333395 32582 consensus_queue.cc:260] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.336097 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:19.337021 32584 tablet_bootstrap.cc:492] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.337769 32584 ts_tablet_manager.cc:1403] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.002s
W20260709 12:21:19.338233 32504 leader_election.cc:343] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:19.339488 32504 leader_election.cc:343] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:21:19.340787 32504 leader_election.cc:343] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:19.341313 32504 leader_election.cc:304] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a; no voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:19.342319 32584 raft_consensus.cc:359] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.343302 32584 raft_consensus.cc:385] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.343708 32584 raft_consensus.cc:740] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.345671 32584 consensus_queue.cc:260] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.349771 32583 tablet_bootstrap.cc:492] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:19.350582 32583 ts_tablet_manager.cc:1403] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.013s
I20260709 12:21:19.352752 32584 ts_tablet_manager.cc:1434] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.007s
I20260709 12:21:19.354693 32584 tablet_bootstrap.cc:492] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.354959 32587 raft_consensus.cc:515] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:19.358332 32587 leader_election.cc:290] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.359514 32587 raft_consensus.cc:2749] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:19.362426 32583 raft_consensus.cc:359] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.363201 32582 ts_tablet_manager.cc:1434] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.035s	user 0.016s	sys 0.017s
I20260709 12:21:19.363399 32583 raft_consensus.cc:385] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.364046 32583 raft_consensus.cc:740] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.364959 32582 tablet_bootstrap.cc:492] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.365168 32583 consensus_queue.cc:260] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.366026 32584 tablet_bootstrap.cc:654] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.371903 32583 ts_tablet_manager.cc:1434] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.021s	user 0.010s	sys 0.002s
I20260709 12:21:19.373193 32583 tablet_bootstrap.cc:492] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:19.381445 32583 tablet_bootstrap.cc:654] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.404601 32582 tablet_bootstrap.cc:654] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:19.408497 32504 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:39265, user_credentials={real_user=slave}} blocked reactor thread for 67746us
I20260709 12:21:19.409548 32583 tablet_bootstrap.cc:492] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:19.410223 32583 ts_tablet_manager.cc:1403] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.019s
I20260709 12:21:19.410717 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:19.411720 32388 raft_consensus.cc:3060] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.412093 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:19.414156 32583 raft_consensus.cc:359] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.415189 32583 raft_consensus.cc:385] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.415493 32583 raft_consensus.cc:740] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.416546 32583 consensus_queue.cc:260] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.419533 32583 ts_tablet_manager.cc:1434] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.001s
I20260709 12:21:19.419909 32582 tablet_bootstrap.cc:492] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.420612 32582 ts_tablet_manager.cc:1403] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.056s	user 0.013s	sys 0.011s
I20260709 12:21:19.420717 32583 tablet_bootstrap.cc:492] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:19.424546 32582 raft_consensus.cc:359] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.425608 32582 raft_consensus.cc:385] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:19.425312 32504 leader_election.cc:343] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:19.426226 32582 raft_consensus.cc:740] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.427357 32582 consensus_queue.cc:260] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.429750 32583 tablet_bootstrap.cc:654] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.410650 32584 tablet_bootstrap.cc:492] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.432415 32584 ts_tablet_manager.cc:1403] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.078s	user 0.032s	sys 0.024s
I20260709 12:21:19.430621 32582 ts_tablet_manager.cc:1434] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 12:21:19.436085 32582 tablet_bootstrap.cc:492] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.436512 32388 raft_consensus.cc:2468] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 1.
I20260709 12:21:19.436204 32584 raft_consensus.cc:359] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.437059 32584 raft_consensus.cc:385] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.437510 32584 raft_consensus.cc:740] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.437776 32504 leader_election.cc:304] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:19.438386 32584 consensus_queue.cc:260] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.439095 32601 raft_consensus.cc:2804] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:19.439487 32583 tablet_bootstrap.cc:492] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:19.440071 32583 ts_tablet_manager.cc:1403] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 12:21:19.441164 32584 ts_tablet_manager.cc:1434] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:19.442504 32584 tablet_bootstrap.cc:492] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.443511 32583 raft_consensus.cc:359] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.444039 32601 raft_consensus.cc:697] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:19.444365 32583 raft_consensus.cc:385] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.444773 32583 raft_consensus.cc:740] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.448910 32601 consensus_queue.cc:237] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:19.450171 32582 tablet_bootstrap.cc:654] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.448922 32583 consensus_queue.cc:260] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.458516 32583 ts_tablet_manager.cc:1434] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.004s
I20260709 12:21:19.460179 32583 tablet_bootstrap.cc:492] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:19.463879 32582 tablet_bootstrap.cc:492] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.464692 32582 ts_tablet_manager.cc:1403] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.029s	user 0.021s	sys 0.000s
I20260709 12:21:19.465207 32584 tablet_bootstrap.cc:654] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.468624 32582 raft_consensus.cc:359] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.469713 32582 raft_consensus.cc:385] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.470173 32582 raft_consensus.cc:740] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.471511 32582 consensus_queue.cc:260] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.474864 32582 ts_tablet_manager.cc:1434] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:21:19.476218 32582 tablet_bootstrap.cc:492] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.477993 32583 tablet_bootstrap.cc:654] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.486730 32582 tablet_bootstrap.cc:654] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.489001 32285 catalog_manager.cc:5697] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 1 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:19.490568 32584 tablet_bootstrap.cc:492] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.490684 32583 tablet_bootstrap.cc:492] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:19.491422 32583 ts_tablet_manager.cc:1403] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.032s	user 0.007s	sys 0.009s
I20260709 12:21:19.491465 32584 ts_tablet_manager.cc:1403] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.024s
I20260709 12:21:19.496209 32583 raft_consensus.cc:359] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.497326 32583 raft_consensus.cc:385] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.496658 32584 raft_consensus.cc:359] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.497753 32583 raft_consensus.cc:740] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.498083 32584 raft_consensus.cc:385] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.498553 32584 raft_consensus.cc:740] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.498912 32583 consensus_queue.cc:260] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.499949 32584 consensus_queue.cc:260] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.502771 32583 ts_tablet_manager.cc:1434] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:21:19.504182 32583 tablet_bootstrap.cc:492] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:19.506033 32584 ts_tablet_manager.cc:1434] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 12:21:19.507730 32584 tablet_bootstrap.cc:492] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.509357 32589 raft_consensus.cc:493] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.510460 32589 raft_consensus.cc:515] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.514441 32583 tablet_bootstrap.cc:654] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.523710 32584 tablet_bootstrap.cc:654] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.537724 32589 leader_election.cc:290] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.544332 32584 tablet_bootstrap.cc:492] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.545287 32584 ts_tablet_manager.cc:1403] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.015s
I20260709 12:21:19.550585 32584 raft_consensus.cc:359] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.551802 32584 raft_consensus.cc:385] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.552225 32584 raft_consensus.cc:740] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.553048 32591 raft_consensus.cc:493] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.553974 32591 raft_consensus.cc:515] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.554857 32584 consensus_queue.cc:260] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.558715 32584 ts_tablet_manager.cc:1434] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:21:19.560253 32584 tablet_bootstrap.cc:492] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.567610 32591 leader_election.cc:290] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.570650 32584 tablet_bootstrap.cc:654] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.582937 32601 raft_consensus.cc:493] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.583833 32601 raft_consensus.cc:515] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.585882 32584 tablet_bootstrap.cc:492] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.587052 32584 ts_tablet_manager.cc:1403] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.008s
I20260709 12:21:19.588595 32601 leader_election.cc:290] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.592077 32584 raft_consensus.cc:359] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.593272 32584 raft_consensus.cc:385] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.593719 32584 raft_consensus.cc:740] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.594941 32584 consensus_queue.cc:260] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.598438 32584 ts_tablet_manager.cc:1434] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260709 12:21:19.599644 32584 tablet_bootstrap.cc:492] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.599668 32582 tablet_bootstrap.cc:492] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.600375 32582 ts_tablet_manager.cc:1403] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.124s	user 0.018s	sys 0.011s
I20260709 12:21:19.604183 32582 raft_consensus.cc:359] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.605054 32582 raft_consensus.cc:385] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.605405 32582 raft_consensus.cc:740] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.606278 32582 consensus_queue.cc:260] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.608357 32584 tablet_bootstrap.cc:654] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.609134 32582 ts_tablet_manager.cc:1434] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:21:19.610558 32582 tablet_bootstrap.cc:492] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.618824 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:19.620028 32463 raft_consensus.cc:2468] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 0.
I20260709 12:21:19.621795 32504 leader_election.cc:304] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 
I20260709 12:21:19.623188 32601 raft_consensus.cc:2804] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.623728 32601 raft_consensus.cc:493] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.624183 32601 raft_consensus.cc:3060] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.628593 32582 tablet_bootstrap.cc:654] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.645038 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.645535 32591 raft_consensus.cc:493] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.646313 32591 raft_consensus.cc:515] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.647552 32582 tablet_bootstrap.cc:492] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.647835 32388 raft_consensus.cc:2468] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 0.
I20260709 12:21:19.648489 32582 ts_tablet_manager.cc:1403] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.000s
I20260709 12:21:19.650413 32587 raft_consensus.cc:493] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.651269 32587 raft_consensus.cc:515] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.655078 32591 leader_election.cc:290] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.655938 32587 leader_election.cc:290] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.667047 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.668380 32388 raft_consensus.cc:2468] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 0.
I20260709 12:21:19.667047 32582 raft_consensus.cc:359] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.671331 32582 raft_consensus.cc:385] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.671567 32589 raft_consensus.cc:493] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.671787 32582 raft_consensus.cc:740] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.672523 32589 raft_consensus.cc:515] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.675585 32589 leader_election.cc:290] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.676280 32582 consensus_queue.cc:260] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.681192 32582 ts_tablet_manager.cc:1434] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.032s	user 0.014s	sys 0.000s
I20260709 12:21:19.682844 32582 tablet_bootstrap.cc:492] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.689644 32589 raft_consensus.cc:493] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.690472 32589 raft_consensus.cc:515] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.693795 32589 leader_election.cc:290] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.696344 32582 tablet_bootstrap.cc:654] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.703789 32504 leader_election.cc:304] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:19.705425 32587 raft_consensus.cc:2804] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.705978 32587 raft_consensus.cc:493] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.706418 32587 raft_consensus.cc:3060] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.710804 32582 tablet_bootstrap.cc:492] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.711664 32582 ts_tablet_manager.cc:1403] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.029s	user 0.025s	sys 0.000s
I20260709 12:21:19.716342 32582 raft_consensus.cc:359] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.717320 32582 raft_consensus.cc:385] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.717690 32582 raft_consensus.cc:740] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.717847 32600 raft_consensus.cc:493] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.718590 32600 raft_consensus.cc:515] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.719139 32582 consensus_queue.cc:260] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.721403 32600 leader_election.cc:290] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.722692 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:19.723753 32463 raft_consensus.cc:2468] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 0.
I20260709 12:21:19.728103 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ad0effbe5d4284aba98d69c34aa176" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
W20260709 12:21:19.730005 32504 leader_election.cc:343] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:19.730973 32582 ts_tablet_manager.cc:1434] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 12:21:19.732620 32582 tablet_bootstrap.cc:492] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.737928 32626 raft_consensus.cc:493] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.738761 32626 raft_consensus.cc:515] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.739949 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ad0effbe5d4284aba98d69c34aa176" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.741029 32388 raft_consensus.cc:2468] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 0.
I20260709 12:21:19.742671 32504 leader_election.cc:304] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:19.743821 32600 raft_consensus.cc:2804] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.744217 32600 raft_consensus.cc:493] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.744599 32600 raft_consensus.cc:3060] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.742765 32626 leader_election.cc:290] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.745566 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c884b79d0314d138e135b0af3751bca" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.748519 32582 tablet_bootstrap.cc:654] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.764191 32582 tablet_bootstrap.cc:492] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.765097 32582 ts_tablet_manager.cc:1403] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.011s
I20260709 12:21:19.767096 32600 raft_consensus.cc:515] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.769655 32582 raft_consensus.cc:359] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.770886 32582 raft_consensus.cc:385] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:19.770661 32504 leader_election.cc:343] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:19.771396 32582 raft_consensus.cc:740] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.771469 32601 raft_consensus.cc:515] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.772891 32582 consensus_queue.cc:260] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.776623 32582 ts_tablet_manager.cc:1434] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:21:19.778169 32582 tablet_bootstrap.cc:492] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a: Bootstrap starting.
I20260709 12:21:19.779724 32583 tablet_bootstrap.cc:492] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:19.780385 32583 ts_tablet_manager.cc:1403] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.276s	user 0.097s	sys 0.122s
I20260709 12:21:19.773805 32601 leader_election.cc:290] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.784227 32600 leader_election.cc:290] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.784221 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ad0effbe5d4284aba98d69c34aa176" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:19.785514 32388 raft_consensus.cc:3060] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.786177 32583 raft_consensus.cc:359] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.786914 32584 tablet_bootstrap.cc:492] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.787057 32583 raft_consensus.cc:385] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.787159 32582 tablet_bootstrap.cc:654] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.787559 32584 ts_tablet_manager.cc:1403] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.188s	user 0.071s	sys 0.108s
I20260709 12:21:19.789602 32591 raft_consensus.cc:493] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.790238 32591 raft_consensus.cc:515] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.791776 32584 raft_consensus.cc:359] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.792521 32584 raft_consensus.cc:385] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.792642 32591 leader_election.cc:290] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.792850 32584 raft_consensus.cc:740] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.793898 32584 consensus_queue.cc:260] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.796337 32584 ts_tablet_manager.cc:1434] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:21:19.796394 32587 raft_consensus.cc:515] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.797452 32584 tablet_bootstrap.cc:492] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e: Bootstrap starting.
I20260709 12:21:19.800340 32582 tablet_bootstrap.cc:492] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a: No bootstrap required, opened a new log
I20260709 12:21:19.801038 32582 ts_tablet_manager.cc:1403] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.009s
I20260709 12:21:19.804450 32584 tablet_bootstrap.cc:654] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:19.805365 32387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:19.805266 32582 raft_consensus.cc:359] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.806350 32387 raft_consensus.cc:3060] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.806509 32582 raft_consensus.cc:385] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.807054 32582 raft_consensus.cc:740] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.807595 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c884b79d0314d138e135b0af3751bca" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:19.808336 32463 raft_consensus.cc:2468] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 0.
I20260709 12:21:19.807929 32582 consensus_queue.cc:260] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.810101 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ad0effbe5d4284aba98d69c34aa176" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:19.810731 32463 raft_consensus.cc:3060] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.811264 32582 ts_tablet_manager.cc:1434] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:21:19.815719 32462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:19.816720 32462 raft_consensus.cc:2468] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in term 0.
I20260709 12:21:19.816860 32461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:19.817939 32461 raft_consensus.cc:2468] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in term 0.
I20260709 12:21:19.819703 32460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:19.820700 32460 raft_consensus.cc:2468] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in term 0.
I20260709 12:21:19.823282 32353 leader_election.cc:304] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:19.824920 32353 leader_election.cc:304] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:19.825675 32591 raft_consensus.cc:2804] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.827520 32591 raft_consensus.cc:493] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.828068 32591 raft_consensus.cc:3060] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.787561 32583 raft_consensus.cc:740] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.829416 32583 consensus_queue.cc:260] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.833029 32386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.833956 32387 raft_consensus.cc:2468] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 1.
I20260709 12:21:19.835242 32386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32623c47210405286dba09464043595" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.836952 32386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.837606 32386 raft_consensus.cc:2468] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 0.
W20260709 12:21:19.839126 32429 leader_election.cc:343] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:19.840353 32504 leader_election.cc:304] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:19.841338 32600 raft_consensus.cc:2804] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:19.841869 32600 raft_consensus.cc:697] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:19.842796 32600 consensus_queue.cc:237] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.845758 32460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:19.846764 32460 raft_consensus.cc:3060] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.847164 32504 leader_election.cc:304] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:19.848145 32601 raft_consensus.cc:2804] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.848582 32601 raft_consensus.cc:493] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.848348 32463 raft_consensus.cc:2468] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 1.
I20260709 12:21:19.853499 32601 raft_consensus.cc:3060] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:19.850313 32429 leader_election.cc:343] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:19.860838 32429 leader_election.cc:304] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:19.861958 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:19.863049 32538 raft_consensus.cc:2468] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 0.
I20260709 12:21:19.864993 32589 raft_consensus.cc:2804] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.865293 32584 tablet_bootstrap.cc:492] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e: No bootstrap required, opened a new log
I20260709 12:21:19.865661 32589 raft_consensus.cc:493] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.866212 32589 raft_consensus.cc:3060] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.866036 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32623c47210405286dba09464043595" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:19.867473 32538 raft_consensus.cc:2468] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 0.
I20260709 12:21:19.850890 32388 raft_consensus.cc:2468] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 1.
I20260709 12:21:19.866098 32584 ts_tablet_manager.cc:1403] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e: Time spent bootstrapping tablet: real 0.069s	user 0.036s	sys 0.020s
I20260709 12:21:19.852440 32587 leader_election.cc:290] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.865465 32537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:19.871138 32537 raft_consensus.cc:2468] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 0.
I20260709 12:21:19.873409 32584 raft_consensus.cc:359] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:19.874197 32584 raft_consensus.cc:385] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.874477 32584 raft_consensus.cc:740] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.875336 32584 consensus_queue.cc:260] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:19.883488 32584 ts_tablet_manager.cc:1434] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:21:19.885763 32583 ts_tablet_manager.cc:1434] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.105s	user 0.012s	sys 0.026s
I20260709 12:21:19.887276 32583 tablet_bootstrap.cc:492] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:19.889544 32630 raft_consensus.cc:2764] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:21:19.890710 32630 raft_consensus.cc:493] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.891410 32630 raft_consensus.cc:515] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.897114 32583 tablet_bootstrap.cc:654] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:19.900784 32353 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.194:39265, user_credentials={real_user=slave}} blocked reactor thread for 75971.8us
I20260709 12:21:19.901973 32353 leader_election.cc:304] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:19.903913 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:19.905225 32536 raft_consensus.cc:2468] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in term 0.
I20260709 12:21:19.907563 32537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:19.908349 32634 raft_consensus.cc:493] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.908695 32537 raft_consensus.cc:2393] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 929d1f472a0f4a0fbb4dede619b4efc4 in current term 1: Already voted for candidate 388d1da26cf142e0a6d3089607aafd4a in this term.
I20260709 12:21:19.908542 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:19.912235 32634 raft_consensus.cc:515] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.910210 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e21b5512fc4213aca00fa0549853df" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:19.914310 32463 raft_consensus.cc:2468] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in term 0.
I20260709 12:21:19.915936 32634 leader_election.cc:290] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.916646 32634 raft_consensus.cc:493] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.917173 32634 raft_consensus.cc:515] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.917833 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:19.918041 32426 leader_election.cc:304] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:19.919035 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e21b5512fc4213aca00fa0549853df" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:19.919559 32634 leader_election.cc:290] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.919849 32538 raft_consensus.cc:2468] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in term 0.
I20260709 12:21:19.920492 32504 leader_election.cc:304] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 
I20260709 12:21:19.920868 32636 raft_consensus.cc:2804] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.917183 32353 leader_election.cc:304] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:19.921391 32636 raft_consensus.cc:493] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.921797 32636 raft_consensus.cc:3060] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.922811 32386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e21b5512fc4213aca00fa0549853df" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.923331 32633 raft_consensus.cc:2804] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.923820 32633 raft_consensus.cc:493] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.924160 32633 raft_consensus.cc:3060] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.925563 32583 tablet_bootstrap.cc:492] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:19.926357 32387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:19.919730 32426 leader_election.cc:304] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:19.927379 32600 raft_consensus.cc:2804] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:19.931213 32634 raft_consensus.cc:2804] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.931422 32600 raft_consensus.cc:697] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:19.931715 32634 raft_consensus.cc:493] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.932137 32634 raft_consensus.cc:3060] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.932644 32600 consensus_queue.cc:237] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.934733 32591 raft_consensus.cc:515] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.936055 32388 raft_consensus.cc:2393] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 388d1da26cf142e0a6d3089607aafd4a in current term 1: Already voted for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in this term.
I20260709 12:21:19.936266 32583 ts_tablet_manager.cc:1403] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.006s
I20260709 12:21:19.909121 32631 raft_consensus.cc:2804] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:19.937682 32631 raft_consensus.cc:493] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:19.938022 32631 raft_consensus.cc:3060] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:19.940766 32429 leader_election.cc:343] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:19.942507 32583 raft_consensus.cc:359] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.943459 32583 raft_consensus.cc:385] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:19.943797 32583 raft_consensus.cc:740] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:19.942793 32284 catalog_manager.cc:5697] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 1 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:19.944832 32583 consensus_queue.cc:260] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.928458 32601 raft_consensus.cc:515] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.919960 32460 raft_consensus.cc:2468] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 1.
I20260709 12:21:19.894665 32630 leader_election.cc:290] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.948894 32601 leader_election.cc:290] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:19.889700 32589 raft_consensus.cc:515] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.952732 32587 consensus_queue.cc:1048] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:19.954452 32591 leader_election.cc:290] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 election: Requested vote from peers 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.954692 32633 raft_consensus.cc:515] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.960028 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:19.972952 32538 raft_consensus.cc:2393] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 929d1f472a0f4a0fbb4dede619b4efc4 in current term 1: Already voted for candidate 388d1da26cf142e0a6d3089607aafd4a in this term.
I20260709 12:21:19.973095 32386 raft_consensus.cc:2393] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 60e13461b83145e4b52d4b0a53081e9e in current term 1: Already voted for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in this term.
I20260709 12:21:19.963768 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:19.974479 32463 raft_consensus.cc:3060] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.961731 32385 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c884b79d0314d138e135b0af3751bca" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:19.975333 32385 raft_consensus.cc:3060] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.978428 32633 leader_election.cc:290] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 election: Requested vote from peers 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.966605 32537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e21b5512fc4213aca00fa0549853df" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:19.979235 32461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e21b5512fc4213aca00fa0549853df" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:19.979395 32537 raft_consensus.cc:2468] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 0.
I20260709 12:21:19.979952 32461 raft_consensus.cc:3060] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.981489 32636 raft_consensus.cc:515] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.984084 32636 leader_election.cc:290] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:19.984709 32636 raft_consensus.cc:493] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:19.967309 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:19.985569 32536 raft_consensus.cc:2468] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 0.
I20260709 12:21:19.969614 32387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:19.971390 32460 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:19.984586 32537 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e21b5512fc4213aca00fa0549853df" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:19.988332 32537 raft_consensus.cc:3060] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:19.987788 32284 catalog_manager.cc:5697] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 1 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:19.966517 32634 raft_consensus.cc:515] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.988656 32353 leader_election.cc:304] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:19.993346 32633 raft_consensus.cc:2749] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:19.992875 32631 raft_consensus.cc:515] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:19.988720 32463 raft_consensus.cc:2468] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 1.
I20260709 12:21:19.998214 32387 raft_consensus.cc:2393] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 60e13461b83145e4b52d4b0a53081e9e in current term 1: Already voted for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in this term.
I20260709 12:21:19.991861 32636 raft_consensus.cc:515] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:20.000751 32386 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
W20260709 12:21:20.002348 32429 leader_election.cc:343] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:20.004477 32631 leader_election.cc:290] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 election: Requested vote from peers 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:20.005753 32536 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:20.006421 32536 raft_consensus.cc:3060] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:20.016924 32589 leader_election.cc:290] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:20.017158 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:20.018194 32463 raft_consensus.cc:2393] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 929d1f472a0f4a0fbb4dede619b4efc4 in current term 1: Already voted for candidate 60e13461b83145e4b52d4b0a53081e9e in this term.
I20260709 12:21:20.022640 32461 raft_consensus.cc:2468] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in term 1.
I20260709 12:21:20.022820 32634 leader_election.cc:290] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:20.023900 32387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32623c47210405286dba09464043595" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:20.024458 32353 leader_election.cc:304] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
W20260709 12:21:20.025704 32429 leader_election.cc:343] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:20.025916 32638 raft_consensus.cc:2804] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:20.026734 32638 raft_consensus.cc:697] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 LEADER]: Becoming Leader. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Running, Role: LEADER
I20260709 12:21:20.018193 32583 ts_tablet_manager.cc:1434] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.081s	user 0.017s	sys 0.012s
I20260709 12:21:20.014750 32385 raft_consensus.cc:2468] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 1.
I20260709 12:21:20.029400 32583 tablet_bootstrap.cc:492] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:20.030691 32387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" is_pre_election: true
I20260709 12:21:20.031471 32504 leader_election.cc:304] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:20.031530 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:20.032568 32538 raft_consensus.cc:3060] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:20.029484 32638 consensus_queue.cc:237] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.034605 32535 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:20.035282 32601 raft_consensus.cc:2804] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:20.035338 32534 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:20.036033 32601 raft_consensus.cc:697] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:20.036252 32426 leader_election.cc:304] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:20.036821 32533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32623c47210405286dba09464043595" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:20.037624 32533 raft_consensus.cc:3060] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:20.037253 32601 consensus_queue.cc:237] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.037750 32426 leader_election.cc:304] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:20.038810 32589 raft_consensus.cc:2804] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:20.037636 32634 raft_consensus.cc:2764] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:21:20.039304 32589 raft_consensus.cc:493] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:20.039927 32589 raft_consensus.cc:3060] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:20.042563 32426 leader_election.cc:304] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e; no voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:20.043574 32634 raft_consensus.cc:2749] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:20.043838 32426 leader_election.cc:304] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e; no voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:20.044852 32634 raft_consensus.cc:2749] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:20.046433 32463 raft_consensus.cc:3060] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:20.054437 32461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c884b79d0314d138e135b0af3751bca" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:20.054718 32504 leader_election.cc:304] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:20.056020 32587 raft_consensus.cc:2804] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:20.056753 32587 raft_consensus.cc:697] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:20.058130 32587 consensus_queue.cc:237] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.029049 32636 leader_election.cc:290] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119), 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757)
I20260709 12:21:20.055496 32461 raft_consensus.cc:3060] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:20.074133 32536 raft_consensus.cc:2468] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in term 1.
I20260709 12:21:20.078609 32537 raft_consensus.cc:2468] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 929d1f472a0f4a0fbb4dede619b4efc4 in term 1.
I20260709 12:21:20.085101 32533 raft_consensus.cc:2468] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 1.
I20260709 12:21:20.096680 32426 leader_election.cc:304] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:20.097255 32350 leader_election.cc:304] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:20.098361 32636 raft_consensus.cc:2804] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:20.098937 32636 raft_consensus.cc:697] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:20.099887 32636 consensus_queue.cc:237] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.101918 32631 raft_consensus.cc:2804] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:20.102499 32631 raft_consensus.cc:697] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 LEADER]: Becoming Leader. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Running, Role: LEADER
I20260709 12:21:20.102291 32285 catalog_manager.cc:5697] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.103667 32631 consensus_queue.cc:237] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.110376 32284 catalog_manager.cc:5697] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 1 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.089797 32538 raft_consensus.cc:2468] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 1.
I20260709 12:21:20.116143 32426 leader_election.cc:304] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:20.119621 32639 raft_consensus.cc:2804] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:20.120255 32639 raft_consensus.cc:697] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:20.120746 32587 consensus_queue.cc:1048] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:20.121341 32639 consensus_queue.cc:237] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.123270 32583 tablet_bootstrap.cc:654] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:20.123440 32589 raft_consensus.cc:515] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.130090 32589 leader_election.cc:290] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:20.131646 32388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:20.133287 32388 raft_consensus.cc:3060] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:20.136246 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:20.147119 32538 raft_consensus.cc:3060] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:20.153409 32461 raft_consensus.cc:2468] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 1.
I20260709 12:21:20.160080 32388 raft_consensus.cc:2468] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 1.
I20260709 12:21:20.169341 32285 catalog_manager.cc:5697] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:20.174571 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:20.178113 32583 tablet_bootstrap.cc:492] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:20.177795 32429 leader_election.cc:304] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:20.178897 32583 ts_tablet_manager.cc:1403] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.150s	user 0.008s	sys 0.008s
I20260709 12:21:20.179373 32639 raft_consensus.cc:2804] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:20.160102 32538 raft_consensus.cc:2468] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 1.
I20260709 12:21:20.180156 32639 raft_consensus.cc:697] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:20.181703 32639 consensus_queue.cc:237] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.184103 32583 raft_consensus.cc:359] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.184996 32583 raft_consensus.cc:385] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:20.173802 32283 catalog_manager.cc:5697] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 1 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:20.185333 32583 raft_consensus.cc:740] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:20.186496 32583 consensus_queue.cc:260] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.189224 32583 ts_tablet_manager.cc:1434] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:21:20.190481 32583 tablet_bootstrap.cc:492] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:20.197643 32583 tablet_bootstrap.cc:654] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:20.201567 32284 catalog_manager.cc:5697] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.205267 32583 tablet_bootstrap.cc:492] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: No bootstrap required, opened a new log
I20260709 12:21:20.205948 32583 ts_tablet_manager.cc:1403] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 12:21:20.209487 32583 raft_consensus.cc:359] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.210080 32583 raft_consensus.cc:385] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:20.210357 32583 raft_consensus.cc:740] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:20.211437 32583 consensus_queue.cc:260] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:20.214241 32583 ts_tablet_manager.cc:1434] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:20.213758 32285 catalog_manager.cc:5697] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.215829 32285 catalog_manager.cc:5697] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:20.303301 22903 ts_manager.cc:295] Set tserver state for 929d1f472a0f4a0fbb4dede619b4efc4 to MAINTENANCE_MODE
I20260709 12:21:20.304479 22903 tablet_server.cc:179] TabletServer@127.22.93.193:0 shutting down...
I20260709 12:21:20.336702 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:20.338001 22903 tablet_replica.cc:333] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.338822 22903 raft_consensus.cc:2243] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.339349 22903 raft_consensus.cc:2272] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.341753 22903 tablet_replica.cc:333] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.342362 22903 raft_consensus.cc:2243] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.342739 22903 raft_consensus.cc:2272] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.344883 22903 tablet_replica.cc:333] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.345448 22903 raft_consensus.cc:2243] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.345793 22903 raft_consensus.cc:2272] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.348359 22903 tablet_replica.cc:333] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.348944 22903 raft_consensus.cc:2243] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.349304 22903 raft_consensus.cc:2272] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.351365 22903 tablet_replica.cc:333] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.351923 22903 raft_consensus.cc:2243] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.352571 22903 pending_rounds.cc:70] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Trying to abort 1 pending ops.
I20260709 12:21:20.352754 22903 pending_rounds.cc:77] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624289446150144 op_type: NO_OP noop_request { }
I20260709 12:21:20.353042 22903 raft_consensus.cc:2889] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:20.353307 22903 raft_consensus.cc:2272] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.356109 22903 tablet_replica.cc:333] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.356734 22903 raft_consensus.cc:2243] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.357139 22903 raft_consensus.cc:2272] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.359359 22903 tablet_replica.cc:333] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.359939 22903 raft_consensus.cc:2243] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.360401 22903 raft_consensus.cc:2272] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.362320 22903 tablet_replica.cc:333] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.362869 22903 raft_consensus.cc:2243] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.363354 22903 raft_consensus.cc:2272] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.365330 22903 tablet_replica.cc:333] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.365947 22903 raft_consensus.cc:2243] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:20.366701 22903 pending_rounds.cc:70] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Trying to abort 1 pending ops.
I20260709 12:21:20.366889 22903 pending_rounds.cc:77] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305624289715355648 op_type: NO_OP noop_request { }
I20260709 12:21:20.367241 22903 raft_consensus.cc:2889] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:20.367542 22903 raft_consensus.cc:2272] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:20.370126 22903 tablet_replica.cc:333] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: stopping tablet replica
I20260709 12:21:20.370694 22903 raft_consensus.cc:2243] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:20.371192 22903 raft_consensus.cc:2272] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:20.386305 32504 consensus_peers.cc:597] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.397044 22903 tablet_server.cc:196] TabletServer@127.22.93.193:0 shutdown complete.
W20260709 12:21:20.420842 32504 consensus_peers.cc:597] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.422082 32601 consensus_queue.cc:1048] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:20.438851 32504 consensus_peers.cc:597] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:20.463284 32504 consensus_peers.cc:597] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.493981 32601 consensus_queue.cc:1048] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:20.560382 32626 consensus_queue.cc:1048] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:20.575687 32504 consensus_peers.cc:597] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.612046 32639 consensus_queue.cc:1048] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:21:20.631762 32429 consensus_peers.cc:597] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.648272 32601 consensus_queue.cc:1048] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:20.675263 32589 consensus_queue.cc:1048] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:21:20.678752 32429 consensus_peers.cc:597] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:20.687062 32639 consensus_queue.cc:1048] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:21:20.695572 32429 consensus_peers.cc:597] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:20.803237 32504 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111) [suppressed 153 similar messages]
W20260709 12:21:21.176169 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:21.689558 32634 raft_consensus.cc:493] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.690316 32634 raft_consensus.cc:515] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:21.692929 32634 leader_election.cc:290] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:21.694368 32533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:21.695217 32533 raft_consensus.cc:2468] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 1.
I20260709 12:21:21.696525 32426 leader_election.cc:304] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 
W20260709 12:21:21.697103 32429 leader_election.cc:336] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111)
I20260709 12:21:21.697326 32634 raft_consensus.cc:2804] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:21.697849 32634 raft_consensus.cc:493] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.698130 32634 raft_consensus.cc:3060] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:21.704862 32634 raft_consensus.cc:515] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:21.706904 32634 leader_election.cc:290] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:21.708089 32533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f4125e9ad07c4073b8daa441a155782d" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:21.708820 32533 raft_consensus.cc:3060] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:21.711362 32429 leader_election.cc:336] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111)
I20260709 12:21:21.715495 32533 raft_consensus.cc:2468] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:21.716650 32426 leader_election.cc:304] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:21.717427 32634 raft_consensus.cc:2804] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:21.718493 32634 raft_consensus.cc:697] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:21.719396 32634 consensus_queue.cc:237] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:21.719954 32668 raft_consensus.cc:493] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:21.720549 32668 raft_consensus.cc:515] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:21.722604 32668 leader_election.cc:290] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:21.723969 32533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e21b5512fc4213aca00fa0549853df" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:21.724786 32533 raft_consensus.cc:2468] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 1.
I20260709 12:21:21.726140 32426 leader_election.cc:304] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 
I20260709 12:21:21.727134 32668 raft_consensus.cc:2804] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:21:21.727494 32668 raft_consensus.cc:493] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:21.727856 32668 raft_consensus.cc:3060] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:21.731061 32429 leader_election.cc:336] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111)
I20260709 12:21:21.733740 32284 catalog_manager.cc:5697] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 1 to 2, leader changed from 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193) to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:21.736654 32668 raft_consensus.cc:515] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:21.738937 32668 leader_election.cc:290] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:21.740533 32533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80e21b5512fc4213aca00fa0549853df" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:21.741235 32533 raft_consensus.cc:3060] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:21.743144 32429 leader_election.cc:336] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111)
I20260709 12:21:21.749140 32533 raft_consensus.cc:2468] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:21.750743 32426 leader_election.cc:304] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:21.751632 32668 raft_consensus.cc:2804] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:21.752144 32668 raft_consensus.cc:697] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:21.753073 32668 consensus_queue.cc:237] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:21.762001 32284 catalog_manager.cc:5697] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 1 to 2, leader changed from 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193) to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:22.177606 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:22.257405 32533 raft_consensus.cc:1275] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:22.259210 32668 consensus_queue.cc:1048] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:22.266965 32429 consensus_peers.cc:597] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:22.267860 32429 consensus_peers.cc:597] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:22.269713 32538 raft_consensus.cc:1275] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:21:22.273242 32678 consensus_queue.cc:1048] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:21:22.596231 32504 consensus_peers.cc:597] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:22.679461 32504 consensus_peers.cc:597] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:22.895283 32504 consensus_peers.cc:597] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:22.909569 32504 consensus_peers.cc:597] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:23.170656 32504 consensus_peers.cc:597] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:23.178889 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:21:23.230948 32429 consensus_peers.cc:597] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:23.271152 32429 consensus_peers.cc:597] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:23.314085 32429 consensus_peers.cc:597] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:24.180328 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:21:24.769903 32429 consensus_peers.cc:597] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:25.065263 32504 consensus_peers.cc:597] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:25.066687 32429 consensus_peers.cc:597] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:21:25.105731 32504 consensus_peers.cc:597] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:25.181545 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:21:25.199798 32504 consensus_peers.cc:597] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:25.430281 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:25.440163 32685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:25.447057 32429 consensus_peers.cc:597] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:21:25.448712 32686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:25.449944 32689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:25.450467 22903 server_base.cc:1061] running on GCE node
I20260709 12:21:25.452663 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:25.452936 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:25.453115 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599685453100 us; error 0 us; skew 500 ppm
I20260709 12:21:25.453845 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:25.456976 22903 webserver.cc:533] Webserver started at http://127.22.93.193:43789/ using document root <none> and password file <none>
I20260709 12:21:25.457552 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:25.457784 22903 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:21:25.462136 22903 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:21:25.467063 32694 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:25.467984 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260709 12:21:25.468329 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
format_stamp: "Formatted at 2026-07-09 12:21:18 on dist-test-slave-k289"
I20260709 12:21:25.468773 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:25.495805 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:25.497318 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:25.499389 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:25.504014 32701 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 12:21:25.556566 32504 consensus_peers.cc:597] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:25.569810 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:21:25.570369 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.068s	user 0.000s	sys 0.003s
I20260709 12:21:25.570884 22903 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:21:25.578954 32701 tablet_bootstrap.cc:492] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:25.594496 32701 tablet_bootstrap.cc:492] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:25.595383 32701 tablet_bootstrap.cc:492] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.596091 32701 ts_tablet_manager.cc:1403] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.012s
I20260709 12:21:25.598551 32701 raft_consensus.cc:359] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:25.599292 32701 raft_consensus.cc:740] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.600056 32701 consensus_queue.cc:260] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:25.602644 32701 ts_tablet_manager.cc:1434] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:21:25.603497 32701 tablet_bootstrap.cc:492] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:25.619046 22903 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:21:25.619518 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.049s	user 0.044s	sys 0.004s
I20260709 12:21:25.622651 32701 tablet_bootstrap.cc:492] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:21:25.623849 32701 tablet_bootstrap.cc:492] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.624833 32701 ts_tablet_manager.cc:1403] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 12:21:25.627812 32701 raft_consensus.cc:359] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.628675 32701 raft_consensus.cc:740] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.629388 32701 consensus_queue.cc:260] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.631210 32701 ts_tablet_manager.cc:1434] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:21:25.632052 32701 tablet_bootstrap.cc:492] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
W20260709 12:21:25.652220 32504 consensus_peers.cc:597] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:21:25.652959 32701 tablet_bootstrap.cc:492] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:25.654219 32701 tablet_bootstrap.cc:492] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.655284 32701 ts_tablet_manager.cc:1403] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.023s	user 0.020s	sys 0.000s
I20260709 12:21:25.658965 32701 raft_consensus.cc:359] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.659883 32701 raft_consensus.cc:385] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.660236 32701 raft_consensus.cc:740] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.661754 32701 consensus_queue.cc:260] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.664631 32701 ts_tablet_manager.cc:1434] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.005s
I20260709 12:21:25.665434 32701 tablet_bootstrap.cc:492] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:25.677780 32701 tablet_bootstrap.cc:492] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:25.678633 32701 tablet_bootstrap.cc:492] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.679416 32701 ts_tablet_manager.cc:1403] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.004s
I20260709 12:21:25.681733 32701 raft_consensus.cc:359] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.682344 32701 raft_consensus.cc:740] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.683185 32701 consensus_queue.cc:260] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.684844 32701 ts_tablet_manager.cc:1434] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:25.685598 32701 tablet_bootstrap.cc:492] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:25.697731 32701 tablet_bootstrap.cc:492] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:25.698508 32701 tablet_bootstrap.cc:492] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.699394 32701 ts_tablet_manager.cc:1403] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.006s
I20260709 12:21:25.701517 32701 raft_consensus.cc:359] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.702090 32701 raft_consensus.cc:740] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.702893 32701 consensus_queue.cc:260] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.704921 32701 ts_tablet_manager.cc:1434] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.001s
I20260709 12:21:25.705762 32701 tablet_bootstrap.cc:492] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:25.713644 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:39757
I20260709 12:21:25.713826 32763 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:39757 every 8 connection(s)
I20260709 12:21:25.718732 32701 tablet_bootstrap.cc:492] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:25.719545 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:25.719792 32701 tablet_bootstrap.cc:492] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.720726 32701 ts_tablet_manager.cc:1403] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.015s	user 0.011s	sys 0.002s
I20260709 12:21:25.724261 32701 raft_consensus.cc:359] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.725337 32701 raft_consensus.cc:740] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.726562 32701 consensus_queue.cc:260] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.730044 32701 ts_tablet_manager.cc:1434] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:21:25.731343 32701 tablet_bootstrap.cc:492] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:25.748083 32701 tablet_bootstrap.cc:492] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:25.748944 32701 tablet_bootstrap.cc:492] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.749863 32701 ts_tablet_manager.cc:1403] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.008s
I20260709 12:21:25.752604 32701 raft_consensus.cc:359] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.753341 32701 raft_consensus.cc:385] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:25.753681 32701 raft_consensus.cc:740] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.754627 32701 consensus_queue.cc:260] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.756419 32701 ts_tablet_manager.cc:1434] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:21:25.757436 32701 tablet_bootstrap.cc:492] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:25.761382 32765 heartbeater.cc:344] Connected to a master server at 127.22.93.254:41695
I20260709 12:21:25.762004 32765 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:25.761890 32538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
mode: GRACEFUL
new_leader_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:51120
I20260709 12:21:25.763020 32538 raft_consensus.cc:606] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Received request to transfer leadership to TS 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:25.763417 32765 heartbeater.cc:507] Master 127.22.93.254:41695 requested a full tablet report, sending...
I20260709 12:21:25.772634 32284 ts_manager.cc:194] Re-registered known tserver with Master: 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757)
I20260709 12:21:25.773435 32701 tablet_bootstrap.cc:492] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:25.774581 32701 tablet_bootstrap.cc:492] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.775470 32701 ts_tablet_manager.cc:1403] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:21:25.778230 32701 raft_consensus.cc:359] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.779031 32701 raft_consensus.cc:740] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.780015 32701 consensus_queue.cc:260] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.781991 32461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f32623c47210405286dba09464043595"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
mode: GRACEFUL
new_leader_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:33286
I20260709 12:21:25.782401 32701 ts_tablet_manager.cc:1434] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:21:25.782812 32461 raft_consensus.cc:606] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Received request to transfer leadership to TS 388d1da26cf142e0a6d3089607aafd4a
I20260709 12:21:25.783567 32701 tablet_bootstrap.cc:492] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:25.784754 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:25.785408 32284 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43576
I20260709 12:21:25.785668 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:25.786584 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:25.790484 32765 heartbeater.cc:499] Master 127.22.93.254:41695 was elected leader, sending a full tablet report...
I20260709 12:21:25.801316 32701 tablet_bootstrap.cc:492] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:21:25.802248 32701 tablet_bootstrap.cc:492] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.802928 32701 ts_tablet_manager.cc:1403] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260709 12:21:25.805287 32701 raft_consensus.cc:359] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.806178 32701 raft_consensus.cc:740] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.807045 32701 consensus_queue.cc:260] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.809343 32701 ts_tablet_manager.cc:1434] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:21:25.810544 32701 tablet_bootstrap.cc:492] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap starting.
I20260709 12:21:25.827877 32701 tablet_bootstrap.cc:492] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:21:25.829187 32701 tablet_bootstrap.cc:492] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: Bootstrap complete.
I20260709 12:21:25.830081 32701 ts_tablet_manager.cc:1403] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent bootstrapping tablet: real 0.020s	user 0.017s	sys 0.000s
I20260709 12:21:25.833243 32701 raft_consensus.cc:359] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.833837 32701 raft_consensus.cc:740] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 929d1f472a0f4a0fbb4dede619b4efc4, State: Initialized, Role: FOLLOWER
I20260709 12:21:25.834537 32701 consensus_queue.cc:260] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.836730 32701 ts_tablet_manager.cc:1434] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:21:25.887177 32684 raft_consensus.cc:993] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a: : Instructing follower 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:25.887778   308 raft_consensus.cc:1081] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Signalling peer 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:25.889577 32461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:48798
I20260709 12:21:25.890182 32461 raft_consensus.cc:493] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:25.890586 32461 raft_consensus.cc:3060] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.897588 32461 raft_consensus.cc:515] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.900142 32461 leader_election.cc:290] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:25.902242 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:25.903149 32538 raft_consensus.cc:3055] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:25.903474 32538 raft_consensus.cc:740] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:25.904568 32538 consensus_queue.cc:260] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.906155 32538 raft_consensus.cc:3060] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.915812 32538 raft_consensus.cc:2468] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:25.916363 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:25.917397 32737 raft_consensus.cc:3060] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:25.917675 32426 leader_election.cc:304] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e; no voters: 
I20260709 12:21:25.919014 32687 raft_consensus.cc:2804] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:25.919612 32687 raft_consensus.cc:697] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:25.921018 32736 raft_consensus.cc:3060] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:25.920611 32687 consensus_queue.cc:237] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:25.930447 32737 raft_consensus.cc:2468] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:25.939926 32284 catalog_manager.cc:5697] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 1 to 2, leader changed from 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195) to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:26.014170 32703 raft_consensus.cc:493] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:26.015123 32703 raft_consensus.cc:515] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.018271 32703 leader_election.cc:290] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:26.032068 32461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "60e13461b83145e4b52d4b0a53081e9e" is_pre_election: true
I20260709 12:21:26.033106 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951" candidate_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "388d1da26cf142e0a6d3089607aafd4a" is_pre_election: true
I20260709 12:21:26.034778 32695 leader_election.cc:304] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 388d1da26cf142e0a6d3089607aafd4a, 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:26.035712 32703 raft_consensus.cc:2749] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:26.040701 32687 raft_consensus.cc:993] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e: : Instructing follower 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:26.041342 32683 raft_consensus.cc:1081] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Signalling peer 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:26.043152 32538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f32623c47210405286dba09464043595"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:38030
I20260709 12:21:26.043654 32538 raft_consensus.cc:493] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:26.043973 32538 raft_consensus.cc:3060] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.051234 32538 raft_consensus.cc:515] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.053264 32538 leader_election.cc:290] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 2 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:26.054399 32736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32623c47210405286dba09464043595" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:26.054934 32461 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f32623c47210405286dba09464043595" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:26.055377 32736 raft_consensus.cc:3060] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.055771 32461 raft_consensus.cc:3055] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:26.056185 32461 raft_consensus.cc:740] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:26.057358 32461 consensus_queue.cc:260] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.057736 32735 raft_consensus.cc:3060] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:26.058720 32461 raft_consensus.cc:3060] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.065310 32461 raft_consensus.cc:2468] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 2.
I20260709 12:21:26.065327 32736 raft_consensus.cc:2468] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 2.
I20260709 12:21:26.067081 32504 leader_election.cc:304] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:26.067945   308 raft_consensus.cc:2804] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:26.068511   308 raft_consensus.cc:697] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 2 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:26.069425   308 consensus_queue.cc:237] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.081609 32285 catalog_manager.cc:5697] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 1 to 2, leader changed from 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194) to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 2 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.098230 32735 raft_consensus.cc:3060] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.103454 32736 raft_consensus.cc:3060] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.106320 32735 pending_rounds.cc:85] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Aborting all ops after (but not including) 0
I20260709 12:21:26.106789 32735 pending_rounds.cc:107] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:21:26.107149 32735 raft_consensus.cc:2889] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:21:26.112337 32736 pending_rounds.cc:85] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Aborting all ops after (but not including) 0
I20260709 12:21:26.112855 32736 pending_rounds.cc:107] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:21:26.113171 32736 raft_consensus.cc:2889] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:21:26.182873 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:26.459420 32538 raft_consensus.cc:1275] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.461292 32687 consensus_queue.cc:1048] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:26.468448 32736 raft_consensus.cc:1275] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.471004 32687 consensus_queue.cc:1048] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:26.485394 32736 raft_consensus.cc:1275] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.488543   328 consensus_queue.cc:1048] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:26.499696 32461 raft_consensus.cc:1275] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:26.501750   335 consensus_queue.cc:1048] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:26.794482 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:26.803197 32538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92ad0effbe5d4284aba98d69c34aa176"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
mode: GRACEFUL
new_leader_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:51120
I20260709 12:21:26.803915 32538 raft_consensus.cc:606] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Received request to transfer leadership to TS 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:26.807484 32461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
mode: GRACEFUL
new_leader_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:33286
I20260709 12:21:26.808158 32461 raft_consensus.cc:606] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Received request to transfer leadership to TS 388d1da26cf142e0a6d3089607aafd4a
I20260709 12:21:26.809476 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:26.810077 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:26.810739 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:26.862027   329 raft_consensus.cc:993] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e: : Instructing follower 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:26.862965   337 raft_consensus.cc:1081] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Signalling peer 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:26.864694 32538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:38030
I20260709 12:21:26.865289 32538 raft_consensus.cc:493] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:26.865617 32538 raft_consensus.cc:3060] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:26.870376 32684 raft_consensus.cc:993] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a: : Instructing follower 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:26.871169 32684 raft_consensus.cc:1081] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Signalling peer 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:26.873296 32461 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92ad0effbe5d4284aba98d69c34aa176"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:48798
I20260709 12:21:26.873965 32461 raft_consensus.cc:493] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:26.874414 32461 raft_consensus.cc:3060] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.875583 32538 raft_consensus.cc:515] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.878547 32538 leader_election.cc:290] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:26.879302 32736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:26.879921 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acc68aa693c944b29921b861d6f2f595" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:26.880189 32736 raft_consensus.cc:3060] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:26.880693 32463 raft_consensus.cc:3055] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:26.881160 32463 raft_consensus.cc:740] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:26.882225 32463 consensus_queue.cc:260] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.884056 32463 raft_consensus.cc:3060] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:26.884663 32461 raft_consensus.cc:515] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.887521 32461 leader_election.cc:290] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:26.888447 32736 raft_consensus.cc:2468] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 3.
I20260709 12:21:26.890337 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ad0effbe5d4284aba98d69c34aa176" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:26.890391 32504 leader_election.cc:304] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:26.891475 32538 raft_consensus.cc:3055] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:26.891927 32684 raft_consensus.cc:2804] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:26.892589 32684 raft_consensus.cc:697] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 3 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:26.893357 32736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92ad0effbe5d4284aba98d69c34aa176" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:26.891935 32538 raft_consensus.cc:740] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:26.894105 32736 raft_consensus.cc:3060] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.893656 32684 consensus_queue.cc:237] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.894658 32463 raft_consensus.cc:2468] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 3.
I20260709 12:21:26.895666 32538 consensus_queue.cc:260] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.897480 32538 raft_consensus.cc:3060] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:26.903673 32736 raft_consensus.cc:2468] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:26.905507 32429 leader_election.cc:304] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:26.905500 32284 catalog_manager.cc:5697] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 2 to 3, leader changed from 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194) to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 3 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:26.906708   337 raft_consensus.cc:2804] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:26.907455   337 raft_consensus.cc:697] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:26.907470 32538 raft_consensus.cc:2468] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:26.908571   337 consensus_queue.cc:237] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:26.920301 32285 catalog_manager.cc:5697] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 1 to 2, leader changed from 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195) to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
W20260709 12:21:27.184168 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:27.390698 32736 raft_consensus.cc:1275] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:27.392526   337 consensus_queue.cc:1048] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:27.405890 32538 raft_consensus.cc:1275] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:27.407316 32461 raft_consensus.cc:1275] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 3 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:27.409217 32684 consensus_queue.cc:1048] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:27.412369   329 consensus_queue.cc:1048] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:27.434754 32736 raft_consensus.cc:1275] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 3 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:27.436384   335 consensus_queue.cc:1048] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:27.817848 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:27.832846 32538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
mode: GRACEFUL
new_leader_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:51120
I20260709 12:21:27.833575 32538 raft_consensus.cc:606] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Received request to transfer leadership to TS 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:27.836905 32461 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
mode: GRACEFUL
new_leader_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:33286
I20260709 12:21:27.837522 32461 raft_consensus.cc:606] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Received request to transfer leadership to TS 388d1da26cf142e0a6d3089607aafd4a
I20260709 12:21:27.838945 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:27.839812 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:27.840445 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:28.422129 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:28.610795   335 raft_consensus.cc:993] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a: : Instructing follower 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:28.611757   335 raft_consensus.cc:1081] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Signalling peer 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:28.630141 32463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:48798
I20260709 12:21:28.631140 32463 raft_consensus.cc:493] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:28.631726 32463 raft_consensus.cc:3060] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:28.633013   346 raft_consensus.cc:993] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e: : Instructing follower 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:28.633781   346 raft_consensus.cc:1081] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Signalling peer 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:28.636626 32538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:38030
I20260709 12:21:28.637147 32538 raft_consensus.cc:493] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:28.637535 32538 raft_consensus.cc:3060] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:28.642930 32463 raft_consensus.cc:515] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:28.643306 32538 raft_consensus.cc:515] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:28.645110 32538 leader_election.cc:290] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 2 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:28.646291 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:28.646512 32463 leader_election.cc:290] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Requested vote from peers 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119), 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757)
I20260709 12:21:28.646756 32737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "366d1b471f1346fb9862751c2b8cd79a" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:28.647022 32538 raft_consensus.cc:3055] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:28.647384 32538 raft_consensus.cc:740] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:28.647454 32737 raft_consensus.cc:3060] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:28.647945 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:28.646054 32736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c13e2225cb4f40c980e1c8050fc9e951" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:28.648674 32463 raft_consensus.cc:3055] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:28.648511 32538 consensus_queue.cc:260] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:28.648782 32736 raft_consensus.cc:3060] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:28.649304 32463 raft_consensus.cc:740] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:28.650107 32538 raft_consensus.cc:3060] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:28.650494 32463 consensus_queue.cc:260] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:28.652123 32463 raft_consensus.cc:3060] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:28.656068 32737 raft_consensus.cc:2468] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:28.658109 32429 leader_election.cc:304] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:28.659179   346 raft_consensus.cc:2804] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:28.659233 32736 raft_consensus.cc:2468] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 2.
I20260709 12:21:28.659145 32538 raft_consensus.cc:2468] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:28.659904   346 raft_consensus.cc:697] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:28.660992 32504 leader_election.cc:304] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:28.661895 32463 raft_consensus.cc:2468] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 2.
I20260709 12:21:28.662178   335 raft_consensus.cc:2804] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:28.662863   335 raft_consensus.cc:697] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 2 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:28.661887   346 consensus_queue.cc:237] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:28.663985   335 consensus_queue.cc:237] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:28.676874 32285 catalog_manager.cc:5697] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 1 to 2, leader changed from 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195) to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:28.676874 32284 catalog_manager.cc:5697] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 1 to 2, leader changed from 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194) to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 2 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:29.133631 32736 raft_consensus.cc:1275] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:29.136335   335 consensus_queue.cc:1048] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:29.142820 32737 raft_consensus.cc:1275] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:29.145661   346 consensus_queue.cc:1048] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:29.172024 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:29.181424 32463 raft_consensus.cc:1275] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:29.195341   369 consensus_queue.cc:1048] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:21:29.215831 32533 raft_consensus.cc:1275] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:29.242758   378 consensus_queue.cc:1048] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:29.246848 32463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
mode: GRACEFUL
new_leader_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:33286
I20260709 12:21:29.247992 32463 raft_consensus.cc:606] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Received request to transfer leadership to TS 388d1da26cf142e0a6d3089607aafd4a
I20260709 12:21:29.253800 32538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
mode: GRACEFUL
new_leader_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:51120
I20260709 12:21:29.254609 32538 raft_consensus.cc:606] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Received request to transfer leadership to TS 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:29.257067 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:29.257912 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:29.259065 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:21:29.423820 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:29.454901   335 raft_consensus.cc:993] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a: : Instructing follower 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:29.455688   369 raft_consensus.cc:1081] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Signalling peer 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:29.457533 32463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:48798
I20260709 12:21:29.458128 32463 raft_consensus.cc:493] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.458439 32463 raft_consensus.cc:3060] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.468407 32463 raft_consensus.cc:515] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:29.470520 32463 leader_election.cc:290] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:29.472002 32533 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:29.471906 32736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:29.473037 32533 raft_consensus.cc:3055] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:29.473067 32736 raft_consensus.cc:3060] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.473564 32533 raft_consensus.cc:740] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:29.475047 32533 consensus_queue.cc:260] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:29.476981 32533 raft_consensus.cc:3060] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.486271 32736 raft_consensus.cc:2468] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:29.488070 32429 leader_election.cc:304] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:29.488471 32533 raft_consensus.cc:2468] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:29.489043   378 raft_consensus.cc:2804] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:29.489723   378 raft_consensus.cc:697] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:29.490906   378 consensus_queue.cc:237] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:29.495579   372 raft_consensus.cc:993] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e: : Instructing follower 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:29.496435   372 raft_consensus.cc:1081] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Signalling peer 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:29.498924 32533 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:38030
I20260709 12:21:29.499542 32533 raft_consensus.cc:493] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:29.499881 32533 raft_consensus.cc:3060] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.504006 32285 catalog_manager.cc:5697] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 1 to 2, leader changed from 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195) to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:29.507566 32533 raft_consensus.cc:515] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:29.509799 32533 leader_election.cc:290] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 2 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:29.511539 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:29.511597 32736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "230e3fd95b5a4068b2b1acd3af55115a" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:29.512516 32463 raft_consensus.cc:3055] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:29.512940 32463 raft_consensus.cc:740] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:29.512810 32736 raft_consensus.cc:3060] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:29.514458 32463 consensus_queue.cc:260] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:29.516144 32463 raft_consensus.cc:3060] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:21:29.522396 32484 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6760 after lost signal to thread 22906
I20260709 12:21:29.522864 32736 raft_consensus.cc:2468] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 2.
I20260709 12:21:29.524616 32504 leader_election.cc:304] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
W20260709 12:21:29.525027 32484 debug-util.cc:398] Leaking SignalData structure 0x7b0800038280 after lost signal to thread 32319
I20260709 12:21:29.525810   369 raft_consensus.cc:2804] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:29.526486   369 raft_consensus.cc:697] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 2 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
W20260709 12:21:29.527740 32484 debug-util.cc:398] Leaking SignalData structure 0x7b0800150640 after lost signal to thread 32487
I20260709 12:21:29.528200   369 consensus_queue.cc:237] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
W20260709 12:21:29.529914 32484 debug-util.cc:398] Leaking SignalData structure 0x7b0800376420 after lost signal to thread 32563
W20260709 12:21:29.531864 32484 debug-util.cc:398] Leaking SignalData structure 0x7b08002d1cc0 after lost signal to thread 32763
I20260709 12:21:29.537436 32463 raft_consensus.cc:2468] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 2.
I20260709 12:21:29.546661 32284 catalog_manager.cc:5697] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 1 to 2, leader changed from 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194) to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 2 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:29.910213 32533 raft_consensus.cc:1275] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:29.912393   372 consensus_queue.cc:1048] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:29.928143 32736 raft_consensus.cc:1275] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:29.930438   375 consensus_queue.cc:1048] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:30.007619 32736 raft_consensus.cc:1275] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:30.010263   369 consensus_queue.cc:1048] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:30.023537 32463 raft_consensus.cc:1275] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:30.025717   386 consensus_queue.cc:1048] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:30.271777 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:30.283178 32538 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4c884b79d0314d138e135b0af3751bca"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
mode: GRACEFUL
new_leader_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:51120
I20260709 12:21:30.283867 32538 raft_consensus.cc:606] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Received request to transfer leadership to TS 60e13461b83145e4b52d4b0a53081e9e
I20260709 12:21:30.286964 32463 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
mode: GRACEFUL
new_leader_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:33286
I20260709 12:21:30.287573 32463 raft_consensus.cc:606] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Received request to transfer leadership to TS 388d1da26cf142e0a6d3089607aafd4a
I20260709 12:21:30.288955 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:30.289624 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:30.290326 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:30.391806   375 raft_consensus.cc:993] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e: : Instructing follower 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:30.392563   372 raft_consensus.cc:1081] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Signalling peer 388d1da26cf142e0a6d3089607aafd4a to start an election
I20260709 12:21:30.394706 32538 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba"
dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
 from {username='slave'} at 127.0.0.1:38030
I20260709 12:21:30.395427 32538 raft_consensus.cc:493] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:30.395807 32538 raft_consensus.cc:3060] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:30.408334 32538 raft_consensus.cc:515] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:30.410925 32538 leader_election.cc:290] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:30.411928 32736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:30.412973 32463 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc8e2e487c564d0aa2ba283574116dba" candidate_uuid: "388d1da26cf142e0a6d3089607aafd4a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
I20260709 12:21:30.413391 32736 raft_consensus.cc:3060] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:30.413731 32463 raft_consensus.cc:3055] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:30.414108 32463 raft_consensus.cc:740] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:30.415083 32463 consensus_queue.cc:260] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:30.416607 32463 raft_consensus.cc:3060] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:30.424615 32736 raft_consensus.cc:2468] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 3.
W20260709 12:21:30.425180 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:30.426036 32463 raft_consensus.cc:2468] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 388d1da26cf142e0a6d3089607aafd4a in term 3.
I20260709 12:21:30.427057 32504 leader_election.cc:304] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:30.428015   335 raft_consensus.cc:2804] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:30.428519   335 raft_consensus.cc:697] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 3 LEADER]: Becoming Leader. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:30.429436   335 consensus_queue.cc:237] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:30.438443 32285 catalog_manager.cc:5697] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a reported cstate change: term changed from 2 to 3, leader changed from 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194) to 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195). New cstate: current_term: 3 leader_uuid: "388d1da26cf142e0a6d3089607aafd4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:30.618245   335 raft_consensus.cc:993] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a: : Instructing follower 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:30.618907   386 raft_consensus.cc:1081] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Signalling peer 60e13461b83145e4b52d4b0a53081e9e to start an election
I20260709 12:21:30.620651 32463 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4c884b79d0314d138e135b0af3751bca"
dest_uuid: "60e13461b83145e4b52d4b0a53081e9e"
 from {username='slave'} at 127.0.0.1:48798
I20260709 12:21:30.621198 32463 raft_consensus.cc:493] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:30.621590 32463 raft_consensus.cc:3060] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:30.628647 32463 raft_consensus.cc:515] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:30.630316 32463 leader_election.cc:290] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Requested vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195:45119)
I20260709 12:21:30.631551 32736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c884b79d0314d138e135b0af3751bca" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "929d1f472a0f4a0fbb4dede619b4efc4"
I20260709 12:21:30.631502 32538 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c884b79d0314d138e135b0af3751bca" candidate_uuid: "60e13461b83145e4b52d4b0a53081e9e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "388d1da26cf142e0a6d3089607aafd4a"
I20260709 12:21:30.632422 32736 raft_consensus.cc:3060] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:30.632467 32538 raft_consensus.cc:3055] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:30.632921 32538 raft_consensus.cc:740] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 388d1da26cf142e0a6d3089607aafd4a, State: Running, Role: LEADER
I20260709 12:21:30.633965 32538 consensus_queue.cc:260] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:30.635478 32538 raft_consensus.cc:3060] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:30.641109 32736 raft_consensus.cc:2468] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:30.642620 32429 leader_election.cc:304] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4; no voters: 
I20260709 12:21:30.643981   372 raft_consensus.cc:2804] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:30.644510   372 raft_consensus.cc:697] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Becoming Leader. State: Replica: 60e13461b83145e4b52d4b0a53081e9e, State: Running, Role: LEADER
I20260709 12:21:30.645666 32538 raft_consensus.cc:2468] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 60e13461b83145e4b52d4b0a53081e9e in term 2.
I20260709 12:21:30.646001   372 consensus_queue.cc:237] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:30.655970 32285 catalog_manager.cc:5697] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e reported cstate change: term changed from 1 to 2, leader changed from 388d1da26cf142e0a6d3089607aafd4a (127.22.93.195) to 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "60e13461b83145e4b52d4b0a53081e9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:30.995105 32736 raft_consensus.cc:1275] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 3 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:30.997023   386 consensus_queue.cc:1048] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:31.010644 32463 raft_consensus.cc:1275] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 3 FOLLOWER]: Refusing update from remote peer 388d1da26cf142e0a6d3089607aafd4a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:31.014820   386 consensus_queue.cc:1048] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:31.156791 32538 raft_consensus.cc:1275] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:31.158851   378 consensus_queue.cc:1048] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:31.161084 32736 raft_consensus.cc:1275] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Refusing update from remote peer 60e13461b83145e4b52d4b0a53081e9e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:31.163560   378 consensus_queue.cc:1048] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:31.297436 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:31.340813 22903 tablet_server.cc:179] TabletServer@127.22.93.193:39757 shutting down...
W20260709 12:21:31.348196 32429 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 99 similar messages]
W20260709 12:21:31.358582 32429 consensus_peers.cc:597] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.387812 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:31.389101 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.390470 22903 raft_consensus.cc:2243] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.391335 22903 raft_consensus.cc:2272] T f4125e9ad07c4073b8daa441a155782d P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.395081 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.395889 22903 raft_consensus.cc:2243] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.396503 22903 raft_consensus.cc:2272] T 4c884b79d0314d138e135b0af3751bca P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.401368 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.402205 22903 raft_consensus.cc:2243] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.402788 22903 raft_consensus.cc:2272] T 230e3fd95b5a4068b2b1acd3af55115a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.405980 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.406714 22903 raft_consensus.cc:2243] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.407424 22903 raft_consensus.cc:2272] T f32623c47210405286dba09464043595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.411219 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.412195 22903 raft_consensus.cc:2243] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.412839 22903 raft_consensus.cc:2272] T bc8e2e487c564d0aa2ba283574116dba P 929d1f472a0f4a0fbb4dede619b4efc4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:31.415398 32429 consensus_peers.cc:597] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.417209 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.418001 22903 raft_consensus.cc:2243] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.418596 22903 raft_consensus.cc:2272] T 92ad0effbe5d4284aba98d69c34aa176 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.422029 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.422688 22903 raft_consensus.cc:2243] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.423377 22903 raft_consensus.cc:2272] T acc68aa693c944b29921b861d6f2f595 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:31.426573 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:31.427049 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.428294 22903 raft_consensus.cc:2243] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.429046 22903 raft_consensus.cc:2272] T c13e2225cb4f40c980e1c8050fc9e951 P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.433075 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.433974 22903 raft_consensus.cc:2243] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.434701 22903 raft_consensus.cc:2272] T 80e21b5512fc4213aca00fa0549853df P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.438935 22903 tablet_replica.cc:333] stopping tablet replica
I20260709 12:21:31.439869 22903 raft_consensus.cc:2243] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.440522 22903 raft_consensus.cc:2272] T 366d1b471f1346fb9862751c2b8cd79a P 929d1f472a0f4a0fbb4dede619b4efc4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:31.472944 32504 connection.cc:573] client connection to 127.22.93.193:39757 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260709 12:21:31.481146 32504 consensus_peers.cc:597] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.483937 22903 tablet_server.cc:196] TabletServer@127.22.93.193:39757 shutdown complete.
W20260709 12:21:31.525564 32504 consensus_peers.cc:597] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:31.528703 32504 consensus_peers.cc:597] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.531450 22903 tablet_server.cc:179] TabletServer@127.22.93.194:0 shutting down...
W20260709 12:21:31.544010 32504 consensus_peers.cc:597] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a -> Peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Couldn't send request to peer 60e13461b83145e4b52d4b0a53081e9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.573724 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:31.575049 22903 tablet_replica.cc:333] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.576642 22903 raft_consensus.cc:2243] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.578156 22903 raft_consensus.cc:2272] T 366d1b471f1346fb9862751c2b8cd79a P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.582129 22903 tablet_replica.cc:333] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.583176 22903 raft_consensus.cc:2243] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.584702 22903 raft_consensus.cc:2272] T 92ad0effbe5d4284aba98d69c34aa176 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.588929 22903 tablet_replica.cc:333] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.589941 22903 raft_consensus.cc:2243] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.591459 22903 raft_consensus.cc:2272] T 80e21b5512fc4213aca00fa0549853df P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.595606 22903 tablet_replica.cc:333] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.596519 22903 raft_consensus.cc:2243] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.597316 22903 raft_consensus.cc:2272] T acc68aa693c944b29921b861d6f2f595 P 60e13461b83145e4b52d4b0a53081e9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.601287 22903 tablet_replica.cc:333] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.602217 22903 raft_consensus.cc:2243] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.602874 22903 raft_consensus.cc:2272] T c13e2225cb4f40c980e1c8050fc9e951 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.606505 22903 tablet_replica.cc:333] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.607477 22903 raft_consensus.cc:2243] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.608084 22903 raft_consensus.cc:2272] T bc8e2e487c564d0aa2ba283574116dba P 60e13461b83145e4b52d4b0a53081e9e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.612151 22903 tablet_replica.cc:333] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.613219 22903 raft_consensus.cc:2243] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.614034 22903 raft_consensus.cc:2272] T f32623c47210405286dba09464043595 P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:31.614837 32504 consensus_peers.cc:597] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Couldn't send request to peer 60e13461b83145e4b52d4b0a53081e9e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.617996 22903 tablet_replica.cc:333] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.619037 22903 raft_consensus.cc:2243] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:31.620292 22903 raft_consensus.cc:2272] T 4c884b79d0314d138e135b0af3751bca P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.624715 22903 tablet_replica.cc:333] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.625388 22903 raft_consensus.cc:2243] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:31.625937 22903 raft_consensus.cc:2272] T 230e3fd95b5a4068b2b1acd3af55115a P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:31.629717 22903 tablet_replica.cc:333] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e: stopping tablet replica
I20260709 12:21:31.630576 22903 raft_consensus.cc:2243] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:21:31.631139 32429 consensus_peers.cc:597] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:31.632328 22903 raft_consensus.cc:2272] T f4125e9ad07c4073b8daa441a155782d P 60e13461b83145e4b52d4b0a53081e9e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:31.760073 32504 consensus_peers.cc:597] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:31.848634 32504 consensus_peers.cc:597] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Couldn't send request to peer 60e13461b83145e4b52d4b0a53081e9e. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:39265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:31.871224 32504 consensus_peers.cc:597] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Couldn't send request to peer 929d1f472a0f4a0fbb4dede619b4efc4. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:31.956606 32504 consensus_peers.cc:597] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a -> Peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Couldn't send request to peer 60e13461b83145e4b52d4b0a53081e9e. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:39265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:32.007539 32504 consensus_peers.cc:597] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a -> Peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Couldn't send request to peer 60e13461b83145e4b52d4b0a53081e9e. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:39265: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:32.428391 32333 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:21:32.555334   410 raft_consensus.cc:493] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 60e13461b83145e4b52d4b0a53081e9e)
I20260709 12:21:32.556147   410 raft_consensus.cc:515] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:32.558281   410 leader_election.cc:290] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
W20260709 12:21:32.563730 32504 leader_election.cc:336] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111)
W20260709 12:21:32.564555 32504 leader_election.cc:336] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Network error: Client connection negotiation failed: client connection to 127.22.93.194:39265: connect: Connection refused (error 111)
I20260709 12:21:32.565014 32504 leader_election.cc:304] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a; no voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:32.565999   410 raft_consensus.cc:2749] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:21:32.669922 22903 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 32484)
I20260709 12:21:32.680100   386 raft_consensus.cc:493] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 60e13461b83145e4b52d4b0a53081e9e)
I20260709 12:21:32.681044   386 raft_consensus.cc:515] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:32.683616   386 leader_election.cc:290] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
W20260709 12:21:32.687959 32504 leader_election.cc:336] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111)
W20260709 12:21:32.688833 32504 leader_election.cc:336] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Network error: Client connection negotiation failed: client connection to 127.22.93.194:39265: connect: Connection refused (error 111)
I20260709 12:21:32.689255 32504 leader_election.cc:304] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a; no voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:32.690057   386 raft_consensus.cc:2749] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:32.730935   386 raft_consensus.cc:493] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 60e13461b83145e4b52d4b0a53081e9e)
I20260709 12:21:32.731667   386 raft_consensus.cc:515] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:32.733742   386 leader_election.cc:290] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
W20260709 12:21:32.738379 32504 leader_election.cc:336] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111)
W20260709 12:21:32.740036 32504 leader_election.cc:336] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Network error: Client connection negotiation failed: client connection to 127.22.93.194:39265: connect: Connection refused (error 111)
I20260709 12:21:32.740489 32504 leader_election.cc:304] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a; no voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:32.742028   386 raft_consensus.cc:2749] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:32.794836   386 raft_consensus.cc:493] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 60e13461b83145e4b52d4b0a53081e9e)
I20260709 12:21:32.795660   386 raft_consensus.cc:515] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } } peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } }
I20260709 12:21:32.797987   386 leader_election.cc:290] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
W20260709 12:21:32.803107 32504 leader_election.cc:336] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111)
W20260709 12:21:32.803828 32504 leader_election.cc:336] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Network error: Client connection negotiation failed: client connection to 127.22.93.194:39265: connect: Connection refused (error 111)
I20260709 12:21:32.804175 32504 leader_election.cc:304] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a; no voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:32.804863   386 raft_consensus.cc:2749] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:32.861611 22903 tablet_server.cc:196] TabletServer@127.22.93.194:0 shutdown complete.
I20260709 12:21:32.898307 22903 tablet_server.cc:179] TabletServer@127.22.93.195:0 shutting down...
I20260709 12:21:32.943343 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:32.944417 22903 tablet_replica.cc:333] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.945364 22903 raft_consensus.cc:2243] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.945978 22903 raft_consensus.cc:2272] T f4125e9ad07c4073b8daa441a155782d P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.948757 22903 tablet_replica.cc:333] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.949416 22903 raft_consensus.cc:2243] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.949950 22903 raft_consensus.cc:2272] T 80e21b5512fc4213aca00fa0549853df P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.952613 22903 tablet_replica.cc:333] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.953567 22903 raft_consensus.cc:2243] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:32.954644 22903 raft_consensus.cc:2272] T f32623c47210405286dba09464043595 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.957152 22903 tablet_replica.cc:333] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.957828 22903 raft_consensus.cc:2243] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:32.958734 22903 raft_consensus.cc:2272] T bc8e2e487c564d0aa2ba283574116dba P 388d1da26cf142e0a6d3089607aafd4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.961023   386 raft_consensus.cc:493] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 60e13461b83145e4b52d4b0a53081e9e)
I20260709 12:21:32.961473 22903 tablet_replica.cc:333] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.961585   386 raft_consensus.cc:515] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "388d1da26cf142e0a6d3089607aafd4a" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 45119 } } peers { permanent_uuid: "929d1f472a0f4a0fbb4dede619b4efc4" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39757 } } peers { permanent_uuid: "60e13461b83145e4b52d4b0a53081e9e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 39265 } }
I20260709 12:21:32.962512 22903 raft_consensus.cc:2243] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:32.963726 22903 raft_consensus.cc:2272] T c13e2225cb4f40c980e1c8050fc9e951 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.964293   386 leader_election.cc:290] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757), 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265)
I20260709 12:21:32.967396 22903 tablet_replica.cc:333] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.968498 22903 raft_consensus.cc:2243] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:21:32.968859 32504 leader_election.cc:336] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 929d1f472a0f4a0fbb4dede619b4efc4 (127.22.93.193:39757): Network error: Client connection negotiation failed: client connection to 127.22.93.193:39757: connect: Connection refused (error 111)
W20260709 12:21:32.969631 32504 leader_election.cc:336] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 60e13461b83145e4b52d4b0a53081e9e (127.22.93.194:39265): Network error: Client connection negotiation failed: client connection to 127.22.93.194:39265: connect: Connection refused (error 111)
I20260709 12:21:32.969754 22903 raft_consensus.cc:2272] T acc68aa693c944b29921b861d6f2f595 P 388d1da26cf142e0a6d3089607aafd4a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.969937 32504 leader_election.cc:304] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 388d1da26cf142e0a6d3089607aafd4a; no voters: 60e13461b83145e4b52d4b0a53081e9e, 929d1f472a0f4a0fbb4dede619b4efc4
I20260709 12:21:32.970702   386 raft_consensus.cc:2749] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:21:32.973117 22903 tablet_replica.cc:333] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.973804 22903 raft_consensus.cc:2243] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.974260 22903 raft_consensus.cc:2272] T 92ad0effbe5d4284aba98d69c34aa176 P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.976658 22903 tablet_replica.cc:333] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.977178 22903 raft_consensus.cc:2243] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.977571 22903 raft_consensus.cc:2272] T 4c884b79d0314d138e135b0af3751bca P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.979813 22903 tablet_replica.cc:333] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.980297 22903 raft_consensus.cc:2243] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:32.981146 22903 raft_consensus.cc:2272] T 230e3fd95b5a4068b2b1acd3af55115a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:32.983660 22903 tablet_replica.cc:333] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a: stopping tablet replica
I20260709 12:21:32.984118 22903 raft_consensus.cc:2243] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:32.984527 22903 raft_consensus.cc:2272] T 366d1b471f1346fb9862751c2b8cd79a P 388d1da26cf142e0a6d3089607aafd4a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.023160 22903 tablet_server.cc:196] TabletServer@127.22.93.195:0 shutdown complete.
I20260709 12:21:33.057142 22903 master.cc:562] Master@127.22.93.254:41695 shutting down...
I20260709 12:21:33.085583 22903 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:33.086292 22903 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:33.086688 22903 tablet_replica.cc:333] T 00000000000000000000000000000000 P fbc66332723e402091f6885c4fd7a1eb: stopping tablet replica
I20260709 12:21:33.109087 22903 master.cc:584] Master@127.22.93.254:41695 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (15170 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:21:33.163467 22903 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.93.254:39291
I20260709 12:21:33.164860 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:33.171701   415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:33.171792   416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:33.172407   418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:33.174602 22903 server_base.cc:1061] running on GCE node
I20260709 12:21:33.175915 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:33.176100 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:33.176216 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599693176205 us; error 0 us; skew 500 ppm
I20260709 12:21:33.176749 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:33.179415 22903 webserver.cc:533] Webserver started at http://127.22.93.254:33151/ using document root <none> and password file <none>
I20260709 12:21:33.179930 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:33.180100 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:33.180337 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:33.181638 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/master-0-root/instance:
uuid: "56ee1ffe4b214bf6978d8968aac3674e"
format_stamp: "Formatted at 2026-07-09 12:21:33 on dist-test-slave-k289"
I20260709 12:21:33.186551 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:21:33.190217   423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:33.191057 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:21:33.191308 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/master-0-root
uuid: "56ee1ffe4b214bf6978d8968aac3674e"
format_stamp: "Formatted at 2026-07-09 12:21:33 on dist-test-slave-k289"
I20260709 12:21:33.191576 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:33.211829 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:33.213274 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:33.260397 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.254:39291
I20260709 12:21:33.260607   475 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.254:39291 every 8 connection(s)
I20260709 12:21:33.265087   476 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.279719   476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e: Bootstrap starting.
I20260709 12:21:33.287564   476 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.294486   476 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e: No bootstrap required, opened a new log
I20260709 12:21:33.297232   476 raft_consensus.cc:359] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ee1ffe4b214bf6978d8968aac3674e" member_type: VOTER }
I20260709 12:21:33.297709   476 raft_consensus.cc:385] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.297984   476 raft_consensus.cc:740] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56ee1ffe4b214bf6978d8968aac3674e, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.298615   476 consensus_queue.cc:260] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ee1ffe4b214bf6978d8968aac3674e" member_type: VOTER }
I20260709 12:21:33.299136   476 raft_consensus.cc:399] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:33.299372   476 raft_consensus.cc:493] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:33.299664   476 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:33.305863   476 raft_consensus.cc:515] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ee1ffe4b214bf6978d8968aac3674e" member_type: VOTER }
I20260709 12:21:33.306443   476 leader_election.cc:304] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56ee1ffe4b214bf6978d8968aac3674e; no voters: 
I20260709 12:21:33.307861   476 leader_election.cc:290] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:33.308331   479 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:33.310006   479 raft_consensus.cc:697] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 1 LEADER]: Becoming Leader. State: Replica: 56ee1ffe4b214bf6978d8968aac3674e, State: Running, Role: LEADER
I20260709 12:21:33.310711   479 consensus_queue.cc:237] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ee1ffe4b214bf6978d8968aac3674e" member_type: VOTER }
I20260709 12:21:33.311570   476 sys_catalog.cc:565] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:33.315928   480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56ee1ffe4b214bf6978d8968aac3674e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ee1ffe4b214bf6978d8968aac3674e" member_type: VOTER } }
I20260709 12:21:33.317958   480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:33.317165   481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56ee1ffe4b214bf6978d8968aac3674e. Latest consensus state: current_term: 1 leader_uuid: "56ee1ffe4b214bf6978d8968aac3674e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56ee1ffe4b214bf6978d8968aac3674e" member_type: VOTER } }
I20260709 12:21:33.318641   481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:33.320423   487 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:33.326359   487 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:33.329401 22903 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:33.336884   487 catalog_manager.cc:1383] Generated new cluster ID: 1096b8b61d7d4e12b20913dff75517ca
I20260709 12:21:33.337229   487 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:33.367578   487 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:33.369241   487 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:33.385673   487 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e: Generated new TSK 0
I20260709 12:21:33.386473   487 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:33.396312 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:33.403627   497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:33.405043   498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:33.409857 22903 server_base.cc:1061] running on GCE node
W20260709 12:21:33.412091   500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:33.413406 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:33.413655 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:33.413838 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599693413817 us; error 0 us; skew 500 ppm
I20260709 12:21:33.414480 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:33.417285 22903 webserver.cc:533] Webserver started at http://127.22.93.193:42893/ using document root <none> and password file <none>
I20260709 12:21:33.417860 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:33.418079 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:33.418396 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:33.419796 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-0-root/instance:
uuid: "0d785ebc2e574f798114b8ff33c2453b"
format_stamp: "Formatted at 2026-07-09 12:21:33 on dist-test-slave-k289"
I20260709 12:21:33.425412 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:21:33.429382   505 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:33.430190 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:21:33.430533 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "0d785ebc2e574f798114b8ff33c2453b"
format_stamp: "Formatted at 2026-07-09 12:21:33 on dist-test-slave-k289"
I20260709 12:21:33.430837 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:33.446183 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:33.447752 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:33.449585 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:33.452302 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:33.452546 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:33.452804 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:33.453015 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:33.505118 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:34697
I20260709 12:21:33.505246   567 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:34697 every 8 connection(s)
I20260709 12:21:33.511586 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:33.520017   572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:33.522557   573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:33.526050   575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:33.526639 22903 server_base.cc:1061] running on GCE node
I20260709 12:21:33.528705   568 heartbeater.cc:344] Connected to a master server at 127.22.93.254:39291
I20260709 12:21:33.528839 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:33.529224 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:33.529294   568 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:33.529414 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599693529378 us; error 0 us; skew 500 ppm
I20260709 12:21:33.530272 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:33.530355   568 heartbeater.cc:507] Master 127.22.93.254:39291 requested a full tablet report, sending...
I20260709 12:21:33.533713 22903 webserver.cc:533] Webserver started at http://127.22.93.194:33739/ using document root <none> and password file <none>
I20260709 12:21:33.533720   440 ts_manager.cc:194] Registered new tserver with Master: 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193:34697)
I20260709 12:21:33.534864 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:33.535246 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:33.535650 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:33.537315   440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39114
I20260709 12:21:33.537803 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-1-root/instance:
uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6"
format_stamp: "Formatted at 2026-07-09 12:21:33 on dist-test-slave-k289"
I20260709 12:21:33.543922 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:21:33.548197   580 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:33.549218 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:21:33.549602 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-1-root
uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6"
format_stamp: "Formatted at 2026-07-09 12:21:33 on dist-test-slave-k289"
I20260709 12:21:33.549962 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:33.564035 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:33.565586 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:33.567395 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:33.570147 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:33.570403 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:33.570663 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:33.570848 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:33.622289 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.194:38599
I20260709 12:21:33.622422   643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.194:38599 every 8 connection(s)
I20260709 12:21:33.628017 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:33.637480   647 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:33.638650   648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:33.642104 22903 server_base.cc:1061] running on GCE node
W20260709 12:21:33.643173   651 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:33.643929   644 heartbeater.cc:344] Connected to a master server at 127.22.93.254:39291
I20260709 12:21:33.644397   644 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:33.644445 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:33.644814 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:33.645011 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599693644990 us; error 0 us; skew 500 ppm
I20260709 12:21:33.645382   644 heartbeater.cc:507] Master 127.22.93.254:39291 requested a full tablet report, sending...
I20260709 12:21:33.645750 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:33.648123   440 ts_manager.cc:194] Registered new tserver with Master: df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194:38599)
I20260709 12:21:33.649243 22903 webserver.cc:533] Webserver started at http://127.22.93.195:45547/ using document root <none> and password file <none>
I20260709 12:21:33.650053 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:33.650318 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:33.650319   440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39124
I20260709 12:21:33.650772 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:33.652760 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-2-root/instance:
uuid: "e14b24a153b346e4b7066b58c49aca20"
format_stamp: "Formatted at 2026-07-09 12:21:33 on dist-test-slave-k289"
I20260709 12:21:33.658226 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.004s
I20260709 12:21:33.662179   655 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:33.663120 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:33.663452 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-2-root
uuid: "e14b24a153b346e4b7066b58c49aca20"
format_stamp: "Formatted at 2026-07-09 12:21:33 on dist-test-slave-k289"
I20260709 12:21:33.663760 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599348838328-22903-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:33.684949 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:33.686666 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:33.689348 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:33.693408 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:33.693809 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:21:33.694167 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:33.694428 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:33.745057 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.195:44599
I20260709 12:21:33.745184   717 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.195:44599 every 8 connection(s)
I20260709 12:21:33.762357   718 heartbeater.cc:344] Connected to a master server at 127.22.93.254:39291
I20260709 12:21:33.762976   718 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:33.763995   718 heartbeater.cc:507] Master 127.22.93.254:39291 requested a full tablet report, sending...
I20260709 12:21:33.766224   440 ts_manager.cc:194] Registered new tserver with Master: e14b24a153b346e4b7066b58c49aca20 (127.22.93.195:44599)
I20260709 12:21:33.766396 22903 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017704775s
I20260709 12:21:33.768014   440 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39128
I20260709 12:21:33.797979   440 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39144:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:33.800598   440 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:33.866609   533 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcff22bb3ad46b4b420fed43525b9dc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3eeac1ad95ee4ebf9e56fff0cd5b7af6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:33.868512   533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcff22bb3ad46b4b420fed43525b9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.868062   532 tablet_service.cc:1511] Processing CreateTablet for tablet 13dfe845a22f4606898baf0ed2163d0c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3eeac1ad95ee4ebf9e56fff0cd5b7af6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:33.872099   532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13dfe845a22f4606898baf0ed2163d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.873840   683 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcff22bb3ad46b4b420fed43525b9dc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3eeac1ad95ee4ebf9e56fff0cd5b7af6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:33.874410   682 tablet_service.cc:1511] Processing CreateTablet for tablet 13dfe845a22f4606898baf0ed2163d0c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3eeac1ad95ee4ebf9e56fff0cd5b7af6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:33.875663   683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcff22bb3ad46b4b420fed43525b9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.876874   682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13dfe845a22f4606898baf0ed2163d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.887180   609 tablet_service.cc:1511] Processing CreateTablet for tablet 1fcff22bb3ad46b4b420fed43525b9dc (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3eeac1ad95ee4ebf9e56fff0cd5b7af6]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:33.889111   609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fcff22bb3ad46b4b420fed43525b9dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.887399   608 tablet_service.cc:1511] Processing CreateTablet for tablet 13dfe845a22f4606898baf0ed2163d0c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=3eeac1ad95ee4ebf9e56fff0cd5b7af6]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:33.891507   608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13dfe845a22f4606898baf0ed2163d0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:33.911865   735 tablet_bootstrap.cc:492] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b: Bootstrap starting.
I20260709 12:21:33.913439   734 tablet_bootstrap.cc:492] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20: Bootstrap starting.
I20260709 12:21:33.924940   735 tablet_bootstrap.cc:654] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.925944   734 tablet_bootstrap.cc:654] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.929831   736 tablet_bootstrap.cc:492] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6: Bootstrap starting.
I20260709 12:21:33.933250   735 tablet_bootstrap.cc:492] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b: No bootstrap required, opened a new log
I20260709 12:21:33.933741   734 tablet_bootstrap.cc:492] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20: No bootstrap required, opened a new log
I20260709 12:21:33.933844   735 ts_tablet_manager.cc:1403] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.003s
I20260709 12:21:33.934651   734 ts_tablet_manager.cc:1403] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.004s
I20260709 12:21:33.937484   735 raft_consensus.cc:359] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:33.938350   735 raft_consensus.cc:385] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.938627   735 raft_consensus.cc:740] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d785ebc2e574f798114b8ff33c2453b, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.939584   736 tablet_bootstrap.cc:654] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.939525   735 consensus_queue.cc:260] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:33.940341   734 raft_consensus.cc:359] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:33.941375   734 raft_consensus.cc:385] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.941763   734 raft_consensus.cc:740] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14b24a153b346e4b7066b58c49aca20, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.942453   568 heartbeater.cc:499] Master 127.22.93.254:39291 was elected leader, sending a full tablet report...
I20260709 12:21:33.942862   735 ts_tablet_manager.cc:1434] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:33.942934   734 consensus_queue.cc:260] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:33.944093   735 tablet_bootstrap.cc:492] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b: Bootstrap starting.
I20260709 12:21:33.948710   736 tablet_bootstrap.cc:492] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6: No bootstrap required, opened a new log
I20260709 12:21:33.949450   736 ts_tablet_manager.cc:1403] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:21:33.953105   736 raft_consensus.cc:359] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:33.954214   735 tablet_bootstrap.cc:654] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.957037   718 heartbeater.cc:499] Master 127.22.93.254:39291 was elected leader, sending a full tablet report...
I20260709 12:21:33.957350   734 ts_tablet_manager.cc:1434] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20: Time spent starting tablet: real 0.022s	user 0.010s	sys 0.003s
I20260709 12:21:33.958820   734 tablet_bootstrap.cc:492] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20: Bootstrap starting.
I20260709 12:21:33.954391   736 raft_consensus.cc:385] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.961443   736 raft_consensus.cc:740] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df0a2e5df1eb4246b9e60ade7c05d1d6, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.962608   736 consensus_queue.cc:260] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:33.968822   734 tablet_bootstrap.cc:654] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:33.979980   644 heartbeater.cc:499] Master 127.22.93.254:39291 was elected leader, sending a full tablet report...
I20260709 12:21:33.981124   735 tablet_bootstrap.cc:492] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b: No bootstrap required, opened a new log
I20260709 12:21:33.981223   734 tablet_bootstrap.cc:492] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20: No bootstrap required, opened a new log
I20260709 12:21:33.982003   735 ts_tablet_manager.cc:1403] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b: Time spent bootstrapping tablet: real 0.038s	user 0.026s	sys 0.009s
I20260709 12:21:33.982053   734 ts_tablet_manager.cc:1403] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.014s
I20260709 12:21:33.984239   736 ts_tablet_manager.cc:1434] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.014s
I20260709 12:21:33.985646   736 tablet_bootstrap.cc:492] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6: Bootstrap starting.
I20260709 12:21:33.986068   735 raft_consensus.cc:359] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:33.986351   734 raft_consensus.cc:359] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:33.987049   735 raft_consensus.cc:385] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.987298   734 raft_consensus.cc:385] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:33.987489   735 raft_consensus.cc:740] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d785ebc2e574f798114b8ff33c2453b, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.987754   734 raft_consensus.cc:740] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14b24a153b346e4b7066b58c49aca20, State: Initialized, Role: FOLLOWER
I20260709 12:21:33.988499   735 consensus_queue.cc:260] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:33.988812   734 consensus_queue.cc:260] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:33.993178   735 ts_tablet_manager.cc:1434] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:21:33.994612   734 ts_tablet_manager.cc:1434] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:21:33.999182   736 tablet_bootstrap.cc:654] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.005321   736 tablet_bootstrap.cc:492] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6: No bootstrap required, opened a new log
I20260709 12:21:34.005954   736 ts_tablet_manager.cc:1403] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6: Time spent bootstrapping tablet: real 0.021s	user 0.002s	sys 0.011s
I20260709 12:21:34.008677   736 raft_consensus.cc:359] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.009260   736 raft_consensus.cc:385] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.009516   736 raft_consensus.cc:740] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df0a2e5df1eb4246b9e60ade7c05d1d6, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.010283   736 consensus_queue.cc:260] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.012396   736 ts_tablet_manager.cc:1434] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:21:34.028105   743 raft_consensus.cc:493] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.028635   743 raft_consensus.cc:515] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.031037   743 leader_election.cc:290] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193:34697), e14b24a153b346e4b7066b58c49aca20 (127.22.93.195:44599)
I20260709 12:21:34.042518   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dfe845a22f4606898baf0ed2163d0c" candidate_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d785ebc2e574f798114b8ff33c2453b" is_pre_election: true
I20260709 12:21:34.043514   543 raft_consensus.cc:2468] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df0a2e5df1eb4246b9e60ade7c05d1d6 in term 0.
I20260709 12:21:34.043673   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dfe845a22f4606898baf0ed2163d0c" candidate_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14b24a153b346e4b7066b58c49aca20" is_pre_election: true
I20260709 12:21:34.044526   693 raft_consensus.cc:2468] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df0a2e5df1eb4246b9e60ade7c05d1d6 in term 0.
I20260709 12:21:34.044914   583 leader_election.cc:304] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d785ebc2e574f798114b8ff33c2453b, df0a2e5df1eb4246b9e60ade7c05d1d6; no voters: 
I20260709 12:21:34.045976   743 raft_consensus.cc:2804] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.046350   743 raft_consensus.cc:493] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.046641   743 raft_consensus.cc:3060] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.053644   743 raft_consensus.cc:515] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.055708   743 leader_election.cc:290] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193:34697), e14b24a153b346e4b7066b58c49aca20 (127.22.93.195:44599)
I20260709 12:21:34.056862   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dfe845a22f4606898baf0ed2163d0c" candidate_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d785ebc2e574f798114b8ff33c2453b"
I20260709 12:21:34.056857   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13dfe845a22f4606898baf0ed2163d0c" candidate_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14b24a153b346e4b7066b58c49aca20"
I20260709 12:21:34.057871   693 raft_consensus.cc:3060] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.057866   543 raft_consensus.cc:3060] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.067598   693 raft_consensus.cc:2468] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df0a2e5df1eb4246b9e60ade7c05d1d6 in term 1.
I20260709 12:21:34.067597   543 raft_consensus.cc:2468] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df0a2e5df1eb4246b9e60ade7c05d1d6 in term 1.
I20260709 12:21:34.069319   583 leader_election.cc:304] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d785ebc2e574f798114b8ff33c2453b, df0a2e5df1eb4246b9e60ade7c05d1d6; no voters: 
I20260709 12:21:34.070235   743 raft_consensus.cc:2804] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.071458   743 raft_consensus.cc:697] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 LEADER]: Becoming Leader. State: Replica: df0a2e5df1eb4246b9e60ade7c05d1d6, State: Running, Role: LEADER
I20260709 12:21:34.072463   743 consensus_queue.cc:237] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.081596   437 catalog_manager.cc:5697] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.116040   743 raft_consensus.cc:493] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.116858   743 raft_consensus.cc:515] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:34.119144   743 leader_election.cc:290] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193:34697), e14b24a153b346e4b7066b58c49aca20 (127.22.93.195:44599)
I20260709 12:21:34.120219   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcff22bb3ad46b4b420fed43525b9dc" candidate_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d785ebc2e574f798114b8ff33c2453b" is_pre_election: true
I20260709 12:21:34.120447   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcff22bb3ad46b4b420fed43525b9dc" candidate_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14b24a153b346e4b7066b58c49aca20" is_pre_election: true
I20260709 12:21:34.121009   543 raft_consensus.cc:2468] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df0a2e5df1eb4246b9e60ade7c05d1d6 in term 0.
I20260709 12:21:34.121165   693 raft_consensus.cc:2468] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df0a2e5df1eb4246b9e60ade7c05d1d6 in term 0.
I20260709 12:21:34.122141   583 leader_election.cc:304] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d785ebc2e574f798114b8ff33c2453b, df0a2e5df1eb4246b9e60ade7c05d1d6; no voters: 
I20260709 12:21:34.122977   743 raft_consensus.cc:2804] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.123311   743 raft_consensus.cc:493] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.123543   743 raft_consensus.cc:3060] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.130849   743 raft_consensus.cc:515] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:34.132609   743 leader_election.cc:290] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193:34697), e14b24a153b346e4b7066b58c49aca20 (127.22.93.195:44599)
I20260709 12:21:34.133558   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcff22bb3ad46b4b420fed43525b9dc" candidate_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d785ebc2e574f798114b8ff33c2453b"
I20260709 12:21:34.133903   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcff22bb3ad46b4b420fed43525b9dc" candidate_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14b24a153b346e4b7066b58c49aca20"
I20260709 12:21:34.134407   543 raft_consensus.cc:3060] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.134549   693 raft_consensus.cc:3060] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.143098   693 raft_consensus.cc:2468] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df0a2e5df1eb4246b9e60ade7c05d1d6 in term 1.
I20260709 12:21:34.143098   543 raft_consensus.cc:2468] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df0a2e5df1eb4246b9e60ade7c05d1d6 in term 1.
I20260709 12:21:34.144902   581 leader_election.cc:304] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df0a2e5df1eb4246b9e60ade7c05d1d6, e14b24a153b346e4b7066b58c49aca20; no voters: 
I20260709 12:21:34.145802   743 raft_consensus.cc:2804] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.146407   743 raft_consensus.cc:697] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 LEADER]: Becoming Leader. State: Replica: df0a2e5df1eb4246b9e60ade7c05d1d6, State: Running, Role: LEADER
I20260709 12:21:34.147404   743 consensus_queue.cc:237] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:34.155324   437 catalog_manager.cc:5697] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:34.214289   437 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39148:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:34.216985   437 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:34.246073   532 tablet_service.cc:1511] Processing CreateTablet for tablet cc01685a7b7344e1a3d3478d07477e1b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a67ee1b00044468881226b3cf0fdcd4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:34.247723   532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc01685a7b7344e1a3d3478d07477e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:34.247548   609 tablet_service.cc:1511] Processing CreateTablet for tablet cc01685a7b7344e1a3d3478d07477e1b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a67ee1b00044468881226b3cf0fdcd4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:34.249158   609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc01685a7b7344e1a3d3478d07477e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:34.251128   533 tablet_service.cc:1511] Processing CreateTablet for tablet f000b3c270224a0bb4b7079ee212de61 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a67ee1b00044468881226b3cf0fdcd4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:34.252686   533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f000b3c270224a0bb4b7079ee212de61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:34.253386   682 tablet_service.cc:1511] Processing CreateTablet for tablet cc01685a7b7344e1a3d3478d07477e1b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a67ee1b00044468881226b3cf0fdcd4]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:21:34.254163   683 tablet_service.cc:1511] Processing CreateTablet for tablet f000b3c270224a0bb4b7079ee212de61 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a67ee1b00044468881226b3cf0fdcd4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:34.254818   682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc01685a7b7344e1a3d3478d07477e1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:34.255558   683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f000b3c270224a0bb4b7079ee212de61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:34.265406   608 tablet_service.cc:1511] Processing CreateTablet for tablet f000b3c270224a0bb4b7079ee212de61 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7a67ee1b00044468881226b3cf0fdcd4]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:21:34.267123   608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f000b3c270224a0bb4b7079ee212de61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:34.268455   735 tablet_bootstrap.cc:492] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b: Bootstrap starting.
I20260709 12:21:34.275998   735 tablet_bootstrap.cc:654] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.283519   734 tablet_bootstrap.cc:492] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20: Bootstrap starting.
I20260709 12:21:34.283973   735 tablet_bootstrap.cc:492] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b: No bootstrap required, opened a new log
I20260709 12:21:34.284695   735 ts_tablet_manager.cc:1403] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 12:21:34.289381   736 tablet_bootstrap.cc:492] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6: Bootstrap starting.
I20260709 12:21:34.289605   735 raft_consensus.cc:359] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.290619   735 raft_consensus.cc:385] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.291049   735 raft_consensus.cc:740] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d785ebc2e574f798114b8ff33c2453b, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.291308   734 tablet_bootstrap.cc:654] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.292258   735 consensus_queue.cc:260] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.295224   735 ts_tablet_manager.cc:1434] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:21:34.296504   735 tablet_bootstrap.cc:492] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b: Bootstrap starting.
I20260709 12:21:34.304152   735 tablet_bootstrap.cc:654] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.314692   736 tablet_bootstrap.cc:654] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.315932   734 tablet_bootstrap.cc:492] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20: No bootstrap required, opened a new log
I20260709 12:21:34.316522   735 tablet_bootstrap.cc:492] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b: No bootstrap required, opened a new log
I20260709 12:21:34.316577   734 ts_tablet_manager.cc:1403] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.014s
I20260709 12:21:34.317320   735 ts_tablet_manager.cc:1403] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 12:21:34.320595   734 raft_consensus.cc:359] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.320890   735 raft_consensus.cc:359] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.321586   734 raft_consensus.cc:385] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.321636   735 raft_consensus.cc:385] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.322055   734 raft_consensus.cc:740] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14b24a153b346e4b7066b58c49aca20, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.322096   735 raft_consensus.cc:740] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d785ebc2e574f798114b8ff33c2453b, State: Initialized, Role: FOLLOWER
W20260709 12:21:34.323125   489 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:34.323845   736 tablet_bootstrap.cc:492] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6: No bootstrap required, opened a new log
I20260709 12:21:34.323195   734 consensus_queue.cc:260] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.323140   735 consensus_queue.cc:260] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.324484   736 ts_tablet_manager.cc:1403] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6: Time spent bootstrapping tablet: real 0.035s	user 0.009s	sys 0.005s
I20260709 12:21:34.329380   735 ts_tablet_manager.cc:1434] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:21:34.330168   734 ts_tablet_manager.cc:1434] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.006s
I20260709 12:21:34.330404   736 raft_consensus.cc:359] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.331513   734 tablet_bootstrap.cc:492] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20: Bootstrap starting.
I20260709 12:21:34.331765   736 raft_consensus.cc:385] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.332125   736 raft_consensus.cc:740] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df0a2e5df1eb4246b9e60ade7c05d1d6, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.333292   736 consensus_queue.cc:260] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.335640   736 ts_tablet_manager.cc:1434] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 12:21:34.336755   736 tablet_bootstrap.cc:492] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6: Bootstrap starting.
I20260709 12:21:34.344107   734 tablet_bootstrap.cc:654] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.347141   736 tablet_bootstrap.cc:654] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:34.350447   734 tablet_bootstrap.cc:492] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20: No bootstrap required, opened a new log
I20260709 12:21:34.351106   734 ts_tablet_manager.cc:1403] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.002s
I20260709 12:21:34.352980   736 tablet_bootstrap.cc:492] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6: No bootstrap required, opened a new log
I20260709 12:21:34.353494   736 ts_tablet_manager.cc:1403] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.006s
I20260709 12:21:34.354039   734 raft_consensus.cc:359] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.354871   734 raft_consensus.cc:385] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.355172   734 raft_consensus.cc:740] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e14b24a153b346e4b7066b58c49aca20, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.355909   734 consensus_queue.cc:260] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.356769   736 raft_consensus.cc:359] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.357519   736 raft_consensus.cc:385] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:34.357812   736 raft_consensus.cc:740] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df0a2e5df1eb4246b9e60ade7c05d1d6, State: Initialized, Role: FOLLOWER
I20260709 12:21:34.358137   734 ts_tablet_manager.cc:1434] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.001s
I20260709 12:21:34.358605   736 consensus_queue.cc:260] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.361127   736 ts_tablet_manager.cc:1434] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:21:34.374502   741 raft_consensus.cc:493] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.375140   741 raft_consensus.cc:515] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.377301   741 leader_election.cc:290] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193:34697), df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194:38599)
I20260709 12:21:34.388734   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f000b3c270224a0bb4b7079ee212de61" candidate_uuid: "e14b24a153b346e4b7066b58c49aca20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d785ebc2e574f798114b8ff33c2453b" is_pre_election: true
I20260709 12:21:34.389137   619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f000b3c270224a0bb4b7079ee212de61" candidate_uuid: "e14b24a153b346e4b7066b58c49aca20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" is_pre_election: true
I20260709 12:21:34.389740   543 raft_consensus.cc:2468] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e14b24a153b346e4b7066b58c49aca20 in term 0.
I20260709 12:21:34.389878   619 raft_consensus.cc:2468] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e14b24a153b346e4b7066b58c49aca20 in term 0.
I20260709 12:21:34.391131   658 leader_election.cc:304] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d785ebc2e574f798114b8ff33c2453b, e14b24a153b346e4b7066b58c49aca20; no voters: 
I20260709 12:21:34.391947   741 raft_consensus.cc:2804] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.392290   741 raft_consensus.cc:493] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.392589   741 raft_consensus.cc:3060] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.399277   741 raft_consensus.cc:515] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.401094   741 leader_election.cc:290] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [CANDIDATE]: Term 1 election: Requested vote from peers 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193:34697), df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194:38599)
I20260709 12:21:34.401954   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f000b3c270224a0bb4b7079ee212de61" candidate_uuid: "e14b24a153b346e4b7066b58c49aca20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d785ebc2e574f798114b8ff33c2453b"
I20260709 12:21:34.402169   619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f000b3c270224a0bb4b7079ee212de61" candidate_uuid: "e14b24a153b346e4b7066b58c49aca20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6"
I20260709 12:21:34.402575   543 raft_consensus.cc:3060] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.402801   619 raft_consensus.cc:3060] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.408628   543 raft_consensus.cc:2468] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e14b24a153b346e4b7066b58c49aca20 in term 1.
I20260709 12:21:34.409569   619 raft_consensus.cc:2468] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e14b24a153b346e4b7066b58c49aca20 in term 1.
I20260709 12:21:34.409804   658 leader_election.cc:304] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d785ebc2e574f798114b8ff33c2453b, e14b24a153b346e4b7066b58c49aca20; no voters: 
I20260709 12:21:34.410866   741 raft_consensus.cc:2804] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.411931   741 raft_consensus.cc:697] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 1 LEADER]: Becoming Leader. State: Replica: e14b24a153b346e4b7066b58c49aca20, State: Running, Role: LEADER
I20260709 12:21:34.412705   741 consensus_queue.cc:237] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.420396   439 catalog_manager.cc:5697] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 reported cstate change: term changed from 0 to 1, leader changed from <none> to e14b24a153b346e4b7066b58c49aca20 (127.22.93.195). New cstate: current_term: 1 leader_uuid: "e14b24a153b346e4b7066b58c49aca20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:34.480379   739 raft_consensus.cc:493] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:34.481040   739 raft_consensus.cc:515] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.483839   739 leader_election.cc:290] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194:38599), e14b24a153b346e4b7066b58c49aca20 (127.22.93.195:44599)
I20260709 12:21:34.495970   619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc01685a7b7344e1a3d3478d07477e1b" candidate_uuid: "0d785ebc2e574f798114b8ff33c2453b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" is_pre_election: true
I20260709 12:21:34.496248   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc01685a7b7344e1a3d3478d07477e1b" candidate_uuid: "0d785ebc2e574f798114b8ff33c2453b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14b24a153b346e4b7066b58c49aca20" is_pre_election: true
I20260709 12:21:34.496865   619 raft_consensus.cc:2468] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d785ebc2e574f798114b8ff33c2453b in term 0.
I20260709 12:21:34.496986   693 raft_consensus.cc:2468] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d785ebc2e574f798114b8ff33c2453b in term 0.
I20260709 12:21:34.498234   509 leader_election.cc:304] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d785ebc2e574f798114b8ff33c2453b, df0a2e5df1eb4246b9e60ade7c05d1d6; no voters: 
I20260709 12:21:34.499092   739 raft_consensus.cc:2804] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:34.499447   739 raft_consensus.cc:493] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:34.499747   739 raft_consensus.cc:3060] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.507210   739 raft_consensus.cc:515] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.509034   739 leader_election.cc:290] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [CANDIDATE]: Term 1 election: Requested vote from peers df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194:38599), e14b24a153b346e4b7066b58c49aca20 (127.22.93.195:44599)
I20260709 12:21:34.509975   619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc01685a7b7344e1a3d3478d07477e1b" candidate_uuid: "0d785ebc2e574f798114b8ff33c2453b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6"
I20260709 12:21:34.510236   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc01685a7b7344e1a3d3478d07477e1b" candidate_uuid: "0d785ebc2e574f798114b8ff33c2453b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e14b24a153b346e4b7066b58c49aca20"
I20260709 12:21:34.510661   619 raft_consensus.cc:3060] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.510893   693 raft_consensus.cc:3060] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:34.517432   693 raft_consensus.cc:2468] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d785ebc2e574f798114b8ff33c2453b in term 1.
I20260709 12:21:34.517735   619 raft_consensus.cc:2468] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d785ebc2e574f798114b8ff33c2453b in term 1.
I20260709 12:21:34.518893   506 leader_election.cc:304] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d785ebc2e574f798114b8ff33c2453b, e14b24a153b346e4b7066b58c49aca20; no voters: 
I20260709 12:21:34.519949   739 raft_consensus.cc:2804] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:34.520983   739 raft_consensus.cc:697] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 1 LEADER]: Becoming Leader. State: Replica: 0d785ebc2e574f798114b8ff33c2453b, State: Running, Role: LEADER
I20260709 12:21:34.521780   739 consensus_queue.cc:237] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.530194   439 catalog_manager.cc:5697] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193). New cstate: current_term: 1 leader_uuid: "0d785ebc2e574f798114b8ff33c2453b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.549563   743 consensus_queue.cc:1048] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.569586   747 consensus_queue.cc:1048] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.578622   619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1fcff22bb3ad46b4b420fed43525b9dc"
dest_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6"
mode: GRACEFUL
new_leader_uuid: "0d785ebc2e574f798114b8ff33c2453b"
 from {username='slave'} at 127.0.0.1:34250
I20260709 12:21:34.579262   619 raft_consensus.cc:606] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 LEADER]: Received request to transfer leadership to TS 0d785ebc2e574f798114b8ff33c2453b
I20260709 12:21:34.602063   693 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f000b3c270224a0bb4b7079ee212de61"
dest_uuid: "e14b24a153b346e4b7066b58c49aca20"
mode: GRACEFUL
new_leader_uuid: "0d785ebc2e574f798114b8ff33c2453b"
 from {username='slave'} at 127.0.0.1:48272
I20260709 12:21:34.602752   693 raft_consensus.cc:606] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 1 LEADER]: Received request to transfer leadership to TS 0d785ebc2e574f798114b8ff33c2453b
I20260709 12:21:34.729243   747 consensus_queue.cc:1048] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.743100   747 consensus_queue.cc:1048] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.754097   776 raft_consensus.cc:993] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6: : Instructing follower 0d785ebc2e574f798114b8ff33c2453b to start an election
I20260709 12:21:34.754835   776 raft_consensus.cc:1081] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 LEADER]: Signalling peer 0d785ebc2e574f798114b8ff33c2453b to start an election
I20260709 12:21:34.757285   543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1fcff22bb3ad46b4b420fed43525b9dc"
dest_uuid: "0d785ebc2e574f798114b8ff33c2453b"
 from {username='slave'} at 127.0.0.1:57540
I20260709 12:21:34.758014   543 raft_consensus.cc:493] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:34.758394   543 raft_consensus.cc:3060] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.764991   543 raft_consensus.cc:515] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:34.768499   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcff22bb3ad46b4b420fed43525b9dc" candidate_uuid: "0d785ebc2e574f798114b8ff33c2453b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e14b24a153b346e4b7066b58c49aca20"
I20260709 12:21:34.769480   543 leader_election.cc:290] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [CANDIDATE]: Term 2 election: Requested vote from peers e14b24a153b346e4b7066b58c49aca20 (127.22.93.195:44599), df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194:38599)
I20260709 12:21:34.769335   693 raft_consensus.cc:3060] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.770788   619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fcff22bb3ad46b4b420fed43525b9dc" candidate_uuid: "0d785ebc2e574f798114b8ff33c2453b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6"
I20260709 12:21:34.771615   619 raft_consensus.cc:3055] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:34.771972   619 raft_consensus.cc:740] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df0a2e5df1eb4246b9e60ade7c05d1d6, State: Running, Role: LEADER
I20260709 12:21:34.773021   619 consensus_queue.cc:260] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:34.774507   619 raft_consensus.cc:3060] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.777832   693 raft_consensus.cc:2468] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d785ebc2e574f798114b8ff33c2453b in term 2.
I20260709 12:21:34.779165   506 leader_election.cc:304] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d785ebc2e574f798114b8ff33c2453b, e14b24a153b346e4b7066b58c49aca20; no voters: 
I20260709 12:21:34.779990   739 raft_consensus.cc:2804] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:34.780459   739 raft_consensus.cc:697] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 2 LEADER]: Becoming Leader. State: Replica: 0d785ebc2e574f798114b8ff33c2453b, State: Running, Role: LEADER
I20260709 12:21:34.780671   619 raft_consensus.cc:2468] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d785ebc2e574f798114b8ff33c2453b in term 2.
I20260709 12:21:34.781371   739 consensus_queue.cc:237] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } }
I20260709 12:21:34.788635   440 catalog_manager.cc:5697] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b reported cstate change: term changed from 1 to 2, leader changed from df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194) to 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193). New cstate: current_term: 2 leader_uuid: "0d785ebc2e574f798114b8ff33c2453b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:34.863482   741 consensus_queue.cc:1048] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:34.871184   763 raft_consensus.cc:993] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20: : Instructing follower 0d785ebc2e574f798114b8ff33c2453b to start an election
I20260709 12:21:34.871979   741 raft_consensus.cc:1081] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 1 LEADER]: Signalling peer 0d785ebc2e574f798114b8ff33c2453b to start an election
I20260709 12:21:34.876211   543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f000b3c270224a0bb4b7079ee212de61"
dest_uuid: "0d785ebc2e574f798114b8ff33c2453b"
 from {username='slave'} at 127.0.0.1:57556
I20260709 12:21:34.877017   543 raft_consensus.cc:493] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:34.877497   543 raft_consensus.cc:3060] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.878672   741 consensus_queue.cc:1048] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:34.888592   543 raft_consensus.cc:515] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.892331   619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f000b3c270224a0bb4b7079ee212de61" candidate_uuid: "0d785ebc2e574f798114b8ff33c2453b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6"
I20260709 12:21:34.892825   693 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f000b3c270224a0bb4b7079ee212de61" candidate_uuid: "0d785ebc2e574f798114b8ff33c2453b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e14b24a153b346e4b7066b58c49aca20"
I20260709 12:21:34.893657   693 raft_consensus.cc:3055] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:34.894037   693 raft_consensus.cc:740] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e14b24a153b346e4b7066b58c49aca20, State: Running, Role: LEADER
I20260709 12:21:34.892546   543 leader_election.cc:290] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [CANDIDATE]: Term 2 election: Requested vote from peers df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194:38599), e14b24a153b346e4b7066b58c49aca20 (127.22.93.195:44599)
I20260709 12:21:34.895042   693 consensus_queue.cc:260] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.896445   693 raft_consensus.cc:3060] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:34.905692   693 raft_consensus.cc:2468] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d785ebc2e574f798114b8ff33c2453b in term 2.
I20260709 12:21:34.907191   506 leader_election.cc:304] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d785ebc2e574f798114b8ff33c2453b, e14b24a153b346e4b7066b58c49aca20; no voters: df0a2e5df1eb4246b9e60ade7c05d1d6
I20260709 12:21:34.908231   739 raft_consensus.cc:2804] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:34.908798   739 raft_consensus.cc:697] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 2 LEADER]: Becoming Leader. State: Replica: 0d785ebc2e574f798114b8ff33c2453b, State: Running, Role: LEADER
I20260709 12:21:34.909649   739 consensus_queue.cc:237] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:34.917172   439 catalog_manager.cc:5697] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b reported cstate change: term changed from 1 to 2, leader changed from e14b24a153b346e4b7066b58c49aca20 (127.22.93.195) to 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193). New cstate: current_term: 2 leader_uuid: "0d785ebc2e574f798114b8ff33c2453b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:35.011149   739 consensus_queue.cc:1048] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:35.025271   739 consensus_queue.cc:1048] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:35.070695 22903 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:21:35.072427 22903 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:21:35.072800 22903 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:21:35.086304   543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc01685a7b7344e1a3d3478d07477e1b"
dest_uuid: "0d785ebc2e574f798114b8ff33c2453b"
mode: GRACEFUL
new_leader_uuid: "e14b24a153b346e4b7066b58c49aca20"
 from {username='slave'} at 127.0.0.1:57572
I20260709 12:21:35.086882   543 raft_consensus.cc:606] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 1 LEADER]: Received request to transfer leadership to TS e14b24a153b346e4b7066b58c49aca20
I20260709 12:21:35.088248 22903 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:21:35.234040   618 raft_consensus.cc:1275] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Refusing update from remote peer 0d785ebc2e574f798114b8ff33c2453b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.235656   739 consensus_queue.cc:1048] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.244711   693 raft_consensus.cc:1275] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Refusing update from remote peer 0d785ebc2e574f798114b8ff33c2453b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.247423   783 consensus_queue.cc:1048] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.296005   693 raft_consensus.cc:1275] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Refusing update from remote peer 0d785ebc2e574f798114b8ff33c2453b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.297798   783 consensus_queue.cc:1048] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:35.308214   618 raft_consensus.cc:3060] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.317270   618 raft_consensus.cc:1275] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Refusing update from remote peer 0d785ebc2e574f798114b8ff33c2453b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:35.318862   739 consensus_queue.cc:1048] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:35.649072   767 raft_consensus.cc:993] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b: : Instructing follower e14b24a153b346e4b7066b58c49aca20 to start an election
I20260709 12:21:35.649714   739 raft_consensus.cc:1081] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 1 LEADER]: Signalling peer e14b24a153b346e4b7066b58c49aca20 to start an election
I20260709 12:21:35.651513   693 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc01685a7b7344e1a3d3478d07477e1b"
dest_uuid: "e14b24a153b346e4b7066b58c49aca20"
 from {username='slave'} at 127.0.0.1:48256
I20260709 12:21:35.652382   693 raft_consensus.cc:493] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:35.652804   693 raft_consensus.cc:3060] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.659329   693 raft_consensus.cc:515] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:35.661162   693 leader_election.cc:290] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [CANDIDATE]: Term 2 election: Requested vote from peers 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193:34697), df0a2e5df1eb4246b9e60ade7c05d1d6 (127.22.93.194:38599)
I20260709 12:21:35.662297   543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc01685a7b7344e1a3d3478d07477e1b" candidate_uuid: "e14b24a153b346e4b7066b58c49aca20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d785ebc2e574f798114b8ff33c2453b"
I20260709 12:21:35.662312   618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc01685a7b7344e1a3d3478d07477e1b" candidate_uuid: "e14b24a153b346e4b7066b58c49aca20" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6"
I20260709 12:21:35.663247   543 raft_consensus.cc:3055] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:35.663336   618 raft_consensus.cc:3060] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.663601   543 raft_consensus.cc:740] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d785ebc2e574f798114b8ff33c2453b, State: Running, Role: LEADER
I20260709 12:21:35.664544   543 consensus_queue.cc:260] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:35.665836   543 raft_consensus.cc:3060] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:35.670163   618 raft_consensus.cc:2468] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e14b24a153b346e4b7066b58c49aca20 in term 2.
I20260709 12:21:35.671657   659 leader_election.cc:304] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df0a2e5df1eb4246b9e60ade7c05d1d6, e14b24a153b346e4b7066b58c49aca20; no voters: 
I20260709 12:21:35.672290   543 raft_consensus.cc:2468] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e14b24a153b346e4b7066b58c49aca20 in term 2.
I20260709 12:21:35.672528   763 raft_consensus.cc:2804] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:35.673838   763 raft_consensus.cc:697] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 2 LEADER]: Becoming Leader. State: Replica: e14b24a153b346e4b7066b58c49aca20, State: Running, Role: LEADER
I20260709 12:21:35.674793   763 consensus_queue.cc:237] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } }
I20260709 12:21:35.681901   440 catalog_manager.cc:5697] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 reported cstate change: term changed from 1 to 2, leader changed from 0d785ebc2e574f798114b8ff33c2453b (127.22.93.193) to e14b24a153b346e4b7066b58c49aca20 (127.22.93.195). New cstate: current_term: 2 leader_uuid: "e14b24a153b346e4b7066b58c49aca20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d785ebc2e574f798114b8ff33c2453b" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 34697 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df0a2e5df1eb4246b9e60ade7c05d1d6" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 38599 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e14b24a153b346e4b7066b58c49aca20" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 44599 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:35.724995 22903 tablet_server.cc:179] TabletServer@127.22.93.193:0 shutting down...
I20260709 12:21:35.746443 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:35.747222 22903 tablet_replica.cc:333] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b: stopping tablet replica
I20260709 12:21:35.747853 22903 raft_consensus.cc:2243] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:35.748286 22903 raft_consensus.cc:2272] T cc01685a7b7344e1a3d3478d07477e1b P 0d785ebc2e574f798114b8ff33c2453b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.750737 22903 tablet_replica.cc:333] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b: stopping tablet replica
I20260709 12:21:35.751382 22903 raft_consensus.cc:2243] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:35.751817 22903 raft_consensus.cc:2272] T 13dfe845a22f4606898baf0ed2163d0c P 0d785ebc2e574f798114b8ff33c2453b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.753922 22903 tablet_replica.cc:333] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b: stopping tablet replica
I20260709 12:21:35.754402 22903 raft_consensus.cc:2243] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:35.755374 22903 raft_consensus.cc:2272] T f000b3c270224a0bb4b7079ee212de61 P 0d785ebc2e574f798114b8ff33c2453b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.758438 22903 tablet_replica.cc:333] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b: stopping tablet replica
I20260709 12:21:35.758955 22903 raft_consensus.cc:2243] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:35.759963 22903 raft_consensus.cc:2272] T 1fcff22bb3ad46b4b420fed43525b9dc P 0d785ebc2e574f798114b8ff33c2453b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.777019 22903 tablet_server.cc:196] TabletServer@127.22.93.193:0 shutdown complete.
I20260709 12:21:35.793520 22903 tablet_server.cc:179] TabletServer@127.22.93.194:0 shutting down...
I20260709 12:21:35.817117 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:35.818181 22903 tablet_replica.cc:333] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6: stopping tablet replica
I20260709 12:21:35.819165 22903 raft_consensus.cc:2243] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:35.819932 22903 raft_consensus.cc:2272] T cc01685a7b7344e1a3d3478d07477e1b P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.823561 22903 tablet_replica.cc:333] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6: stopping tablet replica
I20260709 12:21:35.824143 22903 raft_consensus.cc:2243] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:35.825109 22903 raft_consensus.cc:2272] T 13dfe845a22f4606898baf0ed2163d0c P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.827494 22903 tablet_replica.cc:333] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6: stopping tablet replica
I20260709 12:21:35.828048 22903 raft_consensus.cc:2243] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:35.828495 22903 raft_consensus.cc:2272] T f000b3c270224a0bb4b7079ee212de61 P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.831137 22903 tablet_replica.cc:333] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6: stopping tablet replica
I20260709 12:21:35.831646 22903 raft_consensus.cc:2243] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:35.832122 22903 raft_consensus.cc:2272] T 1fcff22bb3ad46b4b420fed43525b9dc P df0a2e5df1eb4246b9e60ade7c05d1d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.857283 22903 tablet_server.cc:196] TabletServer@127.22.93.194:0 shutdown complete.
I20260709 12:21:35.874735 22903 tablet_server.cc:179] TabletServer@127.22.93.195:0 shutting down...
I20260709 12:21:35.896127 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:35.896912 22903 tablet_replica.cc:333] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20: stopping tablet replica
I20260709 12:21:35.897585 22903 raft_consensus.cc:2243] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:35.898365 22903 pending_rounds.cc:70] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20: Trying to abort 1 pending ops.
I20260709 12:21:35.898579 22903 pending_rounds.cc:77] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305624353492541440 op_type: NO_OP noop_request { }
I20260709 12:21:35.898931 22903 raft_consensus.cc:2889] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:21:35.899326 22903 raft_consensus.cc:2272] T cc01685a7b7344e1a3d3478d07477e1b P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.902046 22903 tablet_replica.cc:333] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20: stopping tablet replica
I20260709 12:21:35.902660 22903 raft_consensus.cc:2243] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:35.903252 22903 raft_consensus.cc:2272] T f000b3c270224a0bb4b7079ee212de61 P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.905696 22903 tablet_replica.cc:333] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20: stopping tablet replica
I20260709 12:21:35.906256 22903 raft_consensus.cc:2243] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:35.906718 22903 raft_consensus.cc:2272] T 1fcff22bb3ad46b4b420fed43525b9dc P e14b24a153b346e4b7066b58c49aca20 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.909202 22903 tablet_replica.cc:333] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20: stopping tablet replica
I20260709 12:21:35.909719 22903 raft_consensus.cc:2243] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:35.910172 22903 raft_consensus.cc:2272] T 13dfe845a22f4606898baf0ed2163d0c P e14b24a153b346e4b7066b58c49aca20 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.934614 22903 tablet_server.cc:196] TabletServer@127.22.93.195:0 shutdown complete.
I20260709 12:21:35.951858 22903 master.cc:562] Master@127.22.93.254:39291 shutting down...
I20260709 12:21:35.971228 22903 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:35.971910 22903 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:35.972213 22903 tablet_replica.cc:333] T 00000000000000000000000000000000 P 56ee1ffe4b214bf6978d8968aac3674e: stopping tablet replica
I20260709 12:21:35.992254 22903 master.cc:584] Master@127.22.93.254:39291 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2865 ms)
[----------] 6 tests from LeaderRebalancerTest (347006 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:21:36.029173 22903 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.93.254:42943
I20260709 12:21:36.030524 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:36.036257   791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:36.036335   792 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:36.039719   794 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:36.041446 22903 server_base.cc:1061] running on GCE node
I20260709 12:21:36.042622 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:36.042919 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:36.043527 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599696043497 us; error 0 us; skew 500 ppm
I20260709 12:21:36.044162 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:36.046877 22903 webserver.cc:533] Webserver started at http://127.22.93.254:44877/ using document root <none> and password file <none>
I20260709 12:21:36.047482 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:36.047698 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:36.048023 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:36.049301 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/master-0-root/instance:
uuid: "560adb8f4a234dfbb0caa1b15f18758f"
format_stamp: "Formatted at 2026-07-09 12:21:36 on dist-test-slave-k289"
I20260709 12:21:36.054746 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:21:36.058821   799 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:36.059809 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:36.060087 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/master-0-root
uuid: "560adb8f4a234dfbb0caa1b15f18758f"
format_stamp: "Formatted at 2026-07-09 12:21:36 on dist-test-slave-k289"
I20260709 12:21:36.060405 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:36.077193 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:36.078383 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:36.121994 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.254:42943
I20260709 12:21:36.122123   850 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.254:42943 every 8 connection(s)
I20260709 12:21:36.126725   851 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.141160   851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f: Bootstrap starting.
I20260709 12:21:36.147310   851 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.152565   851 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f: No bootstrap required, opened a new log
I20260709 12:21:36.155331   851 raft_consensus.cc:359] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560adb8f4a234dfbb0caa1b15f18758f" member_type: VOTER }
I20260709 12:21:36.155791   851 raft_consensus.cc:385] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.155993   851 raft_consensus.cc:740] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 560adb8f4a234dfbb0caa1b15f18758f, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.156597   851 consensus_queue.cc:260] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560adb8f4a234dfbb0caa1b15f18758f" member_type: VOTER }
I20260709 12:21:36.157074   851 raft_consensus.cc:399] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:21:36.157277   851 raft_consensus.cc:493] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:21:36.157500   851 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:36.164322   851 raft_consensus.cc:515] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560adb8f4a234dfbb0caa1b15f18758f" member_type: VOTER }
I20260709 12:21:36.164911   851 leader_election.cc:304] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 560adb8f4a234dfbb0caa1b15f18758f; no voters: 
I20260709 12:21:36.166209   851 leader_election.cc:290] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:21:36.166718   854 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:36.168462   854 raft_consensus.cc:697] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 1 LEADER]: Becoming Leader. State: Replica: 560adb8f4a234dfbb0caa1b15f18758f, State: Running, Role: LEADER
I20260709 12:21:36.169243   854 consensus_queue.cc:237] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560adb8f4a234dfbb0caa1b15f18758f" member_type: VOTER }
I20260709 12:21:36.169731   851 sys_catalog.cc:565] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:21:36.172487   855 sys_catalog.cc:455] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "560adb8f4a234dfbb0caa1b15f18758f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560adb8f4a234dfbb0caa1b15f18758f" member_type: VOTER } }
I20260709 12:21:36.172503   856 sys_catalog.cc:455] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 560adb8f4a234dfbb0caa1b15f18758f. Latest consensus state: current_term: 1 leader_uuid: "560adb8f4a234dfbb0caa1b15f18758f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "560adb8f4a234dfbb0caa1b15f18758f" member_type: VOTER } }
I20260709 12:21:36.173406   855 sys_catalog.cc:458] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:36.173453   856 sys_catalog.cc:458] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [sys.catalog]: This master's current role is: LEADER
I20260709 12:21:36.177121   859 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:21:36.184460   859 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:21:36.187340 22903 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:21:36.195750   859 catalog_manager.cc:1383] Generated new cluster ID: d77feb5f0e304cf4b9a938fb101d8308
I20260709 12:21:36.196147   859 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:21:36.219375   859 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:21:36.220954   859 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:21:36.238900   859 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f: Generated new TSK 0
I20260709 12:21:36.239637   859 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:21:36.254665 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:36.262249   872 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:36.264139   873 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:36.268385   875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:36.269011 22903 server_base.cc:1061] running on GCE node
I20260709 12:21:36.270177 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:36.270416 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:36.270584 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599696270567 us; error 0 us; skew 500 ppm
I20260709 12:21:36.271368 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:36.274251 22903 webserver.cc:533] Webserver started at http://127.22.93.193:41049/ using document root <none> and password file <none>
I20260709 12:21:36.274881 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:36.275173 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:36.275482 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:36.276839 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-0-root/instance:
uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
format_stamp: "Formatted at 2026-07-09 12:21:36 on dist-test-slave-k289"
I20260709 12:21:36.282281 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.002s	sys 0.004s
I20260709 12:21:36.286324   880 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:36.287298 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:21:36.287636 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
format_stamp: "Formatted at 2026-07-09 12:21:36 on dist-test-slave-k289"
I20260709 12:21:36.287961 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:36.303673 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:36.305187 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:36.307206 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:36.310370 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:36.310685 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:36.311061 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:36.311291 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:36.359572 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:39723
I20260709 12:21:36.359709   943 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:39723 every 8 connection(s)
I20260709 12:21:36.365734 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:36.373858   948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:36.375412   949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:36.378585 22903 server_base.cc:1061] running on GCE node
W20260709 12:21:36.378963   951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:36.380270 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:36.380594 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:36.380843 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599696380818 us; error 0 us; skew 500 ppm
I20260709 12:21:36.381696 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:36.383549   944 heartbeater.cc:344] Connected to a master server at 127.22.93.254:42943
I20260709 12:21:36.383972   944 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:36.384909 22903 webserver.cc:533] Webserver started at http://127.22.93.194:35209/ using document root <none> and password file <none>
I20260709 12:21:36.384979   944 heartbeater.cc:507] Master 127.22.93.254:42943 requested a full tablet report, sending...
I20260709 12:21:36.385638 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:36.385903 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:36.386201 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:36.387593 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-1-root/instance:
uuid: "f5712394ef194d8ba6adaac56b28fa4e"
format_stamp: "Formatted at 2026-07-09 12:21:36 on dist-test-slave-k289"
I20260709 12:21:36.387617   816 ts_manager.cc:194] Registered new tserver with Master: 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723)
I20260709 12:21:36.390023   816 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42684
I20260709 12:21:36.393486 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:21:36.397578   956 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:36.398542 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:21:36.399058 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-1-root
uuid: "f5712394ef194d8ba6adaac56b28fa4e"
format_stamp: "Formatted at 2026-07-09 12:21:36 on dist-test-slave-k289"
I20260709 12:21:36.399394 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:36.431587 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:36.433023 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:36.434825 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:36.437474 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:36.437733 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:36.438000 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:36.438189 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:36.485240 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.194:44963
I20260709 12:21:36.485417  1019 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.194:44963 every 8 connection(s)
I20260709 12:21:36.491667 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:21:36.501806  1024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:36.502113  1023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:21:36.503942  1026 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:21:36.505892 22903 server_base.cc:1061] running on GCE node
I20260709 12:21:36.507200  1020 heartbeater.cc:344] Connected to a master server at 127.22.93.254:42943
I20260709 12:21:36.507275 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:21:36.507896 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:21:36.507921  1020 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:36.508119 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599696508097 us; error 0 us; skew 500 ppm
I20260709 12:21:36.508908 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:21:36.508965  1020 heartbeater.cc:507] Master 127.22.93.254:42943 requested a full tablet report, sending...
I20260709 12:21:36.511585   816 ts_manager.cc:194] Registered new tserver with Master: f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:36.511974 22903 webserver.cc:533] Webserver started at http://127.22.93.195:33839/ using document root <none> and password file <none>
I20260709 12:21:36.512722 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:21:36.513003 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:21:36.513375 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:21:36.513967   816 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42692
I20260709 12:21:36.515123 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-2-root/instance:
uuid: "c19b58e8347a467c879323371e5dd5ab"
format_stamp: "Formatted at 2026-07-09 12:21:36 on dist-test-slave-k289"
I20260709 12:21:36.520172 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:21:36.523948  1031 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:36.524791 22903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:21:36.525148 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-2-root
uuid: "c19b58e8347a467c879323371e5dd5ab"
format_stamp: "Formatted at 2026-07-09 12:21:36 on dist-test-slave-k289"
I20260709 12:21:36.525477 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599348838328-22903-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:21:36.537263 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:21:36.538507 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:21:36.540215 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:21:36.542809 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:21:36.543071 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:21:36.543330 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:21:36.543520 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:21:36.590348 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.195:33009
I20260709 12:21:36.590473  1094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.195:33009 every 8 connection(s)
I20260709 12:21:36.606215  1095 heartbeater.cc:344] Connected to a master server at 127.22.93.254:42943
I20260709 12:21:36.606896  1095 heartbeater.cc:461] Registering TS with master...
I20260709 12:21:36.607985  1095 heartbeater.cc:507] Master 127.22.93.254:42943 requested a full tablet report, sending...
I20260709 12:21:36.610414   816 ts_manager.cc:194] Registered new tserver with Master: c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:36.611456 22903 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017457799s
I20260709 12:21:36.612342   816 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:42698
I20260709 12:21:36.640931   816 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42706:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:36.643850   816 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:36.724877   985 tablet_service.cc:1511] Processing CreateTablet for tablet 6b255c0161ac417f86b28a02128d76ac (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:36.726651   985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b255c0161ac417f86b28a02128d76ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.728111   984 tablet_service.cc:1511] Processing CreateTablet for tablet 409b316683f64710987a63f1b0d59c29 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:36.729842   984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409b316683f64710987a63f1b0d59c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.732707   982 tablet_service.cc:1511] Processing CreateTablet for tablet 2825dc6215ba4dbabc40347a2dc07e71 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:36.734326   982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2825dc6215ba4dbabc40347a2dc07e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.726372   983 tablet_service.cc:1511] Processing CreateTablet for tablet 77a6e57991ee4fb6a9016fcf046157a8 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:36.735796   983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a6e57991ee4fb6a9016fcf046157a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.739593   981 tablet_service.cc:1511] Processing CreateTablet for tablet 86865ed63f8c4ca39416ce03553ddb06 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:36.741360   981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86865ed63f8c4ca39416ce03553ddb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.747519  1056 tablet_service.cc:1511] Processing CreateTablet for tablet 86865ed63f8c4ca39416ce03553ddb06 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:36.748754  1057 tablet_service.cc:1511] Processing CreateTablet for tablet 2825dc6215ba4dbabc40347a2dc07e71 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:36.749301  1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86865ed63f8c4ca39416ce03553ddb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.750329  1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2825dc6215ba4dbabc40347a2dc07e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.752161  1059 tablet_service.cc:1511] Processing CreateTablet for tablet 409b316683f64710987a63f1b0d59c29 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:36.753782  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409b316683f64710987a63f1b0d59c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.747606  1058 tablet_service.cc:1511] Processing CreateTablet for tablet 77a6e57991ee4fb6a9016fcf046157a8 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:36.756669  1058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a6e57991ee4fb6a9016fcf046157a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.745944  1060 tablet_service.cc:1511] Processing CreateTablet for tablet 6b255c0161ac417f86b28a02128d76ac (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:36.760455  1060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b255c0161ac417f86b28a02128d76ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.770253   909 tablet_service.cc:1511] Processing CreateTablet for tablet 6b255c0161ac417f86b28a02128d76ac (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:36.776715   909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b255c0161ac417f86b28a02128d76ac. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.772326   904 tablet_service.cc:1511] Processing CreateTablet for tablet d6f35bf354154fdbb42a985e604caeae (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:36.780011   904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f35bf354154fdbb42a985e604caeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.772787   907 tablet_service.cc:1511] Processing CreateTablet for tablet 77a6e57991ee4fb6a9016fcf046157a8 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:36.773928   908 tablet_service.cc:1511] Processing CreateTablet for tablet 409b316683f64710987a63f1b0d59c29 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:36.774760   906 tablet_service.cc:1511] Processing CreateTablet for tablet 2825dc6215ba4dbabc40347a2dc07e71 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:36.782415   907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 77a6e57991ee4fb6a9016fcf046157a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.770063   905 tablet_service.cc:1511] Processing CreateTablet for tablet 86865ed63f8c4ca39416ce03553ddb06 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:36.786441   905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86865ed63f8c4ca39416ce03553ddb06. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.789885   908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 409b316683f64710987a63f1b0d59c29. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.795463   906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2825dc6215ba4dbabc40347a2dc07e71. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.799432   980 tablet_service.cc:1511] Processing CreateTablet for tablet d6f35bf354154fdbb42a985e604caeae (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:36.801283   980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f35bf354154fdbb42a985e604caeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.828653  1055 tablet_service.cc:1511] Processing CreateTablet for tablet d6f35bf354154fdbb42a985e604caeae (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:36.830703  1055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6f35bf354154fdbb42a985e604caeae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.844440   903 tablet_service.cc:1511] Processing CreateTablet for tablet 377a838bf8d1412392608e242715efae (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:36.846323   903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377a838bf8d1412392608e242715efae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.855230  1110 tablet_bootstrap.cc:492] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:36.864835   983 tablet_service.cc:1511] Processing CreateTablet for tablet 377a838bf8d1412392608e242715efae (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:36.866698   983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377a838bf8d1412392608e242715efae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.873431  1110 tablet_bootstrap.cc:654] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.899695  1111 tablet_bootstrap.cc:492] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:36.908043  1113 tablet_bootstrap.cc:492] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:36.911600  1058 tablet_service.cc:1511] Processing CreateTablet for tablet 377a838bf8d1412392608e242715efae (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:36.913440  1058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 377a838bf8d1412392608e242715efae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.923408  1110 tablet_bootstrap.cc:492] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:36.924223  1110 ts_tablet_manager.cc:1403] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.069s	user 0.016s	sys 0.011s
I20260709 12:21:36.928198  1110 raft_consensus.cc:359] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:36.929100  1110 raft_consensus.cc:385] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:36.929409  1110 raft_consensus.cc:740] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:36.930284  1110 consensus_queue.cc:260] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:36.931054   984 tablet_service.cc:1511] Processing CreateTablet for tablet 10b9abcde196419887e519c187dddab0 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:36.932770   984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b9abcde196419887e519c187dddab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.936338  1060 tablet_service.cc:1511] Processing CreateTablet for tablet 10b9abcde196419887e519c187dddab0 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:36.938014  1060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b9abcde196419887e519c187dddab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.938289  1111 tablet_bootstrap.cc:654] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.943709  1113 tablet_bootstrap.cc:654] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:36.960664   908 tablet_service.cc:1511] Processing CreateTablet for tablet 10b9abcde196419887e519c187dddab0 (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:36.961153   904 tablet_service.cc:1511] Processing CreateTablet for tablet 97f350d455504dc2826ae3aa23d3aaab (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:36.962486   908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10b9abcde196419887e519c187dddab0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.963205   904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f350d455504dc2826ae3aa23d3aaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:36.982488   982 tablet_service.cc:1511] Processing CreateTablet for tablet 97f350d455504dc2826ae3aa23d3aaab (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:36.986366   982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f350d455504dc2826ae3aa23d3aaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.009521  1095 heartbeater.cc:499] Master 127.22.93.254:42943 was elected leader, sending a full tablet report...
I20260709 12:21:37.010195  1110 ts_tablet_manager.cc:1434] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.086s	user 0.035s	sys 0.048s
I20260709 12:21:37.011541  1110 tablet_bootstrap.cc:492] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:37.011968  1114 raft_consensus.cc:493] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.012606  1114 raft_consensus.cc:515] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.007627  1060 tablet_service.cc:1511] Processing CreateTablet for tablet 97f350d455504dc2826ae3aa23d3aaab (DEFAULT_TABLE table=test-workload [id=721e06e0f6ee446ca6117e58a2fe4e65]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:37.018137  1060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97f350d455504dc2826ae3aa23d3aaab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:37.019138  1114 leader_election.cc:290] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:37.027721  1113 tablet_bootstrap.cc:492] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:37.028510  1113 ts_tablet_manager.cc:1403] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.121s	user 0.022s	sys 0.020s
I20260709 12:21:37.030565  1110 tablet_bootstrap.cc:654] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.032387  1113 raft_consensus.cc:359] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.033365  1113 raft_consensus.cc:385] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.033735  1113 raft_consensus.cc:740] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.034885  1113 consensus_queue.cc:260] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.040956   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
W20260709 12:21:37.043238  1034 leader_election.cc:343] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.045512   944 heartbeater.cc:499] Master 127.22.93.254:42943 was elected leader, sending a full tablet report...
I20260709 12:21:37.051717   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
W20260709 12:21:37.057653  1033 leader_election.cc:343] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.058248  1033 leader_election.cc:304] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab; no voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:37.059690  1114 raft_consensus.cc:2749] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.063239  1111 tablet_bootstrap.cc:492] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:37.064044  1111 ts_tablet_manager.cc:1403] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.167s	user 0.020s	sys 0.015s
I20260709 12:21:37.067941  1111 raft_consensus.cc:359] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.068854  1111 raft_consensus.cc:385] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.069202  1111 raft_consensus.cc:740] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.063273  1113 ts_tablet_manager.cc:1434] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.002s
I20260709 12:21:37.071367  1113 tablet_bootstrap.cc:492] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:37.079087  1119 raft_consensus.cc:493] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.079896  1119 raft_consensus.cc:515] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.080410  1111 consensus_queue.cc:260] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.079455  1113 tablet_bootstrap.cc:654] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.089304  1119 leader_election.cc:290] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.090193  1110 tablet_bootstrap.cc:492] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:37.091130  1110 ts_tablet_manager.cc:1403] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.080s	user 0.030s	sys 0.034s
I20260709 12:21:37.096657  1110 raft_consensus.cc:359] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.097867  1110 raft_consensus.cc:385] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.098338  1110 raft_consensus.cc:740] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.099713  1110 consensus_queue.cc:260] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.103551  1110 ts_tablet_manager.cc:1434] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.004s
I20260709 12:21:37.105294  1110 tablet_bootstrap.cc:492] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:37.117715  1110 tablet_bootstrap.cc:654] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.137085  1020 heartbeater.cc:499] Master 127.22.93.254:42943 was elected leader, sending a full tablet report...
I20260709 12:21:37.137563  1111 ts_tablet_manager.cc:1434] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.073s	user 0.027s	sys 0.025s
I20260709 12:21:37.139005  1111 tablet_bootstrap.cc:492] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:37.146740  1111 tablet_bootstrap.cc:654] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.153956  1111 tablet_bootstrap.cc:492] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:37.154594  1111 ts_tablet_manager.cc:1403] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.016s	user 0.003s	sys 0.010s
I20260709 12:21:37.157104  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6e57991ee4fb6a9016fcf046157a8" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:37.158337  1113 tablet_bootstrap.cc:492] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:37.157991  1111 raft_consensus.cc:359] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.158457   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6e57991ee4fb6a9016fcf046157a8" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:37.158969  1111 raft_consensus.cc:385] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.159157  1113 ts_tablet_manager.cc:1403] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.088s	user 0.009s	sys 0.025s
I20260709 12:21:37.159365  1111 raft_consensus.cc:740] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.159895  1110 tablet_bootstrap.cc:492] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:37.158027  1070 raft_consensus.cc:2468] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:37.160492  1110 ts_tablet_manager.cc:1403] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.056s	user 0.010s	sys 0.006s
I20260709 12:21:37.160339  1111 consensus_queue.cc:260] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.162109   883 leader_election.cc:304] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:37.163182  1119 raft_consensus.cc:2804] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:21:37.163317   883 leader_election.cc:343] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.163642  1119 raft_consensus.cc:493] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.164147  1119 raft_consensus.cc:3060] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.164783  1110 raft_consensus.cc:359] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.165624  1110 raft_consensus.cc:385] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.165918  1110 raft_consensus.cc:740] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.166806  1110 consensus_queue.cc:260] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.169677  1110 ts_tablet_manager.cc:1434] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:37.170862  1110 tablet_bootstrap.cc:492] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:37.171931  1111 ts_tablet_manager.cc:1434] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.002s
I20260709 12:21:37.173228  1111 tablet_bootstrap.cc:492] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:37.175087  1113 raft_consensus.cc:359] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.176002  1113 raft_consensus.cc:385] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.176302  1113 raft_consensus.cc:740] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.179368  1110 tablet_bootstrap.cc:654] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:37.182426   864 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:37.183336  1113 consensus_queue.cc:260] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.185467  1119 raft_consensus.cc:515] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.181285  1111 tablet_bootstrap.cc:654] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.189857   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6e57991ee4fb6a9016fcf046157a8" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:37.192169  1110 tablet_bootstrap.cc:492] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:37.192982  1110 ts_tablet_manager.cc:1403] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.011s
W20260709 12:21:37.197185   883 leader_election.cc:343] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.199811  1113 ts_tablet_manager.cc:1434] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.040s	user 0.014s	sys 0.003s
I20260709 12:21:37.200156  1110 raft_consensus.cc:359] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.200726  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6e57991ee4fb6a9016fcf046157a8" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:37.201143  1110 raft_consensus.cc:385] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.201479  1070 raft_consensus.cc:3060] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.201642  1113 tablet_bootstrap.cc:492] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:37.201488  1110 raft_consensus.cc:740] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.203075  1110 consensus_queue.cc:260] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.205754  1110 ts_tablet_manager.cc:1434] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 12:21:37.207060  1110 tablet_bootstrap.cc:492] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:37.210366  1111 tablet_bootstrap.cc:492] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:37.211122  1111 ts_tablet_manager.cc:1403] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.001s
I20260709 12:21:37.211536  1113 tablet_bootstrap.cc:654] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.214533  1110 tablet_bootstrap.cc:654] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.221074  1070 raft_consensus.cc:2468] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 1.
I20260709 12:21:37.223121  1119 leader_election.cc:290] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.214601  1111 raft_consensus.cc:359] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.224067  1111 raft_consensus.cc:385] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.224438  1111 raft_consensus.cc:740] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.225514  1111 consensus_queue.cc:260] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.228626  1111 ts_tablet_manager.cc:1434] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:21:37.229925  1111 tablet_bootstrap.cc:492] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:37.238727  1113 tablet_bootstrap.cc:492] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:37.239538  1113 ts_tablet_manager.cc:1403] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.027s
I20260709 12:21:37.239866  1111 tablet_bootstrap.cc:654] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.240096   883 leader_election.cc:304] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:37.241189  1119 raft_consensus.cc:2804] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.241734  1119 raft_consensus.cc:697] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:37.242714  1119 consensus_queue.cc:237] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.252027  1113 raft_consensus.cc:359] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.253237  1113 raft_consensus.cc:385] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.253588  1113 raft_consensus.cc:740] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.254577  1113 consensus_queue.cc:260] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.256079  1110 tablet_bootstrap.cc:492] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:37.256831  1110 ts_tablet_manager.cc:1403] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.022s
I20260709 12:21:37.256915  1113 ts_tablet_manager.cc:1434] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:21:37.258512  1113 tablet_bootstrap.cc:492] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:37.256821  1111 tablet_bootstrap.cc:492] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:37.259262  1111 ts_tablet_manager.cc:1403] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.007s
I20260709 12:21:37.262066  1110 raft_consensus.cc:359] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.263105  1110 raft_consensus.cc:385] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.263437  1110 raft_consensus.cc:740] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.264506  1110 consensus_queue.cc:260] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.267220  1119 raft_consensus.cc:493] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.267745  1113 tablet_bootstrap.cc:654] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.266829   815 catalog_manager.cc:5697] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 1 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.267841  1119 raft_consensus.cc:515] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.271754   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b255c0161ac417f86b28a02128d76ac" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:37.272670   995 raft_consensus.cc:2468] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:37.274142   883 leader_election.cc:304] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:37.275352  1127 raft_consensus.cc:2804] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.275821  1127 raft_consensus.cc:493] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.276178  1127 raft_consensus.cc:3060] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.276229  1110 ts_tablet_manager.cc:1434] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 12:21:37.284209  1119 leader_election.cc:290] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.285259  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b255c0161ac417f86b28a02128d76ac" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:37.286538  1110 tablet_bootstrap.cc:492] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:37.286444  1070 raft_consensus.cc:2468] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:37.290203  1111 raft_consensus.cc:359] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.291172  1111 raft_consensus.cc:385] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.291549  1111 raft_consensus.cc:740] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.292639  1111 consensus_queue.cc:260] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.295363  1111 ts_tablet_manager.cc:1434] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:21:37.296797  1111 tablet_bootstrap.cc:492] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:37.288494  1127 raft_consensus.cc:515] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.303678  1127 leader_election.cc:290] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.304030  1110 tablet_bootstrap.cc:654] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.305466  1113 tablet_bootstrap.cc:492] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:37.306301  1113 ts_tablet_manager.cc:1403] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.048s	user 0.039s	sys 0.004s
I20260709 12:21:37.306885   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b255c0161ac417f86b28a02128d76ac" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:37.307379  1111 tablet_bootstrap.cc:654] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.307777   995 raft_consensus.cc:3060] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.310312  1113 raft_consensus.cc:359] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.311369  1113 raft_consensus.cc:385] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.311772  1113 raft_consensus.cc:740] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.313199  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b255c0161ac417f86b28a02128d76ac" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:37.313125  1113 consensus_queue.cc:260] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.314073  1070 raft_consensus.cc:3060] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.317214  1113 ts_tablet_manager.cc:1434] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.005s
I20260709 12:21:37.321635  1113 tablet_bootstrap.cc:492] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:37.333029  1110 tablet_bootstrap.cc:492] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:37.333468  1113 tablet_bootstrap.cc:654] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.333788  1110 ts_tablet_manager.cc:1403] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.009s
I20260709 12:21:37.335733  1070 raft_consensus.cc:2468] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 1.
I20260709 12:21:37.337756   883 leader_election.cc:304] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:37.340476  1127 raft_consensus.cc:2804] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.341396  1127 raft_consensus.cc:697] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:37.342378  1127 consensus_queue.cc:237] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.342715  1110 raft_consensus.cc:359] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.343575  1110 raft_consensus.cc:385] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.343921  1110 raft_consensus.cc:740] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.349166  1113 tablet_bootstrap.cc:492] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:37.348887  1110 consensus_queue.cc:260] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.350067  1113 ts_tablet_manager.cc:1403] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.015s
I20260709 12:21:37.354950   995 raft_consensus.cc:2468] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 1.
I20260709 12:21:37.355192  1113 raft_consensus.cc:359] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.366710  1113 raft_consensus.cc:385] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.367082  1113 raft_consensus.cc:740] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.357390  1110 ts_tablet_manager.cc:1434] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:21:37.367938  1113 consensus_queue.cc:260] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.369554  1110 tablet_bootstrap.cc:492] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:37.371361  1127 raft_consensus.cc:493] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.372087  1127 raft_consensus.cc:515] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.374373  1127 leader_election.cc:290] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.377326   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:37.378152  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:37.379007  1070 raft_consensus.cc:2468] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:37.380465   883 leader_election.cc:304] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:37.380339   815 catalog_manager.cc:5697] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 1 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.378196   995 raft_consensus.cc:2468] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:37.383455  1127 raft_consensus.cc:2804] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.383916  1127 raft_consensus.cc:493] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.384299  1127 raft_consensus.cc:3060] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.388836  1110 tablet_bootstrap.cc:654] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.370913  1113 ts_tablet_manager.cc:1434] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.020s	user 0.011s	sys 0.000s
I20260709 12:21:37.390900  1113 tablet_bootstrap.cc:492] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:37.392578  1114 raft_consensus.cc:493] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.393744  1111 tablet_bootstrap.cc:492] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:37.393321  1114 raft_consensus.cc:515] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.394519  1111 ts_tablet_manager.cc:1403] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.098s	user 0.030s	sys 0.049s
I20260709 12:21:37.397730   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409b316683f64710987a63f1b0d59c29" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:37.398752   919 raft_consensus.cc:2468] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 0.
I20260709 12:21:37.398644  1111 raft_consensus.cc:359] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.400094  1111 raft_consensus.cc:385] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.400229  1114 leader_election.cc:290] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:37.400501  1111 raft_consensus.cc:740] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.401558  1033 leader_election.cc:304] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:37.401762  1111 consensus_queue.cc:260] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.402868   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409b316683f64710987a63f1b0d59c29" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
W20260709 12:21:37.404424  1034 leader_election.cc:343] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.405580  1114 raft_consensus.cc:2804] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.406057  1114 raft_consensus.cc:493] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.406461  1114 raft_consensus.cc:3060] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.406448  1127 raft_consensus.cc:515] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.408080  1111 ts_tablet_manager.cc:1434] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:21:37.411671  1111 tablet_bootstrap.cc:492] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:37.415462  1113 tablet_bootstrap.cc:654] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.410456  1110 tablet_bootstrap.cc:492] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:37.416320  1110 ts_tablet_manager.cc:1403] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.047s	user 0.021s	sys 0.001s
I20260709 12:21:37.419162   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:37.416987  1114 raft_consensus.cc:515] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.420063  1110 raft_consensus.cc:359] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.420636   995 raft_consensus.cc:3060] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.419670  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:37.421624  1070 raft_consensus.cc:3060] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.423935   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409b316683f64710987a63f1b0d59c29" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:37.424870   919 raft_consensus.cc:3060] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.417507  1127 leader_election.cc:290] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.429044  1110 raft_consensus.cc:385] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.431388  1110 raft_consensus.cc:740] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.431243   995 raft_consensus.cc:2468] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 1.
I20260709 12:21:37.431243  1070 raft_consensus.cc:2468] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 1.
I20260709 12:21:37.434756  1111 tablet_bootstrap.cc:654] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.436451  1110 consensus_queue.cc:260] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.437182   883 leader_election.cc:304] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:37.442797  1127 raft_consensus.cc:2804] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.443764  1127 raft_consensus.cc:697] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:37.444865  1127 consensus_queue.cc:237] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.450906  1114 leader_election.cc:290] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:37.452545   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409b316683f64710987a63f1b0d59c29" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:37.452630   919 raft_consensus.cc:2468] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 1.
I20260709 12:21:37.454972  1033 leader_election.cc:304] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:37.455960  1114 raft_consensus.cc:2804] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.456544  1114 raft_consensus.cc:697] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:37.457021  1110 ts_tablet_manager.cc:1434] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.040s	user 0.014s	sys 0.012s
I20260709 12:21:37.457554  1114 consensus_queue.cc:237] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.458451  1110 tablet_bootstrap.cc:492] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
W20260709 12:21:37.460592  1034 leader_election.cc:343] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.467366  1110 tablet_bootstrap.cc:654] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.469597  1111 tablet_bootstrap.cc:492] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:37.470378  1111 ts_tablet_manager.cc:1403] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.000s
I20260709 12:21:37.471352  1121 raft_consensus.cc:493] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.472182  1121 raft_consensus.cc:515] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.475592  1111 raft_consensus.cc:359] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.476656  1111 raft_consensus.cc:385] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.477031  1111 raft_consensus.cc:740] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.478010  1111 consensus_queue.cc:260] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.480814  1113 tablet_bootstrap.cc:492] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:37.480863  1110 tablet_bootstrap.cc:492] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:37.481711  1113 ts_tablet_manager.cc:1403] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.091s	user 0.021s	sys 0.017s
I20260709 12:21:37.481721  1110 ts_tablet_manager.cc:1403] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.011s
I20260709 12:21:37.482934  1121 leader_election.cc:290] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.485878  1113 raft_consensus.cc:359] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.488180   816 catalog_manager.cc:5697] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 1 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.486930  1113 raft_consensus.cc:385] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.489952  1113 raft_consensus.cc:740] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.491129  1113 consensus_queue.cc:260] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.499408  1113 ts_tablet_manager.cc:1434] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.006s
I20260709 12:21:37.488219  1110 raft_consensus.cc:359] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.500746  1113 tablet_bootstrap.cc:492] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:37.500531  1110 raft_consensus.cc:385] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.503625  1110 raft_consensus.cc:740] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.503466   815 catalog_manager.cc:5697] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 0 to 1, leader changed from <none> to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 1 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.505324  1110 consensus_queue.cc:260] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.511030  1110 ts_tablet_manager.cc:1434] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:21:37.512169  1110 tablet_bootstrap.cc:492] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:37.520172  1113 tablet_bootstrap.cc:654] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.530282  1111 ts_tablet_manager.cc:1434] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.059s	user 0.010s	sys 0.014s
I20260709 12:21:37.531149  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825dc6215ba4dbabc40347a2dc07e71" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:37.531877  1111 tablet_bootstrap.cc:492] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:37.532028  1070 raft_consensus.cc:2468] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:37.533905   959 leader_election.cc:304] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:37.530558  1110 tablet_bootstrap.cc:654] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.537380  1150 raft_consensus.cc:2804] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.537807  1150 raft_consensus.cc:493] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.538125  1150 raft_consensus.cc:3060] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.538684  1113 tablet_bootstrap.cc:492] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:37.539448  1113 ts_tablet_manager.cc:1403] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.039s	user 0.016s	sys 0.000s
I20260709 12:21:37.541868   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825dc6215ba4dbabc40347a2dc07e71" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:37.542721   919 raft_consensus.cc:2468] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:37.543251  1113 raft_consensus.cc:359] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.544866  1113 raft_consensus.cc:385] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.545233  1113 raft_consensus.cc:740] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.546337  1113 consensus_queue.cc:260] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.546972  1111 tablet_bootstrap.cc:654] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.550169  1110 tablet_bootstrap.cc:492] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:37.549983  1150 raft_consensus.cc:515] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.550446  1121 raft_consensus.cc:493] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.551008  1110 ts_tablet_manager.cc:1403] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.000s
I20260709 12:21:37.551108  1121 raft_consensus.cc:515] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.553704  1121 leader_election.cc:290] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.554288  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825dc6215ba4dbabc40347a2dc07e71" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:37.554965  1070 raft_consensus.cc:3060] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.554791  1110 raft_consensus.cc:359] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.555702  1110 raft_consensus.cc:385] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.556070  1110 raft_consensus.cc:740] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.556394   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825dc6215ba4dbabc40347a2dc07e71" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:37.556910  1110 consensus_queue.cc:260] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.557339   919 raft_consensus.cc:3060] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.559633  1110 ts_tablet_manager.cc:1434] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:37.560570  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409b316683f64710987a63f1b0d59c29" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:37.565347   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409b316683f64710987a63f1b0d59c29" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:37.566089   918 raft_consensus.cc:2393] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5712394ef194d8ba6adaac56b28fa4e in current term 1: Already voted for candidate c19b58e8347a467c879323371e5dd5ab in this term.
I20260709 12:21:37.566736  1121 raft_consensus.cc:493] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.567467   958 leader_election.cc:304] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:37.567451  1121 raft_consensus.cc:515] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.570211  1121 leader_election.cc:290] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.570809  1121 raft_consensus.cc:3060] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.575181  1150 leader_election.cc:290] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.577742  1113 ts_tablet_manager.cc:1434] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:21:37.579607  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6e57991ee4fb6a9016fcf046157a8" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:37.580981  1069 raft_consensus.cc:2393] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5712394ef194d8ba6adaac56b28fa4e in current term 1: Already voted for candidate 7435269a0e8246d28af4d2eb5e0a80fc in this term.
I20260709 12:21:37.582844  1121 raft_consensus.cc:2749] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.591868  1070 raft_consensus.cc:2468] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:37.593243   919 raft_consensus.cc:2468] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:37.593917   959 leader_election.cc:304] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:37.591961  1113 tablet_bootstrap.cc:492] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:37.595387  1150 raft_consensus.cc:2804] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.596189  1150 raft_consensus.cc:697] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:37.597469  1150 consensus_queue.cc:237] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.605985   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "77a6e57991ee4fb6a9016fcf046157a8" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:37.609778   958 leader_election.cc:304] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:37.610679  1111 tablet_bootstrap.cc:492] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:37.611258  1154 raft_consensus.cc:3060] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.611488  1111 ts_tablet_manager.cc:1403] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.031s
I20260709 12:21:37.613135  1113 tablet_bootstrap.cc:654] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.616250  1111 raft_consensus.cc:359] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.617202  1111 raft_consensus.cc:385] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.617558  1111 raft_consensus.cc:740] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.618541  1111 consensus_queue.cc:260] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.620353  1154 raft_consensus.cc:2749] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:37.622200  1111 ts_tablet_manager.cc:1434] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:21:37.623582  1111 tablet_bootstrap.cc:492] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:37.622773   815 catalog_manager.cc:5697] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.627310  1113 tablet_bootstrap.cc:492] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:37.627995  1113 ts_tablet_manager.cc:1403] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.000s
I20260709 12:21:37.631804  1111 tablet_bootstrap.cc:654] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.631474  1113 raft_consensus.cc:359] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.632247  1113 raft_consensus.cc:385] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.632561  1113 raft_consensus.cc:740] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.633417  1113 consensus_queue.cc:260] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.638278  1113 ts_tablet_manager.cc:1434] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:21:37.638378  1111 tablet_bootstrap.cc:492] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:37.639135  1111 ts_tablet_manager.cc:1403] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 12:21:37.639417  1113 tablet_bootstrap.cc:492] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:37.642729  1111 raft_consensus.cc:359] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.643607  1111 raft_consensus.cc:385] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.643971  1111 raft_consensus.cc:740] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.644883  1111 consensus_queue.cc:260] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.645766  1114 raft_consensus.cc:493] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.646421  1114 raft_consensus.cc:515] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.647189  1113 tablet_bootstrap.cc:654] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.647909  1111 ts_tablet_manager.cc:1434] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:21:37.649194  1111 tablet_bootstrap.cc:492] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:37.651113   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9abcde196419887e519c187dddab0" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:37.652819   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9abcde196419887e519c187dddab0" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
W20260709 12:21:37.653060  1033 leader_election.cc:343] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:37.653635   995 raft_consensus.cc:2468] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 0.
I20260709 12:21:37.655145  1034 leader_election.cc:304] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:37.655946  1114 leader_election.cc:290] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:37.656401  1143 raft_consensus.cc:2804] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.656946  1113 tablet_bootstrap.cc:492] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:37.656899  1143 raft_consensus.cc:493] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.657473  1113 ts_tablet_manager.cc:1403] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.006s
I20260709 12:21:37.657442  1143 raft_consensus.cc:3060] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.657903  1111 tablet_bootstrap.cc:654] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:37.660653  1113 raft_consensus.cc:359] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.661463  1113 raft_consensus.cc:385] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.661749  1113 raft_consensus.cc:740] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.662791  1113 consensus_queue.cc:260] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.666492  1113 ts_tablet_manager.cc:1434] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:37.670185  1111 tablet_bootstrap.cc:492] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:37.670936  1111 ts_tablet_manager.cc:1403] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 12:21:37.671458  1143 raft_consensus.cc:515] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.674440  1111 raft_consensus.cc:359] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.675127   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9abcde196419887e519c187dddab0" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:37.675388  1111 raft_consensus.cc:385] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:37.675539   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9abcde196419887e519c187dddab0" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:37.675860  1111 raft_consensus.cc:740] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:37.675913   918 raft_consensus.cc:3060] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.676362   995 raft_consensus.cc:3060] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.676400  1143 leader_election.cc:290] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:37.677671  1111 consensus_queue.cc:260] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.680064  1111 ts_tablet_manager.cc:1434] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:21:37.681298  1154 raft_consensus.cc:493] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.681991  1154 raft_consensus.cc:515] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.685362   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f35bf354154fdbb42a985e604caeae" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:37.685988  1143 raft_consensus.cc:493] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.686623   918 raft_consensus.cc:2468] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 1.
I20260709 12:21:37.687991  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f35bf354154fdbb42a985e604caeae" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:37.688066  1033 leader_election.cc:304] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:37.688930  1070 raft_consensus.cc:2468] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:37.686053   919 raft_consensus.cc:2468] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:37.689261  1114 raft_consensus.cc:2804] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.689041  1154 leader_election.cc:290] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.690864   959 leader_election.cc:304] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:37.691713   995 raft_consensus.cc:2468] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 1.
I20260709 12:21:37.692050  1154 raft_consensus.cc:2804] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.692473  1154 raft_consensus.cc:493] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.692878  1154 raft_consensus.cc:3060] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.686692  1143 raft_consensus.cc:515] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.695283  1143 leader_election.cc:290] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:37.696511   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f350d455504dc2826ae3aa23d3aaab" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:37.697326   995 raft_consensus.cc:2468] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 0.
I20260709 12:21:37.698879  1034 leader_election.cc:304] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:37.699324   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f350d455504dc2826ae3aa23d3aaab" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:37.700454  1114 raft_consensus.cc:697] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:37.700610  1160 raft_consensus.cc:2804] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.701130  1160 raft_consensus.cc:493] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.701493  1160 raft_consensus.cc:3060] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.701586  1114 consensus_queue.cc:237] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.702488  1154 raft_consensus.cc:515] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.700073   918 raft_consensus.cc:2468] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 0.
I20260709 12:21:37.705413  1154 leader_election.cc:290] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.706501  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f35bf354154fdbb42a985e604caeae" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:37.707355  1070 raft_consensus.cc:3060] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.706594   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d6f35bf354154fdbb42a985e604caeae" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:37.710700  1160 raft_consensus.cc:515] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.711422   919 raft_consensus.cc:3060] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.713454  1160 leader_election.cc:290] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:37.716390  1070 raft_consensus.cc:2468] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:37.716718   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f350d455504dc2826ae3aa23d3aaab" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:37.717581   918 raft_consensus.cc:3060] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.717984   959 leader_election.cc:304] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:37.719141  1154 raft_consensus.cc:2804] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.718680   815 catalog_manager.cc:5697] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 0 to 1, leader changed from <none> to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 1 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.720264   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97f350d455504dc2826ae3aa23d3aaab" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:37.720647  1154 raft_consensus.cc:697] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:37.720973   995 raft_consensus.cc:3060] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.721743  1154 consensus_queue.cc:237] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.726193   919 raft_consensus.cc:2468] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:37.728626   918 raft_consensus.cc:2468] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 1.
I20260709 12:21:37.730266  1033 leader_election.cc:304] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:37.731271  1114 raft_consensus.cc:2804] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.731813  1114 raft_consensus.cc:697] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:37.732775  1114 consensus_queue.cc:237] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.735304   816 catalog_manager.cc:5697] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:37.738631   995 raft_consensus.cc:2468] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 1.
I20260709 12:21:37.739290  1160 raft_consensus.cc:493] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:37.739950  1160 raft_consensus.cc:515] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.743846   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377a838bf8d1412392608e242715efae" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:37.744642   995 raft_consensus.cc:2468] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 0.
I20260709 12:21:37.744804  1160 leader_election.cc:290] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:37.746198   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377a838bf8d1412392608e242715efae" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:37.746659  1034 leader_election.cc:304] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:37.747117   919 raft_consensus.cc:2468] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 0.
I20260709 12:21:37.747685  1114 raft_consensus.cc:2804] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:37.748569  1114 raft_consensus.cc:493] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:37.749007  1114 raft_consensus.cc:3060] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.749074   815 catalog_manager.cc:5697] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 0 to 1, leader changed from <none> to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 1 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.757943  1114 raft_consensus.cc:515] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.760667  1114 leader_election.cc:290] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:37.761157   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377a838bf8d1412392608e242715efae" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:37.761404   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377a838bf8d1412392608e242715efae" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:37.761940   919 raft_consensus.cc:3060] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.762176   995 raft_consensus.cc:3060] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:37.768342   919 raft_consensus.cc:2468] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 1.
I20260709 12:21:37.768378   995 raft_consensus.cc:2468] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 1.
I20260709 12:21:37.769649  1033 leader_election.cc:304] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:37.770627  1114 raft_consensus.cc:2804] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:37.771209  1114 raft_consensus.cc:697] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:37.772161  1114 consensus_queue.cc:237] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.772614  1127 consensus_queue.cc:1048] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.783070   815 catalog_manager.cc:5697] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 0 to 1, leader changed from <none> to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 1 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:37.800485  1119 consensus_queue.cc:1048] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:37.877885  1119 consensus_queue.cc:1048] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:37.894454  1171 consensus_queue.cc:1048] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.900406  1171 consensus_queue.cc:1048] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.901443  1114 consensus_queue.cc:1048] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.923645  1160 consensus_queue.cc:1048] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.940022  1069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "409b316683f64710987a63f1b0d59c29"
dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
mode: GRACEFUL
new_leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
 from {username='slave'} at 127.0.0.1:54600
I20260709 12:21:37.940721  1171 consensus_queue.cc:1048] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:37.940766  1069 raft_consensus.cc:606] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Received request to transfer leadership to TS 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:37.959116  1114 raft_consensus.cc:993] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab: : Instructing follower 7435269a0e8246d28af4d2eb5e0a80fc to start an election
I20260709 12:21:37.959728  1114 raft_consensus.cc:1081] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Signalling peer 7435269a0e8246d28af4d2eb5e0a80fc to start an election
I20260709 12:21:37.961730   919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "409b316683f64710987a63f1b0d59c29"
dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
 from {username='slave'} at 127.0.0.1:58494
I20260709 12:21:37.962587   919 raft_consensus.cc:493] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:37.963084   919 raft_consensus.cc:3060] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.972527   919 raft_consensus.cc:515] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.975178   919 leader_election.cc:290] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 2 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:37.974901   994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2825dc6215ba4dbabc40347a2dc07e71"
dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
mode: GRACEFUL
new_leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
 from {username='slave'} at 127.0.0.1:39196
I20260709 12:21:37.975907   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409b316683f64710987a63f1b0d59c29" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:37.976344   994 raft_consensus.cc:606] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Received request to transfer leadership to TS 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:37.976676   995 raft_consensus.cc:3060] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.979162  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "409b316683f64710987a63f1b0d59c29" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:37.979928  1069 raft_consensus.cc:3055] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:37.980330  1069 raft_consensus.cc:740] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:37.981372  1069 consensus_queue.cc:260] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.982996  1069 raft_consensus.cc:3060] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:37.989168   995 raft_consensus.cc:2468] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 2.
I20260709 12:21:37.990875   883 leader_election.cc:304] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:37.991987  1171 raft_consensus.cc:2804] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:37.992645  1171 raft_consensus.cc:697] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:37.993789  1171 consensus_queue.cc:237] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:37.993973  1069 raft_consensus.cc:2468] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 2.
I20260709 12:21:37.997036   919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06"
dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
mode: GRACEFUL
new_leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
 from {username='slave'} at 127.0.0.1:58504
I20260709 12:21:37.997782   919 raft_consensus.cc:606] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Received request to transfer leadership to TS f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:38.002358   816 catalog_manager.cc:5697] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 1 to 2, leader changed from c19b58e8347a467c879323371e5dd5ab (127.22.93.195) to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 2 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.009730  1069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "377a838bf8d1412392608e242715efae"
dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
mode: GRACEFUL
new_leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
 from {username='slave'} at 127.0.0.1:54600
I20260709 12:21:38.010406  1069 raft_consensus.cc:606] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Received request to transfer leadership to TS f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:38.016801  1069 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "10b9abcde196419887e519c187dddab0"
dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
mode: GRACEFUL
new_leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
 from {username='slave'} at 127.0.0.1:54600
I20260709 12:21:38.017361  1069 raft_consensus.cc:606] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Received request to transfer leadership to TS f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:38.062065  1154 consensus_queue.cc:1048] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.075287  1150 consensus_queue.cc:1048] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.084163  1121 raft_consensus.cc:993] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e: : Instructing follower 7435269a0e8246d28af4d2eb5e0a80fc to start an election
I20260709 12:21:38.084770  1150 raft_consensus.cc:1081] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Signalling peer 7435269a0e8246d28af4d2eb5e0a80fc to start an election
I20260709 12:21:38.086712   919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2825dc6215ba4dbabc40347a2dc07e71"
dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
 from {username='slave'} at 127.0.0.1:58500
I20260709 12:21:38.087376   919 raft_consensus.cc:493] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:38.087778   919 raft_consensus.cc:3060] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.094762   919 raft_consensus.cc:515] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.097210   919 leader_election.cc:290] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 2 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:38.098194   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825dc6215ba4dbabc40347a2dc07e71" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:38.098734  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2825dc6215ba4dbabc40347a2dc07e71" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:38.099032   995 raft_consensus.cc:3055] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.099617   995 raft_consensus.cc:740] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:38.099689  1069 raft_consensus.cc:3060] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.100677   995 consensus_queue.cc:260] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.102397   995 raft_consensus.cc:3060] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.109911  1069 raft_consensus.cc:2468] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 2.
I20260709 12:21:38.111605   883 leader_election.cc:304] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:38.111872   995 raft_consensus.cc:2468] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 2.
I20260709 12:21:38.112753  1171 raft_consensus.cc:2804] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:38.113447  1171 raft_consensus.cc:697] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:38.114399  1171 consensus_queue.cc:237] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.122342   815 catalog_manager.cc:5697] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 1 to 2, leader changed from f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194) to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 2 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.148026  1160 consensus_queue.cc:1048] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:38.163215  1114 consensus_queue.cc:1048] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.166361  1160 consensus_queue.cc:1048] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:21:38.174594  1114 raft_consensus.cc:993] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab: : Instructing follower f5712394ef194d8ba6adaac56b28fa4e to start an election
I20260709 12:21:38.175275  1114 raft_consensus.cc:1081] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Signalling peer f5712394ef194d8ba6adaac56b28fa4e to start an election
I20260709 12:21:38.177217   995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "10b9abcde196419887e519c187dddab0"
dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:21:38.177999   995 raft_consensus.cc:493] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:38.178484   995 raft_consensus.cc:3060] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.178920  1114 raft_consensus.cc:993] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab: : Instructing follower f5712394ef194d8ba6adaac56b28fa4e to start an election
I20260709 12:21:38.179689  1143 raft_consensus.cc:1081] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Signalling peer f5712394ef194d8ba6adaac56b28fa4e to start an election
I20260709 12:21:38.181957   993 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "377a838bf8d1412392608e242715efae"
dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:21:38.183190   993 raft_consensus.cc:493] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:38.183636   993 raft_consensus.cc:3060] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.188467  1114 consensus_queue.cc:1048] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.196560   993 raft_consensus.cc:515] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.199185   993 leader_election.cc:290] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 2 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:38.201309  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377a838bf8d1412392608e242715efae" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:38.202106  1069 raft_consensus.cc:3055] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.202488  1069 raft_consensus.cc:740] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:38.203482  1069 consensus_queue.cc:260] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.204922  1069 raft_consensus.cc:3060] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.206861   995 raft_consensus.cc:515] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.214023   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377a838bf8d1412392608e242715efae" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:38.215672   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9abcde196419887e519c187dddab0" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:38.216275   995 leader_election.cc:290] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 2 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:38.216486  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10b9abcde196419887e519c187dddab0" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:38.216765   919 raft_consensus.cc:3060] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.217362  1070 raft_consensus.cc:3055] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.217372   918 raft_consensus.cc:3060] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.217873  1070 raft_consensus.cc:740] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:38.218969  1070 consensus_queue.cc:260] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.220608  1070 raft_consensus.cc:3060] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.226305  1150 consensus_queue.cc:1048] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.215534  1069 raft_consensus.cc:2468] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 2.
I20260709 12:21:38.228518   959 leader_election.cc:304] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:38.229686  1150 raft_consensus.cc:2804] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:38.229799   919 raft_consensus.cc:2468] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 2.
I20260709 12:21:38.230003   918 raft_consensus.cc:2468] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 2.
I20260709 12:21:38.230222  1070 raft_consensus.cc:2468] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 2.
I20260709 12:21:38.230724  1150 raft_consensus.cc:697] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:38.231591   958 leader_election.cc:304] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:38.234792  1121 raft_consensus.cc:2804] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:38.235317  1121 raft_consensus.cc:697] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:38.236351  1121 consensus_queue.cc:237] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.237182  1150 consensus_queue.cc:237] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.243551  1114 consensus_queue.cc:1048] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.250087   815 catalog_manager.cc:5697] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 1 to 2, leader changed from c19b58e8347a467c879323371e5dd5ab (127.22.93.195) to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.252274   815 catalog_manager.cc:5697] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 1 to 2, leader changed from c19b58e8347a467c879323371e5dd5ab (127.22.93.195) to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.253142  1150 consensus_queue.cc:1048] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.265416  1160 consensus_queue.cc:1048] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:38.469542  1171 raft_consensus.cc:993] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc: : Instructing follower f5712394ef194d8ba6adaac56b28fa4e to start an election
I20260709 12:21:38.470114  1127 raft_consensus.cc:1081] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Signalling peer f5712394ef194d8ba6adaac56b28fa4e to start an election
I20260709 12:21:38.472139   995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06"
dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
 from {username='slave'} at 127.0.0.1:39186
I20260709 12:21:38.472743   995 raft_consensus.cc:493] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:38.473093   995 raft_consensus.cc:3060] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.480767   995 raft_consensus.cc:515] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.481855   993 raft_consensus.cc:1275] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Refusing update from remote peer 7435269a0e8246d28af4d2eb5e0a80fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.483500   995 leader_election.cc:290] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 2 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:38.484416  1127 consensus_queue.cc:1048] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:38.484675   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:38.485488   917 raft_consensus.cc:3055] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:38.485596  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86865ed63f8c4ca39416ce03553ddb06" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:38.486006   917 raft_consensus.cc:740] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:38.486312  1070 raft_consensus.cc:3060] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.487052   917 consensus_queue.cc:260] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.488754   917 raft_consensus.cc:3060] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:38.500110  1069 raft_consensus.cc:1275] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Refusing update from remote peer 7435269a0e8246d28af4d2eb5e0a80fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.502610  1070 raft_consensus.cc:2468] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 2.
I20260709 12:21:38.503908  1119 consensus_queue.cc:1048] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:38.504297   959 leader_election.cc:304] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:38.504733   995 raft_consensus.cc:1275] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Refusing update from remote peer 7435269a0e8246d28af4d2eb5e0a80fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.505937  1150 raft_consensus.cc:2804] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:38.506582  1150 raft_consensus.cc:697] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:38.506682   917 raft_consensus.cc:2468] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 2.
I20260709 12:21:38.507716  1150 consensus_queue.cc:237] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:38.510329  1119 consensus_queue.cc:1048] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:38.521070   813 catalog_manager.cc:5697] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 1 to 2, leader changed from 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193) to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:38.524389  1070 raft_consensus.cc:1275] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Refusing update from remote peer 7435269a0e8246d28af4d2eb5e0a80fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.526635  1119 consensus_queue.cc:1048] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:38.687357   917 raft_consensus.cc:1275] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Refusing update from remote peer f5712394ef194d8ba6adaac56b28fa4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.688834  1150 consensus_queue.cc:1048] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:38.699383  1070 raft_consensus.cc:1275] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Refusing update from remote peer f5712394ef194d8ba6adaac56b28fa4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.704133  1150 consensus_queue.cc:1048] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:38.729959   917 raft_consensus.cc:1275] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Refusing update from remote peer f5712394ef194d8ba6adaac56b28fa4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.731690  1121 consensus_queue.cc:1048] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:38.741331  1069 raft_consensus.cc:1275] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Refusing update from remote peer f5712394ef194d8ba6adaac56b28fa4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:38.743197  1121 consensus_queue.cc:1048] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:39.021267  1069 raft_consensus.cc:1275] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Refusing update from remote peer f5712394ef194d8ba6adaac56b28fa4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:39.023274  1121 consensus_queue.cc:1048] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:39.030287   917 raft_consensus.cc:1275] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Refusing update from remote peer f5712394ef194d8ba6adaac56b28fa4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:39.032411  1121 consensus_queue.cc:1048] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:41.063921   813 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38934:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:21:41.068176   813 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:21:41.140062   908 tablet_service.cc:1511] Processing CreateTablet for tablet 62536e672efb4d528da624aee2e5c25c (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:41.141451   982 tablet_service.cc:1511] Processing CreateTablet for tablet 62536e672efb4d528da624aee2e5c25c (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:41.142611   908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62536e672efb4d528da624aee2e5c25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.143430  1060 tablet_service.cc:1511] Processing CreateTablet for tablet 62536e672efb4d528da624aee2e5c25c (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:21:41.145488  1060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62536e672efb4d528da624aee2e5c25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.150609   982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62536e672efb4d528da624aee2e5c25c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.150260   983 tablet_service.cc:1511] Processing CreateTablet for tablet 67dde0bca0fd42c7aa79360a473271ba (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:41.153728   904 tablet_service.cc:1511] Processing CreateTablet for tablet 67dde0bca0fd42c7aa79360a473271ba (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:41.154655  1055 tablet_service.cc:1511] Processing CreateTablet for tablet 67dde0bca0fd42c7aa79360a473271ba (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:21:41.155551   904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dde0bca0fd42c7aa79360a473271ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.156457  1055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dde0bca0fd42c7aa79360a473271ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.159711   903 tablet_service.cc:1511] Processing CreateTablet for tablet 09f4e5d9e7a04707bd9883dce4c49d6f (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:41.161994   905 tablet_service.cc:1511] Processing CreateTablet for tablet 8113087f73e5444194c05c5c4bfb2e6f (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:41.164731   984 tablet_service.cc:1511] Processing CreateTablet for tablet 09f4e5d9e7a04707bd9883dce4c49d6f (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:41.165192  1058 tablet_service.cc:1511] Processing CreateTablet for tablet 09f4e5d9e7a04707bd9883dce4c49d6f (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:21:41.167781   983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67dde0bca0fd42c7aa79360a473271ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.179270   906 tablet_service.cc:1511] Processing CreateTablet for tablet de58486375b64283a68d8e2c8d5adaa2 (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:41.182138   980 tablet_service.cc:1511] Processing CreateTablet for tablet 8113087f73e5444194c05c5c4bfb2e6f (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:41.182396  1059 tablet_service.cc:1511] Processing CreateTablet for tablet 8113087f73e5444194c05c5c4bfb2e6f (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:21:41.166882  1058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f4e5d9e7a04707bd9883dce4c49d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.183802   980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8113087f73e5444194c05c5c4bfb2e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.187412  1059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8113087f73e5444194c05c5c4bfb2e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.173437   903 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f4e5d9e7a04707bd9883dce4c49d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.190618   905 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8113087f73e5444194c05c5c4bfb2e6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.192808   984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 09f4e5d9e7a04707bd9883dce4c49d6f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.193147   906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de58486375b64283a68d8e2c8d5adaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.214671   981 tablet_service.cc:1511] Processing CreateTablet for tablet de58486375b64283a68d8e2c8d5adaa2 (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:41.216632   981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de58486375b64283a68d8e2c8d5adaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.228684  1057 tablet_service.cc:1511] Processing CreateTablet for tablet de58486375b64283a68d8e2c8d5adaa2 (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:21:41.230535   907 tablet_service.cc:1511] Processing CreateTablet for tablet f560876a2aa14949a14ccdcfb6dcf413 (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:41.232242   907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f560876a2aa14949a14ccdcfb6dcf413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.230537  1057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de58486375b64283a68d8e2c8d5adaa2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.247099   985 tablet_service.cc:1511] Processing CreateTablet for tablet f560876a2aa14949a14ccdcfb6dcf413 (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:41.248952   985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f560876a2aa14949a14ccdcfb6dcf413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.250644  1056 tablet_service.cc:1511] Processing CreateTablet for tablet f560876a2aa14949a14ccdcfb6dcf413 (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:21:41.252347  1056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f560876a2aa14949a14ccdcfb6dcf413. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:21:41.257014   864 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:41.300704   980 tablet_service.cc:1511] Processing CreateTablet for tablet c1389dec32ba400d8e84a563827c48bf (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:41.302670   980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1389dec32ba400d8e84a563827c48bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.294296   904 tablet_service.cc:1511] Processing CreateTablet for tablet c1389dec32ba400d8e84a563827c48bf (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:41.307981   904 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1389dec32ba400d8e84a563827c48bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.308427  1054 tablet_service.cc:1511] Processing CreateTablet for tablet c1389dec32ba400d8e84a563827c48bf (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:21:41.310720  1054 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1389dec32ba400d8e84a563827c48bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.328934  1208 tablet_bootstrap.cc:492] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:41.344184  1208 tablet_bootstrap.cc:654] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.345125  1209 tablet_bootstrap.cc:492] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:41.350539  1210 tablet_bootstrap.cc:492] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:41.351786   908 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4232f5f75c473f88f789dc9af08f8b (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:41.353351   908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4232f5f75c473f88f789dc9af08f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.360894  1210 tablet_bootstrap.cc:654] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.366331   982 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4232f5f75c473f88f789dc9af08f8b (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:41.368146   982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4232f5f75c473f88f789dc9af08f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.375192  1209 tablet_bootstrap.cc:654] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.377290  1055 tablet_service.cc:1511] Processing CreateTablet for tablet 1d4232f5f75c473f88f789dc9af08f8b (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:21:41.384167  1055 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d4232f5f75c473f88f789dc9af08f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.396737   907 tablet_service.cc:1511] Processing CreateTablet for tablet 6da2fe3147d14d3da9eef2dd08f561a0 (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:41.398665   907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da2fe3147d14d3da9eef2dd08f561a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.412346  1210 tablet_bootstrap.cc:492] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:41.413183  1210 ts_tablet_manager.cc:1403] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.063s	user 0.012s	sys 0.008s
I20260709 12:21:41.417418  1210 raft_consensus.cc:359] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.418295  1210 raft_consensus.cc:385] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.418650  1210 raft_consensus.cc:740] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.420246   983 tablet_service.cc:1511] Processing CreateTablet for tablet 6da2fe3147d14d3da9eef2dd08f561a0 (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:41.422650   983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da2fe3147d14d3da9eef2dd08f561a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.427768  1210 consensus_queue.cc:260] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.433864  1208 tablet_bootstrap.cc:492] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:41.434609  1208 ts_tablet_manager.cc:1403] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.106s	user 0.022s	sys 0.000s
I20260709 12:21:41.445245  1210 ts_tablet_manager.cc:1434] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.004s
I20260709 12:21:41.442396  1060 tablet_service.cc:1511] Processing CreateTablet for tablet 6da2fe3147d14d3da9eef2dd08f561a0 (DEFAULT_TABLE table=soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:21:41.446801  1210 tablet_bootstrap.cc:492] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:41.447827  1208 raft_consensus.cc:359] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.448873  1208 raft_consensus.cc:385] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.449019  1060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da2fe3147d14d3da9eef2dd08f561a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:21:41.449252  1208 raft_consensus.cc:740] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.454757  1208 consensus_queue.cc:260] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.457703  1209 tablet_bootstrap.cc:492] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:41.458815  1209 ts_tablet_manager.cc:1403] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.120s	user 0.018s	sys 0.007s
I20260709 12:21:41.459592  1208 ts_tablet_manager.cc:1434] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.002s
I20260709 12:21:41.460981  1208 tablet_bootstrap.cc:492] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:41.478667  1210 tablet_bootstrap.cc:654] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.478873  1209 raft_consensus.cc:359] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.480136  1209 raft_consensus.cc:385] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.480540  1209 raft_consensus.cc:740] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.481657  1209 consensus_queue.cc:260] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.486483  1208 tablet_bootstrap.cc:654] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.488366  1209 ts_tablet_manager.cc:1434] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.000s
I20260709 12:21:41.490348  1209 tablet_bootstrap.cc:492] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:41.500264  1209 tablet_bootstrap.cc:654] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.501693  1208 tablet_bootstrap.cc:492] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:41.502511  1208 ts_tablet_manager.cc:1403] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.010s
I20260709 12:21:41.506929  1208 raft_consensus.cc:359] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.507910  1208 raft_consensus.cc:385] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.508265  1208 raft_consensus.cc:740] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.509475  1208 consensus_queue.cc:260] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.513002  1208 ts_tablet_manager.cc:1434] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:21:41.514430  1208 tablet_bootstrap.cc:492] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:41.524050  1210 tablet_bootstrap.cc:492] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:41.524922  1210 ts_tablet_manager.cc:1403] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.078s	user 0.021s	sys 0.004s
I20260709 12:21:41.525888  1208 tablet_bootstrap.cc:654] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.526926  1209 tablet_bootstrap.cc:492] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:41.527642  1209 ts_tablet_manager.cc:1403] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.038s	user 0.024s	sys 0.010s
I20260709 12:21:41.529570  1210 raft_consensus.cc:359] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.530587  1210 raft_consensus.cc:385] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.531080  1210 raft_consensus.cc:740] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.531553  1209 raft_consensus.cc:359] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.532496  1209 raft_consensus.cc:385] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.532874  1209 raft_consensus.cc:740] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.532616  1210 consensus_queue.cc:260] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.534020  1209 consensus_queue.cc:260] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.537670  1209 ts_tablet_manager.cc:1434] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:21:41.537765  1210 ts_tablet_manager.cc:1434] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.003s
I20260709 12:21:41.538825  1209 tablet_bootstrap.cc:492] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:41.543833  1210 tablet_bootstrap.cc:492] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:41.550343  1209 tablet_bootstrap.cc:654] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.542712  1208 tablet_bootstrap.cc:492] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:41.554677  1208 ts_tablet_manager.cc:1403] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.012s
I20260709 12:21:41.557263  1197 raft_consensus.cc:493] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.562357  1197 raft_consensus.cc:515] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.565646  1197 leader_election.cc:290] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.566103  1209 tablet_bootstrap.cc:492] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:41.566814  1209 ts_tablet_manager.cc:1403] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.007s
I20260709 12:21:41.559192  1208 raft_consensus.cc:359] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.567976   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:41.561671  1210 tablet_bootstrap.cc:654] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.571687  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:41.568440  1208 raft_consensus.cc:385] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.572546  1070 raft_consensus.cc:2468] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:41.572858  1208 raft_consensus.cc:740] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.573120  1209 raft_consensus.cc:359] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.574178  1209 raft_consensus.cc:385] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.574539  1209 raft_consensus.cc:740] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.574410  1208 consensus_queue.cc:260] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.575896  1209 consensus_queue.cc:260] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.580406  1208 ts_tablet_manager.cc:1434] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:21:41.583283  1208 tablet_bootstrap.cc:492] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:41.583415  1209 ts_tablet_manager.cc:1434] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.002s
I20260709 12:21:41.585683  1209 tablet_bootstrap.cc:492] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:41.591194   883 leader_election.cc:304] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
W20260709 12:21:41.592584   883 leader_election.cc:343] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.594274  1209 tablet_bootstrap.cc:654] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.595939  1191 raft_consensus.cc:493] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.596596  1191 raft_consensus.cc:515] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.601081   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f560876a2aa14949a14ccdcfb6dcf413" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:41.601505  1191 leader_election.cc:290] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
W20260709 12:21:41.603605   958 leader_election.cc:343] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.603663  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f560876a2aa14949a14ccdcfb6dcf413" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:41.604849  1070 raft_consensus.cc:2468] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:41.607148  1208 tablet_bootstrap.cc:654] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.606730   959 leader_election.cc:304] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:41.610265  1211 raft_consensus.cc:2804] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.610829  1211 raft_consensus.cc:493] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.611467  1211 raft_consensus.cc:3060] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.615237  1220 raft_consensus.cc:2804] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.616040  1220 raft_consensus.cc:493] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.625396  1208 tablet_bootstrap.cc:492] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:41.626168  1208 ts_tablet_manager.cc:1403] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.043s	user 0.015s	sys 0.004s
I20260709 12:21:41.631309  1191 raft_consensus.cc:493] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.632160  1191 raft_consensus.cc:515] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.635659  1208 raft_consensus.cc:359] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.616616  1220 raft_consensus.cc:3060] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.636655   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:41.638127   918 raft_consensus.cc:2468] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:41.640534   958 leader_election.cc:304] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:41.641678  1191 leader_election.cc:290] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.642575  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:41.636873  1208 raft_consensus.cc:385] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:21:41.644645   959 leader_election.cc:343] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.645151  1208 raft_consensus.cc:740] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.646276  1224 raft_consensus.cc:2804] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.647219  1224 raft_consensus.cc:493] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.647825  1224 raft_consensus.cc:3060] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.646180  1208 consensus_queue.cc:260] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.650538  1211 raft_consensus.cc:515] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.651650  1208 ts_tablet_manager.cc:1434] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:21:41.653048  1208 tablet_bootstrap.cc:492] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:41.654428   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f560876a2aa14949a14ccdcfb6dcf413" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
W20260709 12:21:41.656267   958 leader_election.cc:343] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.661963  1208 tablet_bootstrap.cc:654] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.663805  1211 leader_election.cc:290] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.664544  1211 raft_consensus.cc:493] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.664898  1210 tablet_bootstrap.cc:492] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:41.665068  1211 raft_consensus.cc:515] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.665563  1210 ts_tablet_manager.cc:1403] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.122s	user 0.020s	sys 0.026s
I20260709 12:21:41.665541  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f560876a2aa14949a14ccdcfb6dcf413" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:41.666853  1070 raft_consensus.cc:3060] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.668818  1220 raft_consensus.cc:515] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.670522  1209 tablet_bootstrap.cc:492] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:41.670348  1210 raft_consensus.cc:359] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.673430   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8113087f73e5444194c05c5c4bfb2e6f" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:41.674043  1210 raft_consensus.cc:385] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.674500  1210 raft_consensus.cc:740] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
W20260709 12:21:41.675349   958 leader_election.cc:343] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.677309  1211 leader_election.cc:290] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.677979  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8113087f73e5444194c05c5c4bfb2e6f" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:41.678194  1220 leader_election.cc:290] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.678736  1210 consensus_queue.cc:260] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
W20260709 12:21:41.680241   959 leader_election.cc:343] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.680750   959 leader_election.cc:304] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:41.681810  1210 ts_tablet_manager.cc:1434] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:21:41.682080  1211 raft_consensus.cc:2749] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:41.682489  1208 tablet_bootstrap.cc:492] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:41.683194  1208 ts_tablet_manager.cc:1403] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.000s
I20260709 12:21:41.679093   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:41.671216  1209 ts_tablet_manager.cc:1403] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.086s	user 0.039s	sys 0.033s
I20260709 12:21:41.683892  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:41.684792  1069 raft_consensus.cc:3060] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:41.684912   883 leader_election.cc:343] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.687783  1208 raft_consensus.cc:359] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.687888  1209 raft_consensus.cc:359] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.690022  1208 raft_consensus.cc:385] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.690158  1209 raft_consensus.cc:385] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.693157  1209 raft_consensus.cc:740] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.690495  1208 raft_consensus.cc:740] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.694280  1209 consensus_queue.cc:260] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.695391  1208 consensus_queue.cc:260] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.697680  1209 ts_tablet_manager.cc:1434] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.004s
I20260709 12:21:41.683202  1210 tablet_bootstrap.cc:492] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:41.701902  1208 ts_tablet_manager.cc:1434] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.001s
I20260709 12:21:41.699100  1209 tablet_bootstrap.cc:492] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:41.703326  1208 tablet_bootstrap.cc:492] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:41.709833  1210 tablet_bootstrap.cc:654] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.713181  1070 raft_consensus.cc:2468] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:41.716771  1208 tablet_bootstrap.cc:654] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.724920  1209 tablet_bootstrap.cc:654] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.726784  1193 raft_consensus.cc:493] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.726780  1069 raft_consensus.cc:2468] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 1.
I20260709 12:21:41.727578  1193 raft_consensus.cc:515] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.727872   959 leader_election.cc:304] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:41.729355  1211 raft_consensus.cc:2804] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.729187   883 leader_election.cc:304] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:41.730065  1211 raft_consensus.cc:697] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:41.731271  1220 raft_consensus.cc:2804] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.731263  1211 consensus_queue.cc:237] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.732169  1220 raft_consensus.cc:697] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:41.732545   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de58486375b64283a68d8e2c8d5adaa2" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:41.733445   993 raft_consensus.cc:2468] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 0.
I20260709 12:21:41.735224  1034 leader_election.cc:304] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:41.736887  1193 leader_election.cc:290] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:41.733649  1220 consensus_queue.cc:237] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.737694  1193 raft_consensus.cc:2804] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.738147  1193 raft_consensus.cc:493] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.738685  1193 raft_consensus.cc:3060] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.720093  1224 raft_consensus.cc:515] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.736642   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de58486375b64283a68d8e2c8d5adaa2" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:41.747704   918 raft_consensus.cc:2468] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 0.
I20260709 12:21:41.756233  1210 tablet_bootstrap.cc:492] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:41.757409   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:41.762784  1210 ts_tablet_manager.cc:1403] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.080s	user 0.007s	sys 0.020s
I20260709 12:21:41.767292   918 raft_consensus.cc:3060] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.767498  1210 raft_consensus.cc:359] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.768410  1210 raft_consensus.cc:385] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.768746  1210 raft_consensus.cc:740] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.769557  1210 consensus_queue.cc:260] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.775520  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:41.772115  1224 leader_election.cc:290] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.777354  1208 tablet_bootstrap.cc:492] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:41.778050  1208 ts_tablet_manager.cc:1403] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.075s	user 0.013s	sys 0.035s
W20260709 12:21:41.778083   959 leader_election.cc:343] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.782444  1210 ts_tablet_manager.cc:1434] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 12:21:41.782696  1208 raft_consensus.cc:359] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.783825  1208 raft_consensus.cc:385] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.784199  1208 raft_consensus.cc:740] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.785066  1210 tablet_bootstrap.cc:492] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:41.785344  1208 consensus_queue.cc:260] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.789517  1208 ts_tablet_manager.cc:1434] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260709 12:21:41.789517   918 raft_consensus.cc:2468] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:41.791245  1208 tablet_bootstrap.cc:492] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:41.791443   958 leader_election.cc:304] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:41.793248  1224 raft_consensus.cc:2804] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.793869  1224 raft_consensus.cc:697] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:41.795017  1224 consensus_queue.cc:237] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.797648   813 catalog_manager.cc:5697] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.770216  1193 raft_consensus.cc:515] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.803151  1193 leader_election.cc:290] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:41.802244  1208 tablet_bootstrap.cc:654] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.803689   814 catalog_manager.cc:5697] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 1 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.805526   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de58486375b64283a68d8e2c8d5adaa2" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:41.806757   917 raft_consensus.cc:3060] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.819572   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de58486375b64283a68d8e2c8d5adaa2" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:41.820024  1210 tablet_bootstrap.cc:654] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.820536   993 raft_consensus.cc:3060] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.832803  1209 tablet_bootstrap.cc:492] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:41.833544  1209 ts_tablet_manager.cc:1403] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.135s	user 0.020s	sys 0.007s
I20260709 12:21:41.837679  1209 raft_consensus.cc:359] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.838531  1209 raft_consensus.cc:385] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.838937  1209 raft_consensus.cc:740] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.839044   917 raft_consensus.cc:2468] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 1.
I20260709 12:21:41.841184   993 raft_consensus.cc:2468] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 1.
I20260709 12:21:41.841420  1033 leader_election.cc:304] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:41.842129  1209 consensus_queue.cc:260] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.842638  1193 raft_consensus.cc:2804] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.843362  1193 raft_consensus.cc:697] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:41.844379  1193 consensus_queue.cc:237] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.845373  1209 ts_tablet_manager.cc:1434] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:21:41.846710  1209 tablet_bootstrap.cc:492] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:41.859048  1209 tablet_bootstrap.cc:654] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.863133  1208 tablet_bootstrap.cc:492] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:41.863893  1208 ts_tablet_manager.cc:1403] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.008s
I20260709 12:21:41.865533  1210 tablet_bootstrap.cc:492] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:41.866396  1210 ts_tablet_manager.cc:1403] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.083s	user 0.010s	sys 0.008s
I20260709 12:21:41.867864  1208 raft_consensus.cc:359] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.868901  1208 raft_consensus.cc:385] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.869338  1208 raft_consensus.cc:740] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.870776  1224 raft_consensus.cc:493] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.871585  1224 raft_consensus.cc:515] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.873167  1210 raft_consensus.cc:359] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.874450  1210 raft_consensus.cc:385] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.876294   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1389dec32ba400d8e84a563827c48bf" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
W20260709 12:21:41.878129   958 leader_election.cc:343] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.881047  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1389dec32ba400d8e84a563827c48bf" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:41.874841  1210 raft_consensus.cc:740] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.882300  1211 raft_consensus.cc:493] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.881701   816 catalog_manager.cc:5697] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 0 to 1, leader changed from <none> to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 1 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:41.882966  1211 raft_consensus.cc:515] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.883105  1210 consensus_queue.cc:260] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.885881  1211 leader_election.cc:290] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.886428  1210 ts_tablet_manager.cc:1434] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.006s
I20260709 12:21:41.887665  1210 tablet_bootstrap.cc:492] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:41.888329  1069 raft_consensus.cc:2468] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:41.888491  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4e5d9e7a04707bd9883dce4c49d6f" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:41.889365  1070 raft_consensus.cc:2468] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:41.890765   959 leader_election.cc:304] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:41.891887  1211 raft_consensus.cc:2804] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.892335  1211 raft_consensus.cc:493] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.892769  1211 raft_consensus.cc:3060] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.895141   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4e5d9e7a04707bd9883dce4c49d6f" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:41.896008   917 raft_consensus.cc:2468] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:41.899356  1210 tablet_bootstrap.cc:654] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.900153  1224 leader_election.cc:290] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.908329  1208 consensus_queue.cc:260] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.909528   959 leader_election.cc:304] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:41.910001  1220 raft_consensus.cc:493] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:41.910653  1220 raft_consensus.cc:515] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.911867  1210 tablet_bootstrap.cc:492] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:41.912258  1224 raft_consensus.cc:2804] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.912540  1210 ts_tablet_manager.cc:1403] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 12:21:41.912899  1224 raft_consensus.cc:493] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.913311  1224 raft_consensus.cc:3060] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.914358   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8113087f73e5444194c05c5c4bfb2e6f" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:41.915197   993 raft_consensus.cc:2468] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:41.916536  1210 raft_consensus.cc:359] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.916891  1220 leader_election.cc:290] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.916762   883 leader_election.cc:304] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:41.917351  1210 raft_consensus.cc:385] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.917727  1210 raft_consensus.cc:740] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.911906  1208 ts_tablet_manager.cc:1434] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.002s
I20260709 12:21:41.901839  1209 tablet_bootstrap.cc:492] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:41.919438  1209 ts_tablet_manager.cc:1403] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.016s
I20260709 12:21:41.919811  1208 tablet_bootstrap.cc:492] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:41.922668  1210 consensus_queue.cc:260] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.923480  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8113087f73e5444194c05c5c4bfb2e6f" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:41.924773  1220 raft_consensus.cc:2804] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:41.925325  1220 raft_consensus.cc:493] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:41.925791  1220 raft_consensus.cc:3060] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:21:41.925434   883 leader_election.cc:343] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.931205  1208 tablet_bootstrap.cc:654] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.932134  1224 raft_consensus.cc:515] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.934702  1220 raft_consensus.cc:515] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.935868   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1389dec32ba400d8e84a563827c48bf" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
W20260709 12:21:41.937481   958 leader_election.cc:343] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.938818  1220 leader_election.cc:290] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.940460  1209 raft_consensus.cc:359] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.940699   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8113087f73e5444194c05c5c4bfb2e6f" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:41.941282  1209 raft_consensus.cc:385] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.941640  1209 raft_consensus.cc:740] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.941674   993 raft_consensus.cc:3060] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.942803  1210 ts_tablet_manager.cc:1434] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.003s
I20260709 12:21:41.944319  1211 raft_consensus.cc:515] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.946190  1209 consensus_queue.cc:260] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.948832  1209 ts_tablet_manager.cc:1434] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.001s
I20260709 12:21:41.950256  1209 tablet_bootstrap.cc:492] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:41.951280  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8113087f73e5444194c05c5c4bfb2e6f" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:41.952673  1210 tablet_bootstrap.cc:492] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
W20260709 12:21:41.953121   883 leader_election.cc:343] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:41.953853   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4e5d9e7a04707bd9883dce4c49d6f" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:41.954522   917 raft_consensus.cc:3060] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.962033  1210 tablet_bootstrap.cc:654] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.966521   917 raft_consensus.cc:2468] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:41.967904  1211 leader_election.cc:290] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.968891   958 leader_election.cc:304] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:41.970233  1224 leader_election.cc:290] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:41.971220  1224 raft_consensus.cc:2804] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.972328  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1389dec32ba400d8e84a563827c48bf" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:41.973232  1070 raft_consensus.cc:3060] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:41.970697   815 catalog_manager.cc:5697] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:41.981637  1224 raft_consensus.cc:697] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:41.982847   993 raft_consensus.cc:2468] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 1.
I20260709 12:21:41.983139  1224 consensus_queue.cc:237] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.984573   883 leader_election.cc:304] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:41.986373  1220 raft_consensus.cc:2804] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:41.987399  1220 raft_consensus.cc:697] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:41.988046  1208 tablet_bootstrap.cc:492] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:41.988772  1208 ts_tablet_manager.cc:1403] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.012s
I20260709 12:21:41.988440  1220 consensus_queue.cc:237] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.989661  1209 tablet_bootstrap.cc:654] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:41.993386  1208 raft_consensus.cc:359] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.994300  1208 raft_consensus.cc:385] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:41.994608  1208 raft_consensus.cc:740] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:41.995632  1208 consensus_queue.cc:260] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:41.998682  1208 ts_tablet_manager.cc:1434] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:21:42.003137  1208 tablet_bootstrap.cc:492] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e: Bootstrap starting.
I20260709 12:21:42.000146  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4e5d9e7a04707bd9883dce4c49d6f" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:42.001747  1210 tablet_bootstrap.cc:492] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:42.003907  1069 raft_consensus.cc:3060] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.004099  1210 ts_tablet_manager.cc:1403] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.010s
I20260709 12:21:42.010763  1210 raft_consensus.cc:359] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.011718  1210 raft_consensus.cc:385] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.012048  1210 raft_consensus.cc:740] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.012470  1070 raft_consensus.cc:2468] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:42.013075  1210 consensus_queue.cc:260] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.015326   814 catalog_manager.cc:5697] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 1 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.018064  1069 raft_consensus.cc:2468] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:42.023070  1208 tablet_bootstrap.cc:654] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.023145   959 leader_election.cc:304] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:42.023730   813 catalog_manager.cc:5697] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.025362  1224 raft_consensus.cc:2804] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.028919  1220 raft_consensus.cc:493] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.029640  1220 raft_consensus.cc:515] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.050751   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f560876a2aa14949a14ccdcfb6dcf413" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:42.052459  1210 ts_tablet_manager.cc:1434] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.048s	user 0.010s	sys 0.009s
I20260709 12:21:42.054024  1211 raft_consensus.cc:493] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.054808  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f560876a2aa14949a14ccdcfb6dcf413" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:42.054718  1211 raft_consensus.cc:515] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.055298  1210 tablet_bootstrap.cc:492] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:42.055823  1069 raft_consensus.cc:2393] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7435269a0e8246d28af4d2eb5e0a80fc in current term 1: Already voted for candidate f5712394ef194d8ba6adaac56b28fa4e in this term.
I20260709 12:21:42.057754  1211 leader_election.cc:290] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.058657   883 leader_election.cc:304] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc; no voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:42.059706  1197 raft_consensus.cc:3060] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.067545  1209 tablet_bootstrap.cc:492] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:42.068333  1209 ts_tablet_manager.cc:1403] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.015s
I20260709 12:21:42.069746   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:42.071839  1220 leader_election.cc:290] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.077502  1209 raft_consensus.cc:359] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.078634  1209 raft_consensus.cc:385] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.078966  1209 raft_consensus.cc:740] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.079885  1209 consensus_queue.cc:260] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.088848  1224 raft_consensus.cc:697] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:42.094341  1224 consensus_queue.cc:237] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.092206  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:42.091964  1210 tablet_bootstrap.cc:654] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.100126  1070 raft_consensus.cc:2393] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5712394ef194d8ba6adaac56b28fa4e in current term 1: Already voted for candidate 7435269a0e8246d28af4d2eb5e0a80fc in this term.
I20260709 12:21:42.112460  1193 raft_consensus.cc:493] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.113325  1193 raft_consensus.cc:515] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.103729  1197 raft_consensus.cc:2749] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.119670  1193 leader_election.cc:290] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:42.122588   918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:42.123047   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:42.124071   918 raft_consensus.cc:2393] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c19b58e8347a467c879323371e5dd5ab in current term 1: Already voted for candidate f5712394ef194d8ba6adaac56b28fa4e in this term.
I20260709 12:21:42.123471  1211 consensus_queue.cc:1048] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.126267  1034 leader_election.cc:304] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab; no voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:42.128579  1193 raft_consensus.cc:3060] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.129179  1208 tablet_bootstrap.cc:492] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e: No bootstrap required, opened a new log
I20260709 12:21:42.130340  1209 ts_tablet_manager.cc:1434] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.062s	user 0.016s	sys 0.017s
I20260709 12:21:42.131669  1209 tablet_bootstrap.cc:492] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:42.132999  1208 ts_tablet_manager.cc:1403] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e: Time spent bootstrapping tablet: real 0.130s	user 0.029s	sys 0.018s
I20260709 12:21:42.137669  1208 raft_consensus.cc:359] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.138652  1208 raft_consensus.cc:385] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.163609  1209 tablet_bootstrap.cc:654] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
W20260709 12:21:42.172111   959 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:33009, user_credentials={real_user=slave}} blocked reactor thread for 67638.3us
I20260709 12:21:42.138954  1208 raft_consensus.cc:740] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.185052   959 leader_election.cc:304] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:42.184314  1208 consensus_queue.cc:260] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.188860  1191 consensus_queue.cc:1048] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.192718  1251 raft_consensus.cc:493] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.193063  1193 raft_consensus.cc:2749] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.193549  1251 raft_consensus.cc:515] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.194967  1252 raft_consensus.cc:3060] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.199147  1191 raft_consensus.cc:493] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.197885   813 catalog_manager.cc:5697] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.201233  1210 tablet_bootstrap.cc:492] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:42.201426  1251 leader_election.cc:290] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.202185  1191 raft_consensus.cc:515] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.203152  1210 ts_tablet_manager.cc:1403] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.148s	user 0.022s	sys 0.020s
I20260709 12:21:42.204699  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:42.205927   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:42.206385   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:42.206921   993 raft_consensus.cc:2468] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:42.207643   917 raft_consensus.cc:2468] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:42.208767  1209 tablet_bootstrap.cc:492] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:42.209093   883 leader_election.cc:304] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:42.213845  1210 raft_consensus.cc:359] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.214617  1209 ts_tablet_manager.cc:1403] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.083s	user 0.009s	sys 0.010s
I20260709 12:21:42.214852  1251 raft_consensus.cc:2804] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:21:42.215206   883 leader_election.cc:343] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:21:42.215647  1251 raft_consensus.cc:493] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.209299   958 leader_election.cc:304] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:42.216114  1251 raft_consensus.cc:3060] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.216743  1224 raft_consensus.cc:2804] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.217285  1224 raft_consensus.cc:493] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.217821  1224 raft_consensus.cc:3060] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.210194  1208 ts_tablet_manager.cc:1434] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e: Time spent starting tablet: real 0.077s	user 0.010s	sys 0.000s
I20260709 12:21:42.223240  1209 raft_consensus.cc:359] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.224629  1209 raft_consensus.cc:385] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.224875  1210 raft_consensus.cc:385] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.225033  1209 raft_consensus.cc:740] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.225471  1210 raft_consensus.cc:740] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.226940  1210 consensus_queue.cc:260] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.229951  1210 ts_tablet_manager.cc:1434] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260709 12:21:42.231199  1210 tablet_bootstrap.cc:492] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab: Bootstrap starting.
I20260709 12:21:42.234041  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:42.235111  1069 raft_consensus.cc:2468] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 0.
I20260709 12:21:42.235450  1252 raft_consensus.cc:2749] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.236748  1191 leader_election.cc:290] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.227595  1209 consensus_queue.cc:260] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.247885  1224 raft_consensus.cc:515] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.247885  1210 tablet_bootstrap.cc:654] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.252708  1209 ts_tablet_manager.cc:1434] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.003s
I20260709 12:21:42.253479   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:42.257514  1209 tablet_bootstrap.cc:492] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc: Bootstrap starting.
I20260709 12:21:42.258780  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:42.259577  1070 raft_consensus.cc:3060] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.255821  1251 raft_consensus.cc:515] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.268606   917 raft_consensus.cc:2393] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5712394ef194d8ba6adaac56b28fa4e in current term 1: Already voted for candidate 7435269a0e8246d28af4d2eb5e0a80fc in this term.
I20260709 12:21:42.251639  1224 leader_election.cc:290] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.280247  1209 tablet_bootstrap.cc:654] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc: Neither blocks nor log segments found. Creating new log.
I20260709 12:21:42.269140  1197 raft_consensus.cc:493] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.282400  1197 raft_consensus.cc:515] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
W20260709 12:21:42.283298   864 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:21:42.269353  1220 consensus_queue.cc:1048] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:21:42.270896  1251 leader_election.cc:290] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.285490  1197 leader_election.cc:290] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.272910   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:42.287725   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1389dec32ba400d8e84a563827c48bf" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:42.288360   993 raft_consensus.cc:2393] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7435269a0e8246d28af4d2eb5e0a80fc in current term 1: Already voted for candidate f5712394ef194d8ba6adaac56b28fa4e in this term.
I20260709 12:21:42.273484  1069 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:42.272908  1210 tablet_bootstrap.cc:492] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab: No bootstrap required, opened a new log
I20260709 12:21:42.276744  1070 raft_consensus.cc:2468] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 1.
I20260709 12:21:42.291749  1210 ts_tablet_manager.cc:1403] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.006s
I20260709 12:21:42.292783  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1389dec32ba400d8e84a563827c48bf" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:42.293946  1066 raft_consensus.cc:2393] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7435269a0e8246d28af4d2eb5e0a80fc in current term 1: Already voted for candidate f5712394ef194d8ba6adaac56b28fa4e in this term.
I20260709 12:21:42.294606   959 leader_election.cc:304] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:42.295823  1210 raft_consensus.cc:359] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.296445  1191 raft_consensus.cc:2804] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.296566  1210 raft_consensus.cc:385] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.297006  1210 raft_consensus.cc:740] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.297104  1191 raft_consensus.cc:697] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:42.297937  1210 consensus_queue.cc:260] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.293637   883 leader_election.cc:304] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc; no voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:42.301194  1210 ts_tablet_manager.cc:1434] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:21:42.298276  1191 consensus_queue.cc:237] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.303498  1197 raft_consensus.cc:2749] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.305104  1209 tablet_bootstrap.cc:492] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc: No bootstrap required, opened a new log
I20260709 12:21:42.304782   883 leader_election.cc:304] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc; no voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:42.308225  1197 raft_consensus.cc:3060] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.307832  1209 ts_tablet_manager.cc:1403] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent bootstrapping tablet: real 0.051s	user 0.007s	sys 0.012s
I20260709 12:21:42.317148  1193 raft_consensus.cc:493] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.318672  1193 raft_consensus.cc:515] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.321185  1209 raft_consensus.cc:359] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.322055  1209 raft_consensus.cc:385] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:21:42.322485  1209 raft_consensus.cc:740] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Initialized, Role: FOLLOWER
I20260709 12:21:42.322830   917 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8113087f73e5444194c05c5c4bfb2e6f" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" is_pre_election: true
I20260709 12:21:42.323268  1209 consensus_queue.cc:260] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.327134  1209 ts_tablet_manager.cc:1434] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:21:42.327400  1197 raft_consensus.cc:2749] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.328373  1197 consensus_queue.cc:1048] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:42.331573  1193 leader_election.cc:290] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:42.335652  1228 consensus_queue.cc:1048] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.336099   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8113087f73e5444194c05c5c4bfb2e6f" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:42.337327   995 raft_consensus.cc:2393] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c19b58e8347a467c879323371e5dd5ab in current term 1: Already voted for candidate 7435269a0e8246d28af4d2eb5e0a80fc in this term.
I20260709 12:21:42.343786  1034 leader_election.cc:304] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab; no voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:42.344893  1228 raft_consensus.cc:3060] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.353226   815 catalog_manager.cc:5697] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 0 to 1, leader changed from <none> to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 1 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.356058  1193 consensus_queue.cc:1048] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.360688  1228 raft_consensus.cc:2749] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:21:42.376168  1191 consensus_queue.cc:1048] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.384022  1191 consensus_queue.cc:1048] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:42.405550  1252 consensus_queue.cc:1048] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.410180  1252 consensus_queue.cc:1048] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:42.430923  1251 raft_consensus.cc:493] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:21:42.431809  1251 raft_consensus.cc:515] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.434782  1251 leader_election.cc:290] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.435734   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da2fe3147d14d3da9eef2dd08f561a0" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e" is_pre_election: true
I20260709 12:21:42.436846   995 raft_consensus.cc:2468] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:42.437263  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da2fe3147d14d3da9eef2dd08f561a0" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab" is_pre_election: true
I20260709 12:21:42.438095  1070 raft_consensus.cc:2468] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 0.
I20260709 12:21:42.438395   883 leader_election.cc:304] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:42.440213  1251 raft_consensus.cc:2804] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:21:42.440629  1251 raft_consensus.cc:493] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:21:42.441097  1251 raft_consensus.cc:3060] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.449370  1251 raft_consensus.cc:515] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.451273  1251 leader_election.cc:290] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.452629  1070 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da2fe3147d14d3da9eef2dd08f561a0" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:42.452479   995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da2fe3147d14d3da9eef2dd08f561a0" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:42.453488  1070 raft_consensus.cc:3060] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.453517   995 raft_consensus.cc:3060] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:21:42.462853  1070 raft_consensus.cc:2468] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 1.
I20260709 12:21:42.462895   995 raft_consensus.cc:2468] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 1.
I20260709 12:21:42.464304   883 leader_election.cc:304] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:42.465090  1251 raft_consensus.cc:2804] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:21:42.465643  1251 raft_consensus.cc:697] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:42.466750  1251 consensus_queue.cc:237] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.476377   815 catalog_manager.cc:5697] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 0 to 1, leader changed from <none> to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 1 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.591707   995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c"
dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
mode: GRACEFUL
new_leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
 from {username='slave'} at 127.0.0.1:39196
I20260709 12:21:42.592574   995 raft_consensus.cc:606] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Received request to transfer leadership to TS 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:42.594537  1252 consensus_queue.cc:1048] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:42.604729  1251 consensus_queue.cc:1048] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:21:42.605638   995 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "09f4e5d9e7a04707bd9883dce4c49d6f"
dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
mode: GRACEFUL
new_leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
 from {username='slave'} at 127.0.0.1:39196
I20260709 12:21:42.612848   995 raft_consensus.cc:606] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Received request to transfer leadership to TS 7435269a0e8246d28af4d2eb5e0a80fc
I20260709 12:21:42.614086  1191 consensus_queue.cc:1048] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:42.617425  1250 consensus_queue.cc:1048] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.636790  1070 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "de58486375b64283a68d8e2c8d5adaa2"
dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
mode: GRACEFUL
new_leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
 from {username='slave'} at 127.0.0.1:54600
I20260709 12:21:42.639063  1070 raft_consensus.cc:606] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Received request to transfer leadership to TS f5712394ef194d8ba6adaac56b28fa4e
I20260709 12:21:42.669353   919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6da2fe3147d14d3da9eef2dd08f561a0"
dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
mode: GRACEFUL
new_leader_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:58504
I20260709 12:21:42.670094   919 raft_consensus.cc:606] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Received request to transfer leadership to TS c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:42.852226  1211 raft_consensus.cc:993] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e: : Instructing follower 7435269a0e8246d28af4d2eb5e0a80fc to start an election
I20260709 12:21:42.852851  1252 raft_consensus.cc:1081] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Signalling peer 7435269a0e8246d28af4d2eb5e0a80fc to start an election
I20260709 12:21:42.854705   919 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "09f4e5d9e7a04707bd9883dce4c49d6f"
dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
 from {username='slave'} at 127.0.0.1:58500
I20260709 12:21:42.855419   919 raft_consensus.cc:493] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:42.855765  1249 consensus_queue.cc:1048] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.855759   919 raft_consensus.cc:3060] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.859750  1252 consensus_queue.cc:1048] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:21:42.866750  1228 raft_consensus.cc:993] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab: : Instructing follower f5712394ef194d8ba6adaac56b28fa4e to start an election
I20260709 12:21:42.867612  1268 raft_consensus.cc:1081] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Signalling peer f5712394ef194d8ba6adaac56b28fa4e to start an election
I20260709 12:21:42.871037   995 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "de58486375b64283a68d8e2c8d5adaa2"
dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
 from {username='slave'} at 127.0.0.1:39170
I20260709 12:21:42.871757   995 raft_consensus.cc:493] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:42.872201   995 raft_consensus.cc:3060] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.881312  1191 consensus_queue.cc:1048] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.882957  1251 raft_consensus.cc:993] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc: : Instructing follower c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:42.883688  1251 raft_consensus.cc:1081] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Signalling peer c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:42.892674  1249 consensus_queue.cc:1048] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:21:42.895853  1066 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6da2fe3147d14d3da9eef2dd08f561a0"
dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:54570
I20260709 12:21:42.896550  1066 raft_consensus.cc:493] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:42.896984  1066 raft_consensus.cc:3060] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.909554  1066 raft_consensus.cc:515] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.911880  1066 leader_election.cc:290] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 2 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:42.913228   916 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da2fe3147d14d3da9eef2dd08f561a0" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:42.914148   916 raft_consensus.cc:3055] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:42.914448   916 raft_consensus.cc:740] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:42.915266   916 consensus_queue.cc:260] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.916371   916 raft_consensus.cc:3060] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.916981   919 raft_consensus.cc:515] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.919566   919 leader_election.cc:290] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 2 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.919950   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da2fe3147d14d3da9eef2dd08f561a0" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:42.920940   995 raft_consensus.cc:515] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.923269   993 raft_consensus.cc:3060] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.923615   995 leader_election.cc:290] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 2 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:42.924801   994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4e5d9e7a04707bd9883dce4c49d6f" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:42.925559   994 raft_consensus.cc:3055] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:42.925647   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de58486375b64283a68d8e2c8d5adaa2" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:42.925922   994 raft_consensus.cc:740] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:42.926457   919 raft_consensus.cc:3060] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.926970   994 consensus_queue.cc:260] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.928830   994 raft_consensus.cc:3060] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.929989  1067 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "09f4e5d9e7a04707bd9883dce4c49d6f" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:42.930716  1067 raft_consensus.cc:3060] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.935941  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de58486375b64283a68d8e2c8d5adaa2" candidate_uuid: "f5712394ef194d8ba6adaac56b28fa4e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:42.936861  1066 raft_consensus.cc:3055] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:42.937361  1066 raft_consensus.cc:740] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:42.938431  1066 consensus_queue.cc:260] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.940006  1066 raft_consensus.cc:3060] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:42.941251  1067 raft_consensus.cc:2468] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 2.
I20260709 12:21:42.941926   994 raft_consensus.cc:2468] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 2.
I20260709 12:21:42.943019   883 leader_election.cc:304] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:42.944104  1249 raft_consensus.cc:2804] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:42.944638  1249 raft_consensus.cc:697] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:42.945534  1249 consensus_queue.cc:237] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.951982   993 raft_consensus.cc:2468] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 2.
I20260709 12:21:42.953343  1066 raft_consensus.cc:2468] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 2.
I20260709 12:21:42.954730   959 leader_election.cc:304] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:42.955862  1224 raft_consensus.cc:2804] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:42.956466  1224 raft_consensus.cc:697] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Becoming Leader. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:42.957398  1224 consensus_queue.cc:237] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.958004   919 raft_consensus.cc:2468] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5712394ef194d8ba6adaac56b28fa4e in term 2.
I20260709 12:21:42.958388  1034 leader_election.cc:304] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:42.957409   916 raft_consensus.cc:2468] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 2.
I20260709 12:21:42.959566  1228 raft_consensus.cc:2804] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:42.960208  1228 raft_consensus.cc:697] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 2 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:42.961133  1228 consensus_queue.cc:237] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:42.972265   816 catalog_manager.cc:5697] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e reported cstate change: term changed from 1 to 2, leader changed from c19b58e8347a467c879323371e5dd5ab (127.22.93.195) to f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194). New cstate: current_term: 2 leader_uuid: "f5712394ef194d8ba6adaac56b28fa4e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.974625   813 catalog_manager.cc:5697] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 1 to 2, leader changed from 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193) to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 2 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:42.978514   815 catalog_manager.cc:5697] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 1 to 2, leader changed from f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194) to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 2 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:42.997267  1211 raft_consensus.cc:993] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e: : Instructing follower 7435269a0e8246d28af4d2eb5e0a80fc to start an election
I20260709 12:21:42.997810  1224 raft_consensus.cc:1081] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Signalling peer 7435269a0e8246d28af4d2eb5e0a80fc to start an election
I20260709 12:21:42.999564   916 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c"
dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
 from {username='slave'} at 127.0.0.1:58500
I20260709 12:21:43.000204   916 raft_consensus.cc:493] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:43.000631   916 raft_consensus.cc:3060] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.007699   916 raft_consensus.cc:515] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:43.009976   916 leader_election.cc:290] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 2 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), c19b58e8347a467c879323371e5dd5ab (127.22.93.195:33009)
I20260709 12:21:43.011107   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:43.011773  1066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62536e672efb4d528da624aee2e5c25c" candidate_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
I20260709 12:21:43.012024   993 raft_consensus.cc:3055] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:43.012342  1066 raft_consensus.cc:3060] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.012523   993 raft_consensus.cc:740] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:43.013679   993 consensus_queue.cc:260] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:43.015199   993 raft_consensus.cc:3060] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:43.019198  1066 raft_consensus.cc:2468] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 2.
I20260709 12:21:43.020598   883 leader_election.cc:304] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:43.021503  1249 raft_consensus.cc:2804] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:43.021972  1249 raft_consensus.cc:697] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 LEADER]: Becoming Leader. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:43.022912  1249 consensus_queue.cc:237] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:43.023263   993 raft_consensus.cc:2468] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7435269a0e8246d28af4d2eb5e0a80fc in term 2.
I20260709 12:21:43.030927   815 catalog_manager.cc:5697] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc reported cstate change: term changed from 1 to 2, leader changed from f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194) to 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193). New cstate: current_term: 2 leader_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: UNKNOWN } } }
I20260709 12:21:43.429719  1066 raft_consensus.cc:1275] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Refusing update from remote peer 7435269a0e8246d28af4d2eb5e0a80fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.431985  1249 consensus_queue.cc:1048] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:43.442284   993 raft_consensus.cc:1275] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Refusing update from remote peer 7435269a0e8246d28af4d2eb5e0a80fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.444559  1251 consensus_queue.cc:1048] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:43.462006  1066 raft_consensus.cc:1275] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Refusing update from remote peer 7435269a0e8246d28af4d2eb5e0a80fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.465898  1251 consensus_queue.cc:1048] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:43.474834   993 raft_consensus.cc:1275] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Refusing update from remote peer 7435269a0e8246d28af4d2eb5e0a80fc: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.479470  1251 consensus_queue.cc:1048] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:21:43.490712  1066 raft_consensus.cc:1275] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Refusing update from remote peer f5712394ef194d8ba6adaac56b28fa4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.492420  1191 consensus_queue.cc:1048] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:43.505323   916 raft_consensus.cc:1275] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Refusing update from remote peer f5712394ef194d8ba6adaac56b28fa4e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.507264  1191 consensus_queue.cc:1048] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:43.560220   993 raft_consensus.cc:1275] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.561842  1228 consensus_queue.cc:1048] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:43.570667   916 raft_consensus.cc:1275] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:43.572661  1228 consensus_queue.cc:1048] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:45.675009   813 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38934:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:21:45.701640   813 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38934:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:21:45.754657 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:45.986466  1333 tablet.cc:1724] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.019256  1336 tablet.cc:1724] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.060921  1337 tablet.cc:1724] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.131836  1342 tablet.cc:1724] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:46.123136   945 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:09f4e5d9e7a04707bd9883dce4c49d6f)
W20260709 12:21:46.143035  1096 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:09f4e5d9e7a04707bd9883dce4c49d6f)
I20260709 12:21:46.072029  1335 tablet.cc:1724] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.183436  1340 tablet.cc:1724] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.243566  1352 tablet.cc:1724] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:46.308341  1021 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:67dde0bca0fd42c7aa79360a473271ba)
I20260709 12:21:46.352843  1357 tablet.cc:1724] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:46.366801   959 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:33009, user_credentials={real_user=slave}} blocked reactor thread for 354058us
W20260709 12:21:46.411330   883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:33009, user_credentials={real_user=slave}} blocked reactor thread for 71438.2us
I20260709 12:21:46.391330  1355 tablet.cc:1724] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.430058  1365 tablet.cc:1724] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:46.414180   958 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:39723, user_credentials={real_user=slave}} blocked reactor thread for 152242us
I20260709 12:21:46.437052  1366 tablet.cc:1724] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.447395   992 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b"
dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
mode: GRACEFUL
new_leader_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:33314
I20260709 12:21:46.448498   992 raft_consensus.cc:606] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Received request to transfer leadership to TS c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:46.422230  1333 tablet.cc:1724] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.456871  1335 tablet.cc:1724] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.468744  1367 tablet.cc:1724] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.474364  1336 tablet.cc:1724] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.484536  1340 tablet.cc:1724] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.488245  1337 tablet.cc:1724] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:21:46.498662   883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.194:44963, user_credentials={real_user=slave}} blocked reactor thread for 80872.7us
I20260709 12:21:46.506531  1350 raft_consensus.cc:993] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e: : Instructing follower c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:46.542351  1342 tablet.cc:1724] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.555335  1314 raft_consensus.cc:1081] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Signalling peer c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:46.557790  1070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b"
dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:54584
I20260709 12:21:46.558449  1070 raft_consensus.cc:493] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:46.558812  1070 raft_consensus.cc:3060] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:46.568045  1352 tablet.cc:1724] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.571794  1357 tablet.cc:1724] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.574409  1070 raft_consensus.cc:515] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
W20260709 12:21:46.601614   883 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.195:33009, user_credentials={real_user=slave}} blocked reactor thread for 78193.5us
I20260709 12:21:46.602680  1070 leader_election.cc:290] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 2 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:46.605100   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:46.618067   993 raft_consensus.cc:3055] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:46.618434   993 raft_consensus.cc:740] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:46.612095   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d4232f5f75c473f88f789dc9af08f8b" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:46.630288   993 consensus_queue.cc:260] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:46.627689   914 raft_consensus.cc:3060] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:46.632112   993 raft_consensus.cc:3060] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:46.637256   816 catalog_manager.cc:5789] TS f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963) does not have the latest schema for tablet de58486375b64283a68d8e2c8d5adaa2 (table soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49]). Expected version 1 got 0
I20260709 12:21:46.659970  1340 tablet.cc:1724] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.684926  1342 tablet.cc:1724] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.672567  1333 tablet.cc:1724] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.671711  1365 tablet.cc:1724] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.670172  1367 tablet.cc:1724] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.675441  1355 tablet.cc:1724] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.680995  1335 tablet.cc:1724] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:21:46.683514   993 raft_consensus.cc:2468] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 2.
I20260709 12:21:46.693812  1034 leader_election.cc:304] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:46.695384  1294 raft_consensus.cc:2804] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:46.695485   919 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba"
dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
mode: GRACEFUL
new_leader_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:41114
I20260709 12:21:46.695992  1294 raft_consensus.cc:697] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 2 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:46.696379   919 raft_consensus.cc:606] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Received request to transfer leadership to TS c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:46.697003  1294 consensus_queue.cc:237] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:46.698308 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:21:46.699254 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:46.679175   914 raft_consensus.cc:2468] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 2.
I20260709 12:21:46.710704   993 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "377a838bf8d1412392608e242715efae"
dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
mode: GRACEFUL
new_leader_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:33314
I20260709 12:21:46.712064   993 raft_consensus.cc:606] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Received request to transfer leadership to TS c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:46.742623   914 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b255c0161ac417f86b28a02128d76ac"
dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
mode: GRACEFUL
new_leader_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:41114
I20260709 12:21:46.743435   914 raft_consensus.cc:606] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Received request to transfer leadership to TS c19b58e8347a467c879323371e5dd5ab
I20260709 12:21:46.746635 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:21:46.747429 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:46.752091   815 catalog_manager.cc:5697] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 1 to 2, leader changed from f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194) to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 2 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:46.781788   815 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f: soft_deleted_table [id=a5d8d9a37e30409689fd35eb83930e49] alter complete (version 1)
I20260709 12:21:47.030530  1350 raft_consensus.cc:993] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e: : Instructing follower c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:47.031610  1314 raft_consensus.cc:1081] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Signalling peer c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:47.033556  1070 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "377a838bf8d1412392608e242715efae"
dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:54584
I20260709 12:21:47.034157  1070 raft_consensus.cc:493] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:47.034540  1070 raft_consensus.cc:3060] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.038291  1292 raft_consensus.cc:993] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc: : Instructing follower c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:47.038909  1372 raft_consensus.cc:1081] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Signalling peer c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:47.040585  1068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba"
dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:54570
I20260709 12:21:47.041088  1068 raft_consensus.cc:493] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:47.041404  1068 raft_consensus.cc:3060] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:47.041313  1070 raft_consensus.cc:515] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:47.043357  1070 leader_election.cc:290] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 3 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:47.045354   993 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377a838bf8d1412392608e242715efae" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:47.046082   993 raft_consensus.cc:3055] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:21:47.046276   914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "377a838bf8d1412392608e242715efae" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:47.046417   993 raft_consensus.cc:740] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5712394ef194d8ba6adaac56b28fa4e, State: Running, Role: LEADER
I20260709 12:21:47.047096   914 raft_consensus.cc:3060] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.047569   993 consensus_queue.cc:260] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:47.049010   993 raft_consensus.cc:3060] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:21:47.049917  1068 raft_consensus.cc:515] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:47.053138  1068 leader_election.cc:290] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 2 election: Requested vote from peers 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723), f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963)
I20260709 12:21:47.053129   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:47.053681   914 raft_consensus.cc:2468] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 3.
I20260709 12:21:47.053932   919 raft_consensus.cc:3055] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:47.053972   992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67dde0bca0fd42c7aa79360a473271ba" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:47.054478   919 raft_consensus.cc:740] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:47.054791   992 raft_consensus.cc:3060] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:47.055397  1033 leader_election.cc:304] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7435269a0e8246d28af4d2eb5e0a80fc, c19b58e8347a467c879323371e5dd5ab; no voters: 
I20260709 12:21:47.056540  1294 raft_consensus.cc:2804] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:21:47.057075  1294 raft_consensus.cc:697] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 3 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:47.058036  1294 consensus_queue.cc:237] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:47.058964   993 raft_consensus.cc:2468] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 3.
I20260709 12:21:47.055418   919 consensus_queue.cc:260] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:47.063088   992 raft_consensus.cc:2468] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 2.
I20260709 12:21:47.063704   919 raft_consensus.cc:3060] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:47.064792  1034 leader_election.cc:304] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:47.066395  1294 raft_consensus.cc:2804] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:47.066954  1294 raft_consensus.cc:697] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 2 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:47.067917  1294 consensus_queue.cc:237] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:47.071956   813 catalog_manager.cc:5697] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 2 to 3, leader changed from f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194) to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 3 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.073101   919 raft_consensus.cc:2468] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 2.
I20260709 12:21:47.086661   813 catalog_manager.cc:5697] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 1 to 2, leader changed from 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193) to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 2 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.236064   919 raft_consensus.cc:1275] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:21:47.237599  1294 consensus_queue.cc:1048] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:47.247555  1292 raft_consensus.cc:993] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc: : Instructing follower c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:47.248329  1292 raft_consensus.cc:1081] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Signalling peer c19b58e8347a467c879323371e5dd5ab to start an election
I20260709 12:21:47.250836  1068 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b255c0161ac417f86b28a02128d76ac"
dest_uuid: "c19b58e8347a467c879323371e5dd5ab"
 from {username='slave'} at 127.0.0.1:54570
I20260709 12:21:47.251678  1068 raft_consensus.cc:493] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:21:47.252162   992 raft_consensus.cc:1275] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:21:47.252188  1068 raft_consensus.cc:3060] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:47.254206  1294 consensus_queue.cc:1048] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:47.265549  1068 raft_consensus.cc:515] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:47.268560  1068 leader_election.cc:290] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 2 election: Requested vote from peers f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963), 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723)
I20260709 12:21:47.270041   919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b255c0161ac417f86b28a02128d76ac" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7435269a0e8246d28af4d2eb5e0a80fc"
I20260709 12:21:47.270953   919 raft_consensus.cc:3055] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:21:47.270115   992 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b255c0161ac417f86b28a02128d76ac" candidate_uuid: "c19b58e8347a467c879323371e5dd5ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5712394ef194d8ba6adaac56b28fa4e"
I20260709 12:21:47.271399   919 raft_consensus.cc:740] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7435269a0e8246d28af4d2eb5e0a80fc, State: Running, Role: LEADER
I20260709 12:21:47.271721   992 raft_consensus.cc:3060] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:47.272547   919 consensus_queue.cc:260] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:47.276389   919 raft_consensus.cc:3060] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:21:47.280756   992 raft_consensus.cc:2468] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 2.
I20260709 12:21:47.282364  1034 leader_election.cc:304] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c19b58e8347a467c879323371e5dd5ab, f5712394ef194d8ba6adaac56b28fa4e; no voters: 
I20260709 12:21:47.283402  1294 raft_consensus.cc:2804] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:21:47.283854  1294 raft_consensus.cc:697] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 2 LEADER]: Becoming Leader. State: Replica: c19b58e8347a467c879323371e5dd5ab, State: Running, Role: LEADER
I20260709 12:21:47.284736  1294 consensus_queue.cc:237] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } }
I20260709 12:21:47.286325   919 raft_consensus.cc:2468] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c19b58e8347a467c879323371e5dd5ab in term 2.
I20260709 12:21:47.293740   815 catalog_manager.cc:5697] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab reported cstate change: term changed from 1 to 2, leader changed from 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193) to c19b58e8347a467c879323371e5dd5ab (127.22.93.195). New cstate: current_term: 2 leader_uuid: "c19b58e8347a467c879323371e5dd5ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c19b58e8347a467c879323371e5dd5ab" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 33009 } health_report { overall_health: HEALTHY } } }
I20260709 12:21:47.489904   919 raft_consensus.cc:1275] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 3 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:47.491338  1294 consensus_queue.cc:1048] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:47.494234   993 raft_consensus.cc:1275] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 3 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:21:47.495851  1294 consensus_queue.cc:1048] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:21:47.517643   993 raft_consensus.cc:1275] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:21:47.521607  1386 consensus_queue.cc:1048] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:47.533377   919 raft_consensus.cc:1275] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:21:47.535207  1381 consensus_queue.cc:1048] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:21:47.706763   919 raft_consensus.cc:1275] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:47.708246  1386 consensus_queue.cc:1048] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "7435269a0e8246d28af4d2eb5e0a80fc" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 39723 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:47.717883   992 raft_consensus.cc:1275] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Refusing update from remote peer c19b58e8347a467c879323371e5dd5ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:21:47.719784  1381 consensus_queue.cc:1048] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5712394ef194d8ba6adaac56b28fa4e" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 44963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:21:47.748603 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:47.754451 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:47.755038 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:47.761039 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:47.761597 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:48.763230 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:48.769375 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:48.770006 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:48.775462 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:48.775876 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:49.777421 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:49.784740 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:49.785349 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:49.790428 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:49.790884 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:50.792299 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:50.797884 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:50.798475 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:50.803548 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:50.803990 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:51.805312 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:51.811133 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:51.811681 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:51.819617 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:51.820245 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:52.821429 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:52.827350 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:52.827906 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:52.833578 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:52.834053 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:53.835435 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:53.841380 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:53.841850 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:53.847795 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:53.848272 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:54.849818 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:54.857564 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:54.858250 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:54.864748 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:54.865214 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:55.866354 22903 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:21:55.872663 22903 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:21:55.873234 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:21:55.880393 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:21:55.880970 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:21:56.949750 22903 tablet_server.cc:179] TabletServer@127.22.93.193:0 shutting down...
W20260709 12:21:56.969830   958 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 43 similar messages]
W20260709 12:21:56.975289   958 consensus_peers.cc:597] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:56.987707  1033 consensus_peers.cc:597] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.009307 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:57.010680 22903 tablet_replica.cc:333] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.012398 22903 raft_consensus.cc:2243] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.013634 22903 raft_consensus.cc:2272] T c1389dec32ba400d8e84a563827c48bf P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.017539 22903 tablet_replica.cc:333] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.018653 22903 raft_consensus.cc:2243] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.019789 22903 raft_consensus.cc:2272] T 1d4232f5f75c473f88f789dc9af08f8b P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:57.021885  1033 consensus_peers.cc:597] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.023885 22903 tablet_replica.cc:333] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.025133 22903 raft_consensus.cc:2243] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.026774 22903 raft_consensus.cc:2272] T 09f4e5d9e7a04707bd9883dce4c49d6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:57.028707   958 consensus_peers.cc:597] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.030742 22903 tablet_replica.cc:333] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.031806 22903 raft_consensus.cc:2243] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.032984 22903 raft_consensus.cc:2272] T 8113087f73e5444194c05c5c4bfb2e6f P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.036182 22903 tablet_replica.cc:333] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.036957 22903 raft_consensus.cc:2243] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.037616 22903 raft_consensus.cc:2272] T 6da2fe3147d14d3da9eef2dd08f561a0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.041093 22903 tablet_replica.cc:333] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.041868 22903 raft_consensus.cc:2243] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.042593 22903 raft_consensus.cc:2272] T f560876a2aa14949a14ccdcfb6dcf413 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.045620 22903 tablet_replica.cc:333] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.046345 22903 raft_consensus.cc:2243] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.046962 22903 raft_consensus.cc:2272] T de58486375b64283a68d8e2c8d5adaa2 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.050107 22903 tablet_replica.cc:333] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.050889 22903 raft_consensus.cc:2243] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.051556 22903 raft_consensus.cc:2272] T 97f350d455504dc2826ae3aa23d3aaab P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.054867 22903 tablet_replica.cc:333] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.055612 22903 raft_consensus.cc:2243] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.056186 22903 raft_consensus.cc:2272] T 67dde0bca0fd42c7aa79360a473271ba P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.059495 22903 tablet_replica.cc:333] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.060146 22903 raft_consensus.cc:2243] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.061312 22903 raft_consensus.cc:2272] T 62536e672efb4d528da624aee2e5c25c P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.065356 22903 tablet_replica.cc:333] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.066025 22903 raft_consensus.cc:2243] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.066725 22903 raft_consensus.cc:2272] T 10b9abcde196419887e519c187dddab0 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.069990 22903 tablet_replica.cc:333] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.070614 22903 raft_consensus.cc:2243] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.071200 22903 raft_consensus.cc:2272] T d6f35bf354154fdbb42a985e604caeae P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.074316 22903 tablet_replica.cc:333] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.075053 22903 raft_consensus.cc:2243] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.076143 22903 raft_consensus.cc:2272] T 409b316683f64710987a63f1b0d59c29 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.079627 22903 tablet_replica.cc:333] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.080340 22903 raft_consensus.cc:2243] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.080961 22903 raft_consensus.cc:2272] T 6b255c0161ac417f86b28a02128d76ac P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.083910 22903 tablet_replica.cc:333] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.084542 22903 raft_consensus.cc:2243] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.085668 22903 raft_consensus.cc:2272] T 77a6e57991ee4fb6a9016fcf046157a8 P 7435269a0e8246d28af4d2eb5e0a80fc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.089056 22903 tablet_replica.cc:333] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.089781 22903 raft_consensus.cc:2243] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.090828 22903 raft_consensus.cc:2272] T 2825dc6215ba4dbabc40347a2dc07e71 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.094156 22903 tablet_replica.cc:333] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.094871 22903 raft_consensus.cc:2243] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.095566 22903 raft_consensus.cc:2272] T 86865ed63f8c4ca39416ce03553ddb06 P 7435269a0e8246d28af4d2eb5e0a80fc [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.098754 22903 tablet_replica.cc:333] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc: stopping tablet replica
I20260709 12:21:57.099395 22903 raft_consensus.cc:2243] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.100026 22903 raft_consensus.cc:2272] T 377a838bf8d1412392608e242715efae P 7435269a0e8246d28af4d2eb5e0a80fc [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:57.108021   958 consensus_peers.cc:597] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:57.121778   958 consensus_peers.cc:597] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.162626 22903 tablet_server.cc:196] TabletServer@127.22.93.193:0 shutdown complete.
W20260709 12:21:57.175633  1033 consensus_peers.cc:597] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:57.224671  1033 consensus_peers.cc:597] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:21:57.233805  1033 consensus_peers.cc:597] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.235421 22903 tablet_server.cc:179] TabletServer@127.22.93.194:0 shutting down...
W20260709 12:21:57.243264  1034 consensus_peers.cc:597] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab -> Peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Couldn't send request to peer f5712394ef194d8ba6adaac56b28fa4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.294116 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:57.295378 22903 tablet_replica.cc:333] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.296828 22903 raft_consensus.cc:2243] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.298310 22903 raft_consensus.cc:2272] T 1d4232f5f75c473f88f789dc9af08f8b P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:57.299572  1034 consensus_peers.cc:597] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab -> Peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Couldn't send request to peer f5712394ef194d8ba6adaac56b28fa4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.302021 22903 tablet_replica.cc:333] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.303263 22903 raft_consensus.cc:2243] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.304081 22903 raft_consensus.cc:2272] T 09f4e5d9e7a04707bd9883dce4c49d6f P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:57.306303  1034 consensus_peers.cc:597] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab -> Peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Couldn't send request to peer f5712394ef194d8ba6adaac56b28fa4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.308012 22903 tablet_replica.cc:333] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.309371 22903 raft_consensus.cc:2243] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.310820 22903 raft_consensus.cc:2272] T c1389dec32ba400d8e84a563827c48bf P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:57.311453  1034 consensus_peers.cc:597] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab -> Peer f5712394ef194d8ba6adaac56b28fa4e (127.22.93.194:44963): Couldn't send request to peer f5712394ef194d8ba6adaac56b28fa4e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.314232 22903 tablet_replica.cc:333] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.315243 22903 raft_consensus.cc:2243] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.315969 22903 raft_consensus.cc:2272] T 6da2fe3147d14d3da9eef2dd08f561a0 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.319356 22903 tablet_replica.cc:333] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.320109 22903 raft_consensus.cc:2243] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.321298 22903 raft_consensus.cc:2272] T de58486375b64283a68d8e2c8d5adaa2 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.324635 22903 tablet_replica.cc:333] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.325485 22903 raft_consensus.cc:2243] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.326597 22903 raft_consensus.cc:2272] T f560876a2aa14949a14ccdcfb6dcf413 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.329906 22903 tablet_replica.cc:333] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.330782 22903 raft_consensus.cc:2243] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.331447 22903 raft_consensus.cc:2272] T 8113087f73e5444194c05c5c4bfb2e6f P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.334712 22903 tablet_replica.cc:333] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.335577 22903 raft_consensus.cc:2243] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.336297 22903 raft_consensus.cc:2272] T 62536e672efb4d528da624aee2e5c25c P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.339268 22903 tablet_replica.cc:333] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.339962 22903 raft_consensus.cc:2243] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.340660 22903 raft_consensus.cc:2272] T 67dde0bca0fd42c7aa79360a473271ba P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.343832 22903 tablet_replica.cc:333] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.344597 22903 raft_consensus.cc:2243] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.345180 22903 raft_consensus.cc:2272] T 97f350d455504dc2826ae3aa23d3aaab P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.348078 22903 tablet_replica.cc:333] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.348775 22903 raft_consensus.cc:2243] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.349953 22903 raft_consensus.cc:2272] T 10b9abcde196419887e519c187dddab0 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.352814 22903 tablet_replica.cc:333] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.353475 22903 raft_consensus.cc:2243] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.354053 22903 raft_consensus.cc:2272] T 409b316683f64710987a63f1b0d59c29 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.356954 22903 tablet_replica.cc:333] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.357690 22903 raft_consensus.cc:2243] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.358788 22903 raft_consensus.cc:2272] T d6f35bf354154fdbb42a985e604caeae P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.361768 22903 tablet_replica.cc:333] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.362545 22903 raft_consensus.cc:2243] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.363269 22903 raft_consensus.cc:2272] T 6b255c0161ac417f86b28a02128d76ac P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.366269 22903 tablet_replica.cc:333] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.366923 22903 raft_consensus.cc:2243] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.367529 22903 raft_consensus.cc:2272] T 77a6e57991ee4fb6a9016fcf046157a8 P f5712394ef194d8ba6adaac56b28fa4e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.370870 22903 tablet_replica.cc:333] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.371660 22903 raft_consensus.cc:2243] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.372323 22903 raft_consensus.cc:2272] T 2825dc6215ba4dbabc40347a2dc07e71 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.375195 22903 tablet_replica.cc:333] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.375794 22903 raft_consensus.cc:2243] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.376996 22903 raft_consensus.cc:2272] T 86865ed63f8c4ca39416ce03553ddb06 P f5712394ef194d8ba6adaac56b28fa4e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.379740 22903 tablet_replica.cc:333] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e: stopping tablet replica
I20260709 12:21:57.380338 22903 raft_consensus.cc:2243] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.381024 22903 raft_consensus.cc:2272] T 377a838bf8d1412392608e242715efae P f5712394ef194d8ba6adaac56b28fa4e [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:57.405973  1033 consensus_peers.cc:597] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab -> Peer 7435269a0e8246d28af4d2eb5e0a80fc (127.22.93.193:39723): Couldn't send request to peer 7435269a0e8246d28af4d2eb5e0a80fc. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:39723: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:21:57.443473 22903 tablet_server.cc:196] TabletServer@127.22.93.194:0 shutdown complete.
I20260709 12:21:57.501322 22903 tablet_server.cc:179] TabletServer@127.22.93.195:0 shutting down...
I20260709 12:21:57.560184 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:21:57.561275 22903 tablet_replica.cc:333] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.562532 22903 raft_consensus.cc:2243] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.564358 22903 raft_consensus.cc:2272] T 1d4232f5f75c473f88f789dc9af08f8b P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.567860 22903 tablet_replica.cc:333] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.568591 22903 raft_consensus.cc:2243] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.569196 22903 raft_consensus.cc:2272] T 8113087f73e5444194c05c5c4bfb2e6f P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.572289 22903 tablet_replica.cc:333] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.572955 22903 raft_consensus.cc:2243] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.573470 22903 raft_consensus.cc:2272] T 62536e672efb4d528da624aee2e5c25c P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.576452 22903 tablet_replica.cc:333] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.577098 22903 raft_consensus.cc:2243] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.577661 22903 raft_consensus.cc:2272] T c1389dec32ba400d8e84a563827c48bf P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.580339 22903 tablet_replica.cc:333] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.581066 22903 raft_consensus.cc:2243] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.581744 22903 raft_consensus.cc:2272] T 09f4e5d9e7a04707bd9883dce4c49d6f P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.584838 22903 tablet_replica.cc:333] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.585503 22903 raft_consensus.cc:2243] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.586591 22903 raft_consensus.cc:2272] T 97f350d455504dc2826ae3aa23d3aaab P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.589334 22903 tablet_replica.cc:333] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.590008 22903 raft_consensus.cc:2243] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.591037 22903 raft_consensus.cc:2272] T 67dde0bca0fd42c7aa79360a473271ba P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.593705 22903 tablet_replica.cc:333] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.594587 22903 raft_consensus.cc:2243] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.595638 22903 raft_consensus.cc:2272] T 6da2fe3147d14d3da9eef2dd08f561a0 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.598402 22903 tablet_replica.cc:333] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.599128 22903 raft_consensus.cc:2243] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.599763 22903 raft_consensus.cc:2272] T de58486375b64283a68d8e2c8d5adaa2 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.602514 22903 tablet_replica.cc:333] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.603258 22903 raft_consensus.cc:2243] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.603814 22903 raft_consensus.cc:2272] T f560876a2aa14949a14ccdcfb6dcf413 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.606613 22903 tablet_replica.cc:333] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.607218 22903 raft_consensus.cc:2243] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.607738 22903 raft_consensus.cc:2272] T 10b9abcde196419887e519c187dddab0 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.610715 22903 tablet_replica.cc:333] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.611347 22903 raft_consensus.cc:2243] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.611791 22903 raft_consensus.cc:2272] T d6f35bf354154fdbb42a985e604caeae P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.614660 22903 tablet_replica.cc:333] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.615430 22903 raft_consensus.cc:2243] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.615931 22903 raft_consensus.cc:2272] T 409b316683f64710987a63f1b0d59c29 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.618571 22903 tablet_replica.cc:333] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.619125 22903 raft_consensus.cc:2243] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.620210 22903 raft_consensus.cc:2272] T 6b255c0161ac417f86b28a02128d76ac P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.622807 22903 tablet_replica.cc:333] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.623396 22903 raft_consensus.cc:2243] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.623977 22903 raft_consensus.cc:2272] T 86865ed63f8c4ca39416ce03553ddb06 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.627869 22903 tablet_replica.cc:333] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.628716 22903 raft_consensus.cc:2243] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.629364 22903 raft_consensus.cc:2272] T 77a6e57991ee4fb6a9016fcf046157a8 P c19b58e8347a467c879323371e5dd5ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.632550 22903 tablet_replica.cc:333] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.633051 22903 raft_consensus.cc:2243] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:21:57.633594 22903 raft_consensus.cc:2272] T 2825dc6215ba4dbabc40347a2dc07e71 P c19b58e8347a467c879323371e5dd5ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:21:57.636266 22903 tablet_replica.cc:333] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab: stopping tablet replica
I20260709 12:21:57.636745 22903 raft_consensus.cc:2243] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:21:57.637673 22903 raft_consensus.cc:2272] T 377a838bf8d1412392608e242715efae P c19b58e8347a467c879323371e5dd5ab [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:21:58.709898  1091 debug-util.cc:398] Leaking SignalData structure 0x7b0800286ec0 after lost signal to thread 22906
W20260709 12:21:58.711395  1091 debug-util.cc:398] Leaking SignalData structure 0x7b0800236ba0 after lost signal to thread 850
W20260709 12:21:58.809355 22903 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1091)
W20260709 12:21:59.810195 22903 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1091)
W20260709 12:22:00.810954 22903 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1091)
I20260709 12:22:01.611543 22903 tablet_server.cc:196] TabletServer@127.22.93.195:0 shutdown complete.
I20260709 12:22:01.714787 22903 master.cc:562] Master@127.22.93.254:42943 shutting down...
I20260709 12:22:01.767541 22903 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:01.768730 22903 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:01.769229 22903 tablet_replica.cc:333] T 00000000000000000000000000000000 P 560adb8f4a234dfbb0caa1b15f18758f: stopping tablet replica
I20260709 12:22:01.799510 22903 master.cc:584] Master@127.22.93.254:42943 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (25863 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:22:01.893684 22903 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.22.93.254:38767
I20260709 12:22:01.895224 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:01.902922  1420 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:01.904469  1421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:01.905427  1423 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:01.906456 22903 server_base.cc:1061] running on GCE node
I20260709 12:22:01.908372 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:01.908583 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:01.908703 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599721908690 us; error 0 us; skew 500 ppm
I20260709 12:22:01.909250 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:01.912163 22903 webserver.cc:533] Webserver started at http://127.22.93.254:37959/ using document root <none> and password file <none>
I20260709 12:22:01.912722 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:01.912907 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:01.913143 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:01.914934 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/master-0-root/instance:
uuid: "5a249e17a17b4cfda2609f19a24ab033"
format_stamp: "Formatted at 2026-07-09 12:22:01 on dist-test-slave-k289"
I20260709 12:22:01.920403 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:22:01.925050  1428 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:01.926016 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:22:01.926492 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/master-0-root
uuid: "5a249e17a17b4cfda2609f19a24ab033"
format_stamp: "Formatted at 2026-07-09 12:22:01 on dist-test-slave-k289"
I20260709 12:22:01.926828 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:01.944514 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:01.946154 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:02.002732 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.254:38767
I20260709 12:22:02.003082  1479 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.254:38767 every 8 connection(s)
I20260709 12:22:02.009217  1480 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.029351  1480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033: Bootstrap starting.
I20260709 12:22:02.037089  1480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:02.043462  1480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033: No bootstrap required, opened a new log
I20260709 12:22:02.046453  1480 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a249e17a17b4cfda2609f19a24ab033" member_type: VOTER }
I20260709 12:22:02.046963  1480 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:02.047279  1480 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a249e17a17b4cfda2609f19a24ab033, State: Initialized, Role: FOLLOWER
I20260709 12:22:02.048009  1480 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a249e17a17b4cfda2609f19a24ab033" member_type: VOTER }
I20260709 12:22:02.048655  1480 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:02.048879  1480 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:02.049113  1480 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:02.056131  1480 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a249e17a17b4cfda2609f19a24ab033" member_type: VOTER }
I20260709 12:22:02.056715  1480 leader_election.cc:304] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5a249e17a17b4cfda2609f19a24ab033; no voters: 
I20260709 12:22:02.058256  1480 leader_election.cc:290] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:02.059113  1483 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:02.061201  1483 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 1 LEADER]: Becoming Leader. State: Replica: 5a249e17a17b4cfda2609f19a24ab033, State: Running, Role: LEADER
I20260709 12:22:02.062453  1480 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:02.062305  1483 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a249e17a17b4cfda2609f19a24ab033" member_type: VOTER }
I20260709 12:22:02.070873  1485 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5a249e17a17b4cfda2609f19a24ab033. Latest consensus state: current_term: 1 leader_uuid: "5a249e17a17b4cfda2609f19a24ab033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a249e17a17b4cfda2609f19a24ab033" member_type: VOTER } }
I20260709 12:22:02.071287  1484 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5a249e17a17b4cfda2609f19a24ab033" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5a249e17a17b4cfda2609f19a24ab033" member_type: VOTER } }
I20260709 12:22:02.072244  1484 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:02.072017  1485 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:02.076053  1493 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:02.082574  1493 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:02.086336 22903 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:02.095239  1493 catalog_manager.cc:1383] Generated new cluster ID: 0637d32176844e14974f41995295d2c4
I20260709 12:22:02.095649  1493 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:02.115384  1493 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:02.117959  1493 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:02.135946  1493 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033: Generated new TSK 0
I20260709 12:22:02.136919  1493 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:02.154704 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:02.165143  1502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.167243  1503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.171254  1505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:02.175762 22903 server_base.cc:1061] running on GCE node
I20260709 12:22:02.178699 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:02.178978 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:02.179176 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599722179161 us; error 0 us; skew 500 ppm
I20260709 12:22:02.180310 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:02.183491 22903 webserver.cc:533] Webserver started at http://127.22.93.193:45817/ using document root <none> and password file <none>
I20260709 12:22:02.184057 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:02.184286 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:02.184633 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:02.186349 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-0-root/instance:
uuid: "5568fb1ae11a4139959c130f3683e2f8"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-k289"
I20260709 12:22:02.192361 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:22:02.197472  1510 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.198406 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260709 12:22:02.198782 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-0-root
uuid: "5568fb1ae11a4139959c130f3683e2f8"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-k289"
I20260709 12:22:02.199178 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:02.220371 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:02.222134 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:02.224171 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:02.227200 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:02.227465 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.227723 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:02.227994 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.294507 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.193:45459
I20260709 12:22:02.294755  1572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.193:45459 every 8 connection(s)
I20260709 12:22:02.302428 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:02.314518  1577 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.317230  1578 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.323047  1580 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:02.323997 22903 server_base.cc:1061] running on GCE node
I20260709 12:22:02.325721 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:02.326058 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:02.326174  1573 heartbeater.cc:344] Connected to a master server at 127.22.93.254:38767
I20260709 12:22:02.326306 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599722326280 us; error 0 us; skew 500 ppm
I20260709 12:22:02.326831  1573 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:02.327559 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:02.328281  1573 heartbeater.cc:507] Master 127.22.93.254:38767 requested a full tablet report, sending...
I20260709 12:22:02.331468 22903 webserver.cc:533] Webserver started at http://127.22.93.194:34575/ using document root <none> and password file <none>
I20260709 12:22:02.331907  1445 ts_manager.cc:194] Registered new tserver with Master: 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459)
I20260709 12:22:02.332233 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:02.332645 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:02.332963 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:02.335124  1445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60684
I20260709 12:22:02.335120 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-1-root/instance:
uuid: "1527e8bf876143a8a808d60931fa6b32"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-k289"
I20260709 12:22:02.341981 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:02.347410  1585 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.349591 22903 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:22:02.350042 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-1-root
uuid: "1527e8bf876143a8a808d60931fa6b32"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-k289"
I20260709 12:22:02.350431 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:02.364877 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:02.366801 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:02.369000 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:02.372219 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:02.372552 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.372834 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:02.373030 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.440938 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.194:34981
I20260709 12:22:02.441061  1647 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.194:34981 every 8 connection(s)
I20260709 12:22:02.448230 22903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:02.459618  1651 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:02.460647  1652 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:02.464562 22903 server_base.cc:1061] running on GCE node
W20260709 12:22:02.464600  1654 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:02.466393 22903 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:02.466779 22903 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:02.466869  1648 heartbeater.cc:344] Connected to a master server at 127.22.93.254:38767
I20260709 12:22:02.466965 22903 hybrid_clock.cc:648] HybridClock initialized: now 1783599722466948 us; error 0 us; skew 500 ppm
I20260709 12:22:02.467657  1648 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:02.468041 22903 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:02.468763  1648 heartbeater.cc:507] Master 127.22.93.254:38767 requested a full tablet report, sending...
I20260709 12:22:02.471482  1445 ts_manager.cc:194] Registered new tserver with Master: 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:02.471696 22903 webserver.cc:533] Webserver started at http://127.22.93.195:35901/ using document root <none> and password file <none>
I20260709 12:22:02.472533 22903 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:02.472896 22903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:02.473228 22903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:02.473840  1445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60686
I20260709 12:22:02.474936 22903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-2-root/instance:
uuid: "3c478c9a878d4bcb9b474e67d7829054"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-k289"
I20260709 12:22:02.480849 22903 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.002s
I20260709 12:22:02.485668  1659 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.486650 22903 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 12:22:02.487105 22903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-2-root
uuid: "3c478c9a878d4bcb9b474e67d7829054"
format_stamp: "Formatted at 2026-07-09 12:22:02 on dist-test-slave-k289"
I20260709 12:22:02.487547 22903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskJs84V2/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599348838328-22903-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:02.522501 22903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:02.524488 22903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:02.526481 22903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:02.529850 22903 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:02.530162 22903 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.530462 22903 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:02.530666 22903 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:02.600200 22903 rpc_server.cc:307] RPC server started. Bound to: 127.22.93.195:39321
I20260709 12:22:02.600441  1721 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.93.195:39321 every 8 connection(s)
I20260709 12:22:02.622709  1722 heartbeater.cc:344] Connected to a master server at 127.22.93.254:38767
I20260709 12:22:02.623521  1722 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:02.624665  1722 heartbeater.cc:507] Master 127.22.93.254:38767 requested a full tablet report, sending...
I20260709 12:22:02.627424  1445 ts_manager.cc:194] Registered new tserver with Master: 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:02.628469 22903 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.021745056s
I20260709 12:22:02.629684  1445 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60700
I20260709 12:22:02.666371  1445 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60706:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:02.670405  1445 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:02.771522  1687 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb6d4ebc7c94d63be65317be1ba14a7 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:02.773779  1687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb6d4ebc7c94d63be65317be1ba14a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.774231  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5c4887be9b40a789432d640c1e4e8e (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:02.776309  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5c4887be9b40a789432d640c1e4e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.778776  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 156815799cdb498f9804e65be3824412 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:02.780865  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156815799cdb498f9804e65be3824412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.790107  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 2a48bf4e64e346b49d0ba0c5cc51e493 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:02.792479  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a48bf4e64e346b49d0ba0c5cc51e493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.803061  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 79d8c18f47a24342b5cebc8fd5c60617 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:02.805162  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d8c18f47a24342b5cebc8fd5c60617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.812624  1538 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb6d4ebc7c94d63be65317be1ba14a7 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:02.816869  1537 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5c4887be9b40a789432d640c1e4e8e (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:02.817302  1610 tablet_service.cc:1511] Processing CreateTablet for tablet 2a48bf4e64e346b49d0ba0c5cc51e493 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:02.817808  1613 tablet_service.cc:1511] Processing CreateTablet for tablet 9eb6d4ebc7c94d63be65317be1ba14a7 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:02.819482  1610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a48bf4e64e346b49d0ba0c5cc51e493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.820549  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 156815799cdb498f9804e65be3824412 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:02.820814  1536 tablet_service.cc:1511] Processing CreateTablet for tablet 156815799cdb498f9804e65be3824412 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:02.823261  1612 tablet_service.cc:1511] Processing CreateTablet for tablet 9a5c4887be9b40a789432d640c1e4e8e (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:02.814903  1538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb6d4ebc7c94d63be65317be1ba14a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.824736  1609 tablet_service.cc:1511] Processing CreateTablet for tablet 79d8c18f47a24342b5cebc8fd5c60617 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:02.827859  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156815799cdb498f9804e65be3824412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.824586  1535 tablet_service.cc:1511] Processing CreateTablet for tablet 2a48bf4e64e346b49d0ba0c5cc51e493 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:02.828009  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 79d8c18f47a24342b5cebc8fd5c60617 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:02.829319  1609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d8c18f47a24342b5cebc8fd5c60617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.830456  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5c4887be9b40a789432d640c1e4e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.831892  1613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9eb6d4ebc7c94d63be65317be1ba14a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.832954  1535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2a48bf4e64e346b49d0ba0c5cc51e493. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.833818  1608 tablet_service.cc:1511] Processing CreateTablet for tablet f8044d53d4cf42ae9c776dfe50786c05 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:02.834798  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79d8c18f47a24342b5cebc8fd5c60617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.828284  1533 tablet_service.cc:1511] Processing CreateTablet for tablet f8044d53d4cf42ae9c776dfe50786c05 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:02.839514  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8044d53d4cf42ae9c776dfe50786c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.840307  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8044d53d4cf42ae9c776dfe50786c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.844056  1537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a5c4887be9b40a789432d640c1e4e8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.846956  1682 tablet_service.cc:1511] Processing CreateTablet for tablet f8044d53d4cf42ae9c776dfe50786c05 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:02.849028  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8044d53d4cf42ae9c776dfe50786c05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.847036  1536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 156815799cdb498f9804e65be3824412. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.853258  1532 tablet_service.cc:1511] Processing CreateTablet for tablet 784bc0f917cd483b9b9bba01d1e0fe01 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:02.875244  1532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784bc0f917cd483b9b9bba01d1e0fe01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.906682  1607 tablet_service.cc:1511] Processing CreateTablet for tablet 784bc0f917cd483b9b9bba01d1e0fe01 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:02.909415  1607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784bc0f917cd483b9b9bba01d1e0fe01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.930966  1686 tablet_service.cc:1511] Processing CreateTablet for tablet 784bc0f917cd483b9b9bba01d1e0fe01 (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:02.932987  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 784bc0f917cd483b9b9bba01d1e0fe01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.949694  1531 tablet_service.cc:1511] Processing CreateTablet for tablet e8518e0449b143fbbf58f6c7ab7a0a5b (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:02.954604  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8518e0449b143fbbf58f6c7ab7a0a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:02.956234  1740 tablet_bootstrap.cc:492] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:02.970193  1606 tablet_service.cc:1511] Processing CreateTablet for tablet e8518e0449b143fbbf58f6c7ab7a0a5b (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:02.972126  1606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8518e0449b143fbbf58f6c7ab7a0a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.013198  1685 tablet_service.cc:1511] Processing CreateTablet for tablet e8518e0449b143fbbf58f6c7ab7a0a5b (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:03.015707  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8518e0449b143fbbf58f6c7ab7a0a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.043692  1742 tablet_bootstrap.cc:492] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:03.052529  1530 tablet_service.cc:1511] Processing CreateTablet for tablet 37bf1701bc504dcaa7c9589b3ec6f8bd (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:03.053223  1605 tablet_service.cc:1511] Processing CreateTablet for tablet 37bf1701bc504dcaa7c9589b3ec6f8bd (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:03.054766  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bf1701bc504dcaa7c9589b3ec6f8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.054774  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bf1701bc504dcaa7c9589b3ec6f8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.058740  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 37bf1701bc504dcaa7c9589b3ec6f8bd (DEFAULT_TABLE table=test-workload [id=2a3a5df19e5145b78df42c6e64579a24]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:03.064940  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37bf1701bc504dcaa7c9589b3ec6f8bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:03.074100  1740 tablet_bootstrap.cc:654] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:03.079521  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:03.086405  1741 tablet_bootstrap.cc:492] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:03.138046  1741 tablet_bootstrap.cc:654] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.139034  1742 tablet_bootstrap.cc:654] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.155911  1740 tablet_bootstrap.cc:492] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:03.156852  1740 ts_tablet_manager.cc:1403] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.202s	user 0.030s	sys 0.028s
I20260709 12:22:03.163430  1740 raft_consensus.cc:359] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:03.164531  1740 raft_consensus.cc:385] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.164949  1740 raft_consensus.cc:740] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.166356  1740 consensus_queue.cc:260] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:03.178381  1741 tablet_bootstrap.cc:492] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:03.179697  1741 ts_tablet_manager.cc:1403] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.094s	user 0.027s	sys 0.021s
I20260709 12:22:03.185521  1722 heartbeater.cc:499] Master 127.22.93.254:38767 was elected leader, sending a full tablet report...
I20260709 12:22:03.185599  1740 ts_tablet_manager.cc:1434] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.028s	user 0.012s	sys 0.016s
I20260709 12:22:03.185861  1741 raft_consensus.cc:359] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.187305  1741 raft_consensus.cc:385] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.187724  1741 raft_consensus.cc:740] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.187803  1742 tablet_bootstrap.cc:492] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:03.188047  1740 tablet_bootstrap.cc:492] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:03.188619  1742 ts_tablet_manager.cc:1403] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.145s	user 0.021s	sys 0.009s
I20260709 12:22:03.189033  1741 consensus_queue.cc:260] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.194335  1742 raft_consensus.cc:359] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.195449  1742 raft_consensus.cc:385] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.195806  1742 raft_consensus.cc:740] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.197013  1742 consensus_queue.cc:260] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.200675  1740 tablet_bootstrap.cc:654] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.200841  1648 heartbeater.cc:499] Master 127.22.93.254:38767 was elected leader, sending a full tablet report...
I20260709 12:22:03.201622  1741 ts_tablet_manager.cc:1434] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.015s
I20260709 12:22:03.203465  1741 tablet_bootstrap.cc:492] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:03.206907  1742 ts_tablet_manager.cc:1434] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.018s	user 0.011s	sys 0.003s
I20260709 12:22:03.208227  1573 heartbeater.cc:499] Master 127.22.93.254:38767 was elected leader, sending a full tablet report...
I20260709 12:22:03.217093  1741 tablet_bootstrap.cc:654] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.222844  1742 tablet_bootstrap.cc:492] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:03.236773  1742 tablet_bootstrap.cc:654] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.242954  1740 tablet_bootstrap.cc:492] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:03.242954  1741 tablet_bootstrap.cc:492] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:03.244144  1740 ts_tablet_manager.cc:1403] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.031s
I20260709 12:22:03.244232  1741 ts_tablet_manager.cc:1403] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.041s	user 0.028s	sys 0.011s
I20260709 12:22:03.249791  1740 raft_consensus.cc:359] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.250941  1740 raft_consensus.cc:385] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.250352  1741 raft_consensus.cc:359] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.251365  1740 raft_consensus.cc:740] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.251988  1741 raft_consensus.cc:385] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.252486  1741 raft_consensus.cc:740] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.252610  1740 consensus_queue.cc:260] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.254274  1742 tablet_bootstrap.cc:492] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:03.254204  1741 consensus_queue.cc:260] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.255119  1742 ts_tablet_manager.cc:1403] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.004s
I20260709 12:22:03.256474  1740 ts_tablet_manager.cc:1434] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.005s
I20260709 12:22:03.257815  1741 ts_tablet_manager.cc:1434] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:22:03.258287  1740 tablet_bootstrap.cc:492] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:03.259676  1741 tablet_bootstrap.cc:492] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:03.260367  1742 raft_consensus.cc:359] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:03.261595  1742 raft_consensus.cc:385] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.263891  1746 raft_consensus.cc:493] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.264986  1746 raft_consensus.cc:515] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:03.270182  1740 tablet_bootstrap.cc:654] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.272153  1741 tablet_bootstrap.cc:654] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.262059  1742 raft_consensus.cc:740] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.290719  1742 consensus_queue.cc:260] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:03.297139  1742 ts_tablet_manager.cc:1434] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.001s
W20260709 12:22:03.301811  1574 tablet.cc:2406] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:03.306468  1742 tablet_bootstrap.cc:492] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:03.284732  1746 leader_election.cc:290] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:03.325084  1741 tablet_bootstrap.cc:492] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:03.326561  1741 ts_tablet_manager.cc:1403] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.067s	user 0.024s	sys 0.025s
I20260709 12:22:03.331918  1741 raft_consensus.cc:359] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.332928  1740 tablet_bootstrap.cc:492] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:03.333011  1741 raft_consensus.cc:385] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.333832  1741 raft_consensus.cc:740] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.333973  1740 ts_tablet_manager.cc:1403] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.076s	user 0.033s	sys 0.039s
I20260709 12:22:03.335714  1741 consensus_queue.cc:260] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.336323  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:03.337512  1548 raft_consensus.cc:2468] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 0.
I20260709 12:22:03.339463  1741 ts_tablet_manager.cc:1434] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.006s
I20260709 12:22:03.339579  1740 raft_consensus.cc:359] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.340709  1740 raft_consensus.cc:385] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.341542  1740 raft_consensus.cc:740] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.342051  1741 tablet_bootstrap.cc:492] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:03.342790  1740 consensus_queue.cc:260] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.343806  1742 tablet_bootstrap.cc:654] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.348753  1740 ts_tablet_manager.cc:1434] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 12:22:03.350373  1740 tablet_bootstrap.cc:492] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:03.351717  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
W20260709 12:22:03.357928  1662 leader_election.cc:343] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.359179  1740 tablet_bootstrap.cc:654] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.363713  1746 raft_consensus.cc:493] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.364725  1746 raft_consensus.cc:515] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.368607  1746 leader_election.cc:290] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:03.371709  1741 tablet_bootstrap.cc:654] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.374112  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
W20260709 12:22:03.376730  1662 leader_election.cc:343] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.375710  1660 leader_election.cc:304] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 1527e8bf876143a8a808d60931fa6b32
I20260709 12:22:03.381632  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:03.383394  1747 raft_consensus.cc:493] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.384322  1747 raft_consensus.cc:515] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.396059  1760 raft_consensus.cc:493] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.397256  1760 raft_consensus.cc:515] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.401039  1741 tablet_bootstrap.cc:492] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:03.404093  1741 ts_tablet_manager.cc:1403] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.062s	user 0.018s	sys 0.006s
I20260709 12:22:03.404258  1747 leader_election.cc:290] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:03.384301  1746 raft_consensus.cc:2804] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.409181  1746 raft_consensus.cc:493] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.409722  1746 raft_consensus.cc:3060] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.413730  1760 leader_election.cc:290] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:03.417382  1741 raft_consensus.cc:359] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.421217  1741 raft_consensus.cc:385] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.422271  1748 raft_consensus.cc:493] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.422478  1741 raft_consensus.cc:740] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.423236  1748 raft_consensus.cc:515] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.426292  1741 consensus_queue.cc:260] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.432272  1741 ts_tablet_manager.cc:1434] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.026s	user 0.012s	sys 0.001s
I20260709 12:22:03.437029  1741 tablet_bootstrap.cc:492] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:03.438439  1748 leader_election.cc:290] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:03.453753  1741 tablet_bootstrap.cc:654] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.467566  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
W20260709 12:22:03.468339  1660 leader_election.cc:343] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.469017  1660 leader_election.cc:304] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054; no voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8
W20260709 12:22:03.470490  1586 leader_election.cc:343] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.472091  1741 tablet_bootstrap.cc:492] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:03.473290  1741 ts_tablet_manager.cc:1403] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.037s	user 0.018s	sys 0.011s
I20260709 12:22:03.472332  1766 raft_consensus.cc:2749] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:03.472105  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
W20260709 12:22:03.481477  1586 leader_election.cc:343] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.480885  1741 raft_consensus.cc:359] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.482396  1741 raft_consensus.cc:385] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.482942  1741 raft_consensus.cc:740] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.484318  1741 consensus_queue.cc:260] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.488814  1741 ts_tablet_manager.cc:1434] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.002s
I20260709 12:22:03.490971  1741 tablet_bootstrap.cc:492] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:03.494277  1766 raft_consensus.cc:493] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.495321  1766 raft_consensus.cc:515] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.498934  1766 leader_election.cc:290] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:03.500766  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156815799cdb498f9804e65be3824412" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:03.502130  1623 raft_consensus.cc:2468] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 0.
I20260709 12:22:03.502323  1741 tablet_bootstrap.cc:654] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.504338  1662 leader_election.cc:304] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 
I20260709 12:22:03.505446  1766 raft_consensus.cc:2804] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.505898  1766 raft_consensus.cc:493] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.506250  1766 raft_consensus.cc:3060] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.521862  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:03.522915  1623 raft_consensus.cc:2468] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:03.524961  1513 leader_election.cc:304] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:03.525996  1748 raft_consensus.cc:2804] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.526566  1748 raft_consensus.cc:493] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.526955  1748 raft_consensus.cc:3060] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:03.535091  1660 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.22.93.193:45459, user_credentials={real_user=slave}} blocked reactor thread for 66800.1us
I20260709 12:22:03.536024  1741 tablet_bootstrap.cc:492] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:03.537061  1741 ts_tablet_manager.cc:1403] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.046s	user 0.022s	sys 0.022s
I20260709 12:22:03.537508  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156815799cdb498f9804e65be3824412" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
W20260709 12:22:03.539817  1660 leader_election.cc:343] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.540298  1748 raft_consensus.cc:515] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.542737  1741 raft_consensus.cc:359] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:03.543211  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:03.545367  1741 raft_consensus.cc:385] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.545974  1741 raft_consensus.cc:740] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.548200  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:03.548926  1623 raft_consensus.cc:3060] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.548334  1741 consensus_queue.cc:260] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
W20260709 12:22:03.551934  1512 leader_election.cc:343] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.553052  1741 ts_tablet_manager.cc:1434] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 12:22:03.555383  1741 tablet_bootstrap.cc:492] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:03.562215  1766 raft_consensus.cc:515] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.566427  1741 tablet_bootstrap.cc:654] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.568478  1740 tablet_bootstrap.cc:492] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:03.569260  1740 ts_tablet_manager.cc:1403] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.219s	user 0.065s	sys 0.122s
I20260709 12:22:03.569010  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:03.570770  1748 leader_election.cc:290] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:03.573972  1623 raft_consensus.cc:2468] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:03.574613  1740 raft_consensus.cc:359] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.576079  1740 raft_consensus.cc:385] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.576529  1740 raft_consensus.cc:740] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.576583  1513 leader_election.cc:304] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:03.578013  1748 raft_consensus.cc:2804] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.578059  1740 consensus_queue.cc:260] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.572686  1760 raft_consensus.cc:493] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.581305  1760 raft_consensus.cc:515] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.582319  1741 tablet_bootstrap.cc:492] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:03.583491  1741 ts_tablet_manager.cc:1403] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.029s	user 0.023s	sys 0.003s
I20260709 12:22:03.586903  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:03.589643  1741 raft_consensus.cc:359] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.591193  1741 raft_consensus.cc:385] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:22:03.591311  1586 leader_election.cc:343] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.591775  1741 raft_consensus.cc:740] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.592468  1760 leader_election.cc:290] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:03.593531  1741 consensus_queue.cc:260] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.595785  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:03.597304  1740 ts_tablet_manager.cc:1434] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.028s	user 0.017s	sys 0.011s
I20260709 12:22:03.598059  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:03.598724  1740 tablet_bootstrap.cc:492] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:03.599061  1697 raft_consensus.cc:2468] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 0.
W20260709 12:22:03.601164  1587 leader_election.cc:343] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.601372  1741 ts_tablet_manager.cc:1434] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 12:22:03.602074  1587 leader_election.cc:304] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32; no voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:03.603088  1741 tablet_bootstrap.cc:492] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:03.605890  1747 raft_consensus.cc:2749] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:03.608624  1587 leader_election.cc:343] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.609057  1740 tablet_bootstrap.cc:654] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.609493  1587 leader_election.cc:304] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32; no voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:03.610792  1747 raft_consensus.cc:2749] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:03.615128  1742 tablet_bootstrap.cc:492] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:03.617250  1742 ts_tablet_manager.cc:1403] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.311s	user 0.038s	sys 0.051s
I20260709 12:22:03.621543  1742 raft_consensus.cc:359] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.622445  1742 raft_consensus.cc:385] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.622936  1742 raft_consensus.cc:740] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.626019  1587 leader_election.cc:304] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:03.627790  1741 tablet_bootstrap.cc:654] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.626780  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:03.631032  1760 raft_consensus.cc:2804] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.631553  1760 raft_consensus.cc:493] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.631946  1760 raft_consensus.cc:3060] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.624018  1742 consensus_queue.cc:260] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
W20260709 12:22:03.634891  1512 leader_election.cc:343] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.637331  1740 tablet_bootstrap.cc:492] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:03.638326  1740 ts_tablet_manager.cc:1403] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.015s
I20260709 12:22:03.638424  1746 raft_consensus.cc:515] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:03.643710  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:03.644757  1548 raft_consensus.cc:3060] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.654363  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156815799cdb498f9804e65be3824412" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:03.655833  1547 raft_consensus.cc:3060] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.654587  1741 tablet_bootstrap.cc:492] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:03.660296  1741 ts_tablet_manager.cc:1403] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.007s
I20260709 12:22:03.665356  1548 raft_consensus.cc:2468] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 1.
I20260709 12:22:03.667851  1660 leader_election.cc:304] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:03.669629  1771 raft_consensus.cc:2804] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.671341  1766 leader_election.cc:290] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:03.674427  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156815799cdb498f9804e65be3824412" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:03.675448  1623 raft_consensus.cc:3060] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.643692  1740 raft_consensus.cc:359] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.676127  1740 raft_consensus.cc:385] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.676455  1740 raft_consensus.cc:740] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.676617  1746 leader_election.cc:290] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:03.677430  1740 consensus_queue.cc:260] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.679880  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:03.680968  1622 raft_consensus.cc:3060] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.669911  1741 raft_consensus.cc:359] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.684003  1741 raft_consensus.cc:385] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.684501  1741 raft_consensus.cc:740] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.684798  1740 ts_tablet_manager.cc:1434] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.046s	user 0.000s	sys 0.013s
I20260709 12:22:03.685837  1741 consensus_queue.cc:260] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.686576  1746 raft_consensus.cc:493] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.692265  1740 tablet_bootstrap.cc:492] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:03.697714  1748 raft_consensus.cc:697] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:03.703934  1748 consensus_queue.cc:237] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.704988  1742 ts_tablet_manager.cc:1434] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.087s	user 0.040s	sys 0.034s
I20260709 12:22:03.691416  1746 raft_consensus.cc:515] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.714090  1741 ts_tablet_manager.cc:1434] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.053s	user 0.013s	sys 0.001s
I20260709 12:22:03.716707  1741 tablet_bootstrap.cc:492] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:03.720402  1760 raft_consensus.cc:515] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.724575  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
W20260709 12:22:03.726665  1586 leader_election.cc:343] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.712854  1771 raft_consensus.cc:697] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Leader. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:03.727486  1740 tablet_bootstrap.cc:654] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.727568  1547 raft_consensus.cc:2468] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 1.
I20260709 12:22:03.731496  1660 leader_election.cc:304] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:03.733577  1775 raft_consensus.cc:2804] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.733652  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:03.734254  1775 raft_consensus.cc:697] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Leader. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:03.734668  1697 raft_consensus.cc:3060] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.736061  1775 consensus_queue.cc:237] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.734433  1771 consensus_queue.cc:237] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:03.738978  1760 leader_election.cc:290] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:03.744423  1623 raft_consensus.cc:2468] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 1.
I20260709 12:22:03.746408  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
W20260709 12:22:03.748184  1660 leader_election.cc:343] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.749346  1622 raft_consensus.cc:2468] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 1.
I20260709 12:22:03.758690  1697 raft_consensus.cc:2468] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 1.
I20260709 12:22:03.759521  1741 tablet_bootstrap.cc:654] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.762285  1587 leader_election.cc:304] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:03.763602  1760 raft_consensus.cc:2804] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.765318  1760 raft_consensus.cc:697] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:03.766390  1760 consensus_queue.cc:237] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.774354  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:03.775676  1622 raft_consensus.cc:2468] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 0.
I20260709 12:22:03.777117  1662 leader_election.cc:304] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:03.771806  1746 leader_election.cc:290] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:03.778820  1775 raft_consensus.cc:2804] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.778280  1445 catalog_manager.cc:5697] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195). New cstate: current_term: 1 leader_uuid: "3c478c9a878d4bcb9b474e67d7829054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.774451  1443 catalog_manager.cc:5697] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:03.779366  1775 raft_consensus.cc:493] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.781888  1775 raft_consensus.cc:3060] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.778867  1742 tablet_bootstrap.cc:492] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:03.786441  1741 tablet_bootstrap.cc:492] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:03.787192  1741 ts_tablet_manager.cc:1403] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.071s	user 0.023s	sys 0.001s
I20260709 12:22:03.790346  1740 tablet_bootstrap.cc:492] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:03.791301  1740 ts_tablet_manager.cc:1403] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.100s	user 0.028s	sys 0.000s
I20260709 12:22:03.791059  1741 raft_consensus.cc:359] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.791996  1741 raft_consensus.cc:385] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.792348  1741 raft_consensus.cc:740] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.794068  1741 consensus_queue.cc:260] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.796146  1742 tablet_bootstrap.cc:654] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.797067  1741 ts_tablet_manager.cc:1434] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:22:03.797384  1740 raft_consensus.cc:359] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.798599  1740 raft_consensus.cc:385] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.810179  1775 raft_consensus.cc:515] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.812419  1742 tablet_bootstrap.cc:492] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:03.798918  1740 raft_consensus.cc:740] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.813526  1742 ts_tablet_manager.cc:1403] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.008s
I20260709 12:22:03.813977  1740 consensus_queue.cc:260] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.815925  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:03.816952  1622 raft_consensus.cc:3060] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.817754  1740 ts_tablet_manager.cc:1434] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.026s	user 0.011s	sys 0.000s
I20260709 12:22:03.819343  1740 tablet_bootstrap.cc:492] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:03.819733  1742 raft_consensus.cc:359] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.820839  1742 raft_consensus.cc:385] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.821123  1742 raft_consensus.cc:740] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.822048  1742 consensus_queue.cc:260] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.823559  1775 leader_election.cc:290] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:03.827133  1742 ts_tablet_manager.cc:1434] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 12:22:03.828560  1742 tablet_bootstrap.cc:492] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:03.826602  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:03.828444  1442 catalog_manager.cc:5697] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
W20260709 12:22:03.832486  1660 leader_election.cc:343] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.843226  1742 tablet_bootstrap.cc:654] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.846043  1760 raft_consensus.cc:493] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.846447  1740 tablet_bootstrap.cc:654] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.847200  1760 raft_consensus.cc:515] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.853384  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
W20260709 12:22:03.856060  1586 leader_election.cc:343] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.859683  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
W20260709 12:22:03.862816  1587 leader_election.cc:343] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.863626  1587 leader_election.cc:304] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32; no voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:03.864876  1747 raft_consensus.cc:2749] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:03.864878  1760 leader_election.cc:290] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:03.870929  1622 raft_consensus.cc:2468] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 1.
I20260709 12:22:03.888408  1662 leader_election.cc:304] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:03.885964  1443 catalog_manager.cc:5697] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195). New cstate: current_term: 1 leader_uuid: "3c478c9a878d4bcb9b474e67d7829054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.890146  1742 tablet_bootstrap.cc:492] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:03.890441  1775 raft_consensus.cc:2804] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:03.890584  1740 tablet_bootstrap.cc:492] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:03.891176  1742 ts_tablet_manager.cc:1403] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.063s	user 0.029s	sys 0.025s
I20260709 12:22:03.891259  1775 raft_consensus.cc:697] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Leader. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:03.891739  1740 ts_tablet_manager.cc:1403] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.073s	user 0.024s	sys 0.023s
I20260709 12:22:03.892742  1775 consensus_queue.cc:237] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.895499  1742 raft_consensus.cc:359] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.895850  1740 raft_consensus.cc:359] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.896515  1742 raft_consensus.cc:385] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.896822  1740 raft_consensus.cc:385] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.896931  1742 raft_consensus.cc:740] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.897279  1740 raft_consensus.cc:740] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.898025  1742 consensus_queue.cc:260] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.898564  1740 consensus_queue.cc:260] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.901077  1742 ts_tablet_manager.cc:1434] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:22:03.901610  1740 ts_tablet_manager.cc:1434] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:22:03.902307  1742 tablet_bootstrap.cc:492] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:03.902758  1740 tablet_bootstrap.cc:492] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:03.912533  1740 tablet_bootstrap.cc:654] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.913504  1742 tablet_bootstrap.cc:654] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.929414  1742 tablet_bootstrap.cc:492] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:03.929428  1740 tablet_bootstrap.cc:492] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:03.929275  1442 catalog_manager.cc:5697] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195). New cstate: current_term: 1 leader_uuid: "3c478c9a878d4bcb9b474e67d7829054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:03.930416  1742 ts_tablet_manager.cc:1403] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.015s
I20260709 12:22:03.930490  1740 ts_tablet_manager.cc:1403] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.009s
I20260709 12:22:03.934012  1742 raft_consensus.cc:359] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.934377  1740 raft_consensus.cc:359] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.935034  1742 raft_consensus.cc:385] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.935348  1740 raft_consensus.cc:385] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.935410  1742 raft_consensus.cc:740] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.935671  1740 raft_consensus.cc:740] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.936518  1742 consensus_queue.cc:260] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.936777  1740 consensus_queue.cc:260] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.939518  1742 ts_tablet_manager.cc:1434] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:22:03.939512  1740 ts_tablet_manager.cc:1434] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:03.940831  1742 tablet_bootstrap.cc:492] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:03.940941  1740 tablet_bootstrap.cc:492] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:03.950318  1740 tablet_bootstrap.cc:654] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.950851  1742 tablet_bootstrap.cc:654] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.957456  1740 tablet_bootstrap.cc:492] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:03.957914  1775 raft_consensus.cc:493] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:03.958141  1740 ts_tablet_manager.cc:1403] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.008s
I20260709 12:22:03.959137  1742 tablet_bootstrap.cc:492] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:03.958601  1775 raft_consensus.cc:515] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.959801  1742 ts_tablet_manager.cc:1403] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.019s	user 0.018s	sys 0.000s
I20260709 12:22:03.961961  1740 raft_consensus.cc:359] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.962901  1740 raft_consensus.cc:385] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.962806  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:03.963388  1740 raft_consensus.cc:740] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.964351  1740 consensus_queue.cc:260] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
W20260709 12:22:03.965078  1660 leader_election.cc:343] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.965711  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:03.966544  1740 ts_tablet_manager.cc:1434] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:03.966617  1622 raft_consensus.cc:2468] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 0.
I20260709 12:22:03.968420  1775 leader_election.cc:290] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:03.968438  1662 leader_election.cc:304] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:03.969869  1775 raft_consensus.cc:2804] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:03.970335  1775 raft_consensus.cc:493] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:03.970886  1775 raft_consensus.cc:3060] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:03.972342  1742 raft_consensus.cc:359] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.973371  1742 raft_consensus.cc:385] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:03.974119  1742 raft_consensus.cc:740] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:03.975666  1742 consensus_queue.cc:260] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.979326  1742 ts_tablet_manager.cc:1434] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 12:22:03.981266  1742 tablet_bootstrap.cc:492] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:03.984630  1775 raft_consensus.cc:515] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:03.989130  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:03.989475  1742 tablet_bootstrap.cc:654] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:03.989986  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:03.990797  1622 raft_consensus.cc:3060] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:03.990975  1660 leader_election.cc:343] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:03.996739  1742 tablet_bootstrap.cc:492] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:03.997505  1742 ts_tablet_manager.cc:1403] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:22:03.999181  1775 leader_election.cc:290] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:04.000159  1622 raft_consensus.cc:2468] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 1.
I20260709 12:22:04.000627  1742 raft_consensus.cc:359] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.001401  1742 raft_consensus.cc:385] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:04.001523  1662 leader_election.cc:304] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:04.001747  1742 raft_consensus.cc:740] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.002810  1775 raft_consensus.cc:2804] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:04.002839  1742 consensus_queue.cc:260] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.003494  1775 raft_consensus.cc:697] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Leader. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:04.004930  1742 ts_tablet_manager.cc:1434] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:04.007072  1742 tablet_bootstrap.cc:492] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:04.007443  1775 consensus_queue.cc:237] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.015419  1742 tablet_bootstrap.cc:654] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:04.020421  1443 catalog_manager.cc:5697] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195). New cstate: current_term: 1 leader_uuid: "3c478c9a878d4bcb9b474e67d7829054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.022480  1742 tablet_bootstrap.cc:492] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:04.023291  1742 ts_tablet_manager.cc:1403] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 12:22:04.026209  1742 raft_consensus.cc:359] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.026765  1742 raft_consensus.cc:385] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:04.027032  1742 raft_consensus.cc:740] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:04.027699  1742 consensus_queue.cc:260] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.028074  1748 raft_consensus.cc:493] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.029203  1748 raft_consensus.cc:515] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.030442  1742 ts_tablet_manager.cc:1434] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:22:04.032039  1748 leader_election.cc:290] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.033888  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:04.034583  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:04.035086  1697 raft_consensus.cc:2468] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:04.035395  1622 raft_consensus.cc:2468] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:04.036731  1512 leader_election.cc:304] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.037667  1748 raft_consensus.cc:2804] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:04.038110  1748 raft_consensus.cc:493] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.038488  1748 raft_consensus.cc:3060] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.046244  1748 raft_consensus.cc:515] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.048627  1748 leader_election.cc:290] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.049422  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:04.050295  1622 raft_consensus.cc:3060] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.050132  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.051072  1697 raft_consensus.cc:3060] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.057734  1748 raft_consensus.cc:493] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.058712  1748 raft_consensus.cc:515] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.060783  1697 raft_consensus.cc:2468] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:04.061105  1748 leader_election.cc:290] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.060786  1622 raft_consensus.cc:2468] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:04.062882  1512 leader_election.cc:304] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.062939  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8044d53d4cf42ae9c776dfe50786c05" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:04.064064  1623 raft_consensus.cc:2468] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:04.064635  1748 raft_consensus.cc:2804] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:04.065306  1748 raft_consensus.cc:697] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:04.065776  1513 leader_election.cc:304] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.063964  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8044d53d4cf42ae9c776dfe50786c05" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:04.066854  1774 raft_consensus.cc:2804] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:04.066416  1748 consensus_queue.cc:237] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.067193  1697 raft_consensus.cc:2468] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:04.067382  1774 raft_consensus.cc:493] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.067901  1774 raft_consensus.cc:3060] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.073024  1760 raft_consensus.cc:493] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.073786  1760 raft_consensus.cc:515] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.078425  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:04.078969  1774 raft_consensus.cc:515] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.079392  1697 raft_consensus.cc:2468] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 0.
I20260709 12:22:04.079970  1760 leader_election.cc:290] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.079474  1445 catalog_manager.cc:5697] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.080852  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:04.081496  1587 leader_election.cc:304] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 
I20260709 12:22:04.081650  1547 raft_consensus.cc:2468] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 0.
I20260709 12:22:04.082639  1760 raft_consensus.cc:2804] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:04.083113  1760 raft_consensus.cc:493] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:04.083478  1760 raft_consensus.cc:3060] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.083525  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8044d53d4cf42ae9c776dfe50786c05" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:04.083743  1774 leader_election.cc:290] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.084336  1623 raft_consensus.cc:3060] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:04.085777  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:04.087541  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8044d53d4cf42ae9c776dfe50786c05" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.088565  1697 raft_consensus.cc:3060] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.095412  1623 raft_consensus.cc:2468] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:04.096784  1760 raft_consensus.cc:515] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.097334  1513 leader_election.cc:304] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.097911  1697 raft_consensus.cc:2468] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:04.098294  1774 raft_consensus.cc:2804] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:04.099295  1774 raft_consensus.cc:697] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:04.100106  1760 leader_election.cc:290] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.100721  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:04.100344  1774 consensus_queue.cc:237] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.101431  1547 raft_consensus.cc:3060] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.101477  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.102320  1697 raft_consensus.cc:3060] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.111219  1547 raft_consensus.cc:2468] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 1.
I20260709 12:22:04.111297  1445 catalog_manager.cc:5697] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.112938  1586 leader_election.cc:304] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.113945  1697 raft_consensus.cc:2468] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 1.
I20260709 12:22:04.113963  1760 raft_consensus.cc:2804] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:04.114841  1760 raft_consensus.cc:697] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:04.115967  1760 consensus_queue.cc:237] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.126318  1445 catalog_manager.cc:5697] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.135524  1774 raft_consensus.cc:493] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.136413  1774 raft_consensus.cc:515] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.138561  1774 leader_election.cc:290] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.139504  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:04.139734  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:04.140539  1697 raft_consensus.cc:2393] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5568fb1ae11a4139959c130f3683e2f8 in current term 1: Already voted for candidate 1527e8bf876143a8a808d60931fa6b32 in this term.
I20260709 12:22:04.141764  1512 leader_election.cc:304] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5568fb1ae11a4139959c130f3683e2f8; no voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054
I20260709 12:22:04.142503  1774 raft_consensus.cc:3060] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.150290  1774 raft_consensus.cc:2749] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:04.164292  1775 consensus_queue.cc:1048] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.171454  1748 consensus_queue.cc:1048] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.183039  1775 raft_consensus.cc:493] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.183938  1775 raft_consensus.cc:515] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.189494  1775 leader_election.cc:290] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:04.189567  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:04.190955  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:04.193861  1660 leader_election.cc:304] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054; no voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:04.194226  1766 consensus_queue.cc:1048] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.196599  1771 raft_consensus.cc:2749] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:04.200083  1697 raft_consensus.cc:3060] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.203874  1771 consensus_queue.cc:1048] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.210861  1760 consensus_queue.cc:1048] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.236132  1748 raft_consensus.cc:493] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.237118  1748 raft_consensus.cc:515] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.240795  1748 leader_election.cc:290] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.243558  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:04.244928  1622 raft_consensus.cc:2393] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5568fb1ae11a4139959c130f3683e2f8 in current term 1: Already voted for candidate 3c478c9a878d4bcb9b474e67d7829054 in this term.
I20260709 12:22:04.248116  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:04.251109  1512 leader_election.cc:304] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5568fb1ae11a4139959c130f3683e2f8; no voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054
I20260709 12:22:04.252982  1748 raft_consensus.cc:3060] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.260378  1770 consensus_queue.cc:1048] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.273401  1748 raft_consensus.cc:2749] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:04.275067  1747 consensus_queue.cc:1048] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.285096  1805 consensus_queue.cc:1048] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.296695  1770 raft_consensus.cc:493] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:04.297648  1770 raft_consensus.cc:515] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.303661  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:04.305055  1622 raft_consensus.cc:2393] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5568fb1ae11a4139959c130f3683e2f8 in current term 1: Already voted for candidate 3c478c9a878d4bcb9b474e67d7829054 in this term.
I20260709 12:22:04.309412  1770 leader_election.cc:290] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.311105  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:04.313359  1512 leader_election.cc:304] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5568fb1ae11a4139959c130f3683e2f8; no voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054
I20260709 12:22:04.314347  1770 raft_consensus.cc:3060] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:04.334082  1770 raft_consensus.cc:2749] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:04.350636  1697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7"
dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
mode: GRACEFUL
new_leader_uuid: "5568fb1ae11a4139959c130f3683e2f8"
 from {username='slave'} at 127.0.0.1:56322
I20260709 12:22:04.351730  1697 raft_consensus.cc:606] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Received request to transfer leadership to TS 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:04.371809  1623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
mode: GRACEFUL
new_leader_uuid: "5568fb1ae11a4139959c130f3683e2f8"
 from {username='slave'} at 127.0.0.1:46460
I20260709 12:22:04.372572  1623 raft_consensus.cc:606] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Received request to transfer leadership to TS 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:04.380057  1697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "156815799cdb498f9804e65be3824412"
dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
mode: GRACEFUL
new_leader_uuid: "5568fb1ae11a4139959c130f3683e2f8"
 from {username='slave'} at 127.0.0.1:56322
I20260709 12:22:04.380976  1697 raft_consensus.cc:606] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Received request to transfer leadership to TS 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:04.387995  1623 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
mode: GRACEFUL
new_leader_uuid: "5568fb1ae11a4139959c130f3683e2f8"
 from {username='slave'} at 127.0.0.1:46460
I20260709 12:22:04.388842  1623 raft_consensus.cc:606] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Received request to transfer leadership to TS 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:04.395750  1697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617"
dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
mode: GRACEFUL
new_leader_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:56322
I20260709 12:22:04.396374  1697 raft_consensus.cc:606] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Received request to transfer leadership to TS 1527e8bf876143a8a808d60931fa6b32
I20260709 12:22:04.414417  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8044d53d4cf42ae9c776dfe50786c05"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
mode: GRACEFUL
new_leader_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46758
I20260709 12:22:04.415289  1547 raft_consensus.cc:606] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Received request to transfer leadership to TS 1527e8bf876143a8a808d60931fa6b32
I20260709 12:22:04.422295  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
mode: GRACEFUL
new_leader_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46758
I20260709 12:22:04.423024  1547 raft_consensus.cc:606] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Received request to transfer leadership to TS 1527e8bf876143a8a808d60931fa6b32
I20260709 12:22:04.429919  1697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b"
dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
mode: GRACEFUL
new_leader_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:56322
I20260709 12:22:04.430598  1697 raft_consensus.cc:606] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Received request to transfer leadership to TS 1527e8bf876143a8a808d60931fa6b32
I20260709 12:22:04.436432  1775 consensus_queue.cc:1048] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.438925  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
mode: GRACEFUL
new_leader_uuid: "3c478c9a878d4bcb9b474e67d7829054"
 from {username='slave'} at 127.0.0.1:46758
I20260709 12:22:04.439855  1547 raft_consensus.cc:606] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Received request to transfer leadership to TS 3c478c9a878d4bcb9b474e67d7829054
I20260709 12:22:04.447207  1805 raft_consensus.cc:993] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054: : Instructing follower 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:04.447968  1771 raft_consensus.cc:1081] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Signalling peer 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:04.449946  1622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46436
I20260709 12:22:04.452731  1622 raft_consensus.cc:493] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.453224  1622 raft_consensus.cc:3060] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.456547  1746 consensus_queue.cc:1048] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.466275  1622 raft_consensus.cc:515] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.475932  1622 leader_election.cc:290] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.479491  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:04.480350  1547 raft_consensus.cc:3060] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.482990  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "79d8c18f47a24342b5cebc8fd5c60617" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.483901  1697 raft_consensus.cc:3055] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.484297  1697 raft_consensus.cc:740] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:04.485450  1697 consensus_queue.cc:260] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.487092  1697 raft_consensus.cc:3060] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.490972  1547 raft_consensus.cc:2468] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:04.492723  1586 leader_election.cc:304] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.493830  1760 raft_consensus.cc:2804] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.494551  1760 raft_consensus.cc:697] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:04.495833  1760 consensus_queue.cc:237] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.496136  1697 raft_consensus.cc:2468] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:04.504647  1770 consensus_queue.cc:1048] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:04.504498  1445 catalog_manager.cc:5697] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 1 to 2, leader changed from 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195) to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.514672  1774 raft_consensus.cc:993] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8: : Instructing follower 3c478c9a878d4bcb9b474e67d7829054 to start an election
I20260709 12:22:04.515331  1774 raft_consensus.cc:1081] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Signalling peer 3c478c9a878d4bcb9b474e67d7829054 to start an election
I20260709 12:22:04.521665  1697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd"
dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
 from {username='slave'} at 127.0.0.1:56320
I20260709 12:22:04.524071  1697 raft_consensus.cc:493] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.524745  1697 raft_consensus.cc:3060] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.524322  1748 consensus_queue.cc:1048] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.536018  1697 raft_consensus.cc:515] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.539217  1697 leader_election.cc:290] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 2 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:04.539202  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:04.540340  1547 raft_consensus.cc:3055] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.539471  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37bf1701bc504dcaa7c9589b3ec6f8bd" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:04.540673  1547 raft_consensus.cc:740] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:04.541003  1622 raft_consensus.cc:3060] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.541688  1547 consensus_queue.cc:260] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.543181  1547 raft_consensus.cc:3060] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.550465  1622 raft_consensus.cc:2468] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 2.
I20260709 12:22:04.551239  1547 raft_consensus.cc:2468] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 2.
I20260709 12:22:04.552175  1662 leader_election.cc:304] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 
I20260709 12:22:04.553460  1746 raft_consensus.cc:2804] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.554072  1746 raft_consensus.cc:697] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 2 LEADER]: Becoming Leader. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:04.554947  1746 consensus_queue.cc:237] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.562390  1445 catalog_manager.cc:5697] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 reported cstate change: term changed from 1 to 2, leader changed from 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193) to 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195). New cstate: current_term: 2 leader_uuid: "3c478c9a878d4bcb9b474e67d7829054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:04.568861  1805 raft_consensus.cc:993] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054: : Instructing follower 5568fb1ae11a4139959c130f3683e2f8 to start an election
I20260709 12:22:04.569605  1805 raft_consensus.cc:1081] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Signalling peer 5568fb1ae11a4139959c130f3683e2f8 to start an election
I20260709 12:22:04.571748  1547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
 from {username='slave'} at 127.0.0.1:46734
I20260709 12:22:04.572497  1547 raft_consensus.cc:493] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.572937  1547 raft_consensus.cc:3060] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.574630  1760 consensus_queue.cc:1048] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.579375  1805 consensus_queue.cc:1048] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.584843  1547 raft_consensus.cc:515] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:04.595355  1547 leader_election.cc:290] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 2 election: Requested vote from peers 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:04.597611  1747 consensus_queue.cc:1048] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.604581  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.606599  1697 raft_consensus.cc:3055] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.607192  1697 raft_consensus.cc:740] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:04.608665  1697 consensus_queue.cc:260] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:04.611884  1697 raft_consensus.cc:3060] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.607195  1771 consensus_queue.cc:1048] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:22:04.620568  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:04.621416  1622 raft_consensus.cc:3060] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.623845  1748 consensus_queue.cc:1048] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.635315  1697 raft_consensus.cc:2468] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 2.
I20260709 12:22:04.637528  1512 leader_election.cc:304] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.641074  1748 raft_consensus.cc:2804] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.642165  1748 raft_consensus.cc:697] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:04.643400  1748 consensus_queue.cc:237] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:04.645321  1622 raft_consensus.cc:2468] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 2.
I20260709 12:22:04.649288  1771 raft_consensus.cc:993] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054: : Instructing follower 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:04.649972  1746 raft_consensus.cc:1081] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Signalling peer 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:04.652597  1623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46436
I20260709 12:22:04.653702  1623 raft_consensus.cc:493] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.654239  1623 raft_consensus.cc:3060] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.659118  1810 raft_consensus.cc:993] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32: : Instructing follower 5568fb1ae11a4139959c130f3683e2f8 to start an election
I20260709 12:22:04.659853  1810 raft_consensus.cc:1081] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Signalling peer 5568fb1ae11a4139959c130f3683e2f8 to start an election
I20260709 12:22:04.667743  1748 consensus_queue.cc:1048] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:04.673309  1623 raft_consensus.cc:515] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.675024  1547 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
 from {username='slave'} at 127.0.0.1:46742
I20260709 12:22:04.675783  1547 raft_consensus.cc:493] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.676239  1547 raft_consensus.cc:3060] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.682654  1442 catalog_manager.cc:5697] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 1 to 2, leader changed from 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195) to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.683552  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:04.684619  1548 raft_consensus.cc:3060] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.684906  1623 leader_election.cc:290] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.685492  1774 raft_consensus.cc:993] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8: : Instructing follower 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:04.686213  1774 raft_consensus.cc:1081] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Signalling peer 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:04.688714  1623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46450
I20260709 12:22:04.689484  1696 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.690385  1696 raft_consensus.cc:3055] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.690820  1696 raft_consensus.cc:740] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:04.692060  1696 consensus_queue.cc:260] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.693807  1696 raft_consensus.cc:3060] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.695706  1547 raft_consensus.cc:515] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.689494  1623 raft_consensus.cc:493] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.697345  1623 raft_consensus.cc:3060] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.700974  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:04.701856  1621 raft_consensus.cc:3055] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.702250  1621 raft_consensus.cc:740] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:04.703474  1621 consensus_queue.cc:260] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.705000  1621 raft_consensus.cc:3060] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.711103  1696 raft_consensus.cc:2468] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:04.713137  1587 leader_election.cc:304] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 
I20260709 12:22:04.714476  1548 raft_consensus.cc:2468] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:04.714766  1760 raft_consensus.cc:2804] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.715536  1760 raft_consensus.cc:697] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:04.715749  1547 leader_election.cc:290] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 2 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.716590  1760 consensus_queue.cc:237] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.720691  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a5c4887be9b40a789432d640c1e4e8e" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.721246  1748 raft_consensus.cc:993] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8: : Instructing follower 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:04.721691  1697 raft_consensus.cc:3060] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.721922  1748 raft_consensus.cc:1081] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Signalling peer 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:04.724524  1620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8044d53d4cf42ae9c776dfe50786c05"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46450
I20260709 12:22:04.725345  1620 raft_consensus.cc:493] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.725761  1620 raft_consensus.cc:3060] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.725544  1623 raft_consensus.cc:515] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.726256  1621 raft_consensus.cc:2468] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 2.
I20260709 12:22:04.728055  1513 leader_election.cc:304] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.729611  1770 raft_consensus.cc:2804] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.729689  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:04.730248  1770 raft_consensus.cc:697] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:04.730530  1548 raft_consensus.cc:3055] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.731106  1548 raft_consensus.cc:740] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:04.732158  1548 consensus_queue.cc:260] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.731974  1770 consensus_queue.cc:237] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.738765  1548 raft_consensus.cc:3060] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.738962  1623 leader_election.cc:290] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.740625  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "784bc0f917cd483b9b9bba01d1e0fe01" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.741632  1695 raft_consensus.cc:3060] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.743815  1620 raft_consensus.cc:515] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.746912  1620 leader_election.cc:290] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.748059  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8044d53d4cf42ae9c776dfe50786c05" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:04.748610  1694 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8044d53d4cf42ae9c776dfe50786c05" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.748981  1547 raft_consensus.cc:3055] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.749881  1547 raft_consensus.cc:740] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:04.749944  1694 raft_consensus.cc:3060] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.756563  1445 catalog_manager.cc:5697] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 1 to 2, leader changed from 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195) to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.757735  1697 raft_consensus.cc:2468] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 2.
I20260709 12:22:04.750962  1547 consensus_queue.cc:260] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.760740  1694 raft_consensus.cc:2468] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:04.761034  1547 raft_consensus.cc:3060] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.762328  1587 leader_election.cc:304] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 
I20260709 12:22:04.763531  1760 raft_consensus.cc:2804] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.762638  1442 catalog_manager.cc:5697] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 1 to 2, leader changed from 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194) to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.764395  1760 raft_consensus.cc:697] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:04.765511  1760 consensus_queue.cc:237] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.768932  1548 raft_consensus.cc:2468] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:04.770488  1586 leader_election.cc:304] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.772373  1547 raft_consensus.cc:2468] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:04.773650  1695 raft_consensus.cc:2468] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:04.775076  1760 raft_consensus.cc:2804] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.775959  1760 raft_consensus.cc:697] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:04.777170  1760 consensus_queue.cc:237] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.782107  1747 raft_consensus.cc:993] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32: : Instructing follower 5568fb1ae11a4139959c130f3683e2f8 to start an election
I20260709 12:22:04.782809  1810 raft_consensus.cc:1081] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Signalling peer 5568fb1ae11a4139959c130f3683e2f8 to start an election
I20260709 12:22:04.783360  1443 catalog_manager.cc:5697] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 1 to 2, leader changed from 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193) to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.785181  1548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
 from {username='slave'} at 127.0.0.1:46742
I20260709 12:22:04.785905  1548 raft_consensus.cc:493] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.786270  1548 raft_consensus.cc:3060] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.795106  1548 raft_consensus.cc:515] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.798043  1548 leader_election.cc:290] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 2 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.798885  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.800189  1695 raft_consensus.cc:3060] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.801268  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2a48bf4e64e346b49d0ba0c5cc51e493" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:04.802143  1623 raft_consensus.cc:3055] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.802489  1623 raft_consensus.cc:740] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:04.802501  1443 catalog_manager.cc:5697] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 1 to 2, leader changed from 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193) to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.803566  1623 consensus_queue.cc:260] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.806246  1623 raft_consensus.cc:3060] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.809521  1805 raft_consensus.cc:993] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054: : Instructing follower 5568fb1ae11a4139959c130f3683e2f8 to start an election
I20260709 12:22:04.810190  1805 raft_consensus.cc:1081] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Signalling peer 5568fb1ae11a4139959c130f3683e2f8 to start an election
I20260709 12:22:04.811290  1695 raft_consensus.cc:2468] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 2.
I20260709 12:22:04.812487  1548 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "156815799cdb498f9804e65be3824412"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
 from {username='slave'} at 127.0.0.1:46734
I20260709 12:22:04.813001  1512 leader_election.cc:304] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.813269  1548 raft_consensus.cc:493] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:04.813798  1548 raft_consensus.cc:3060] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.814044  1770 raft_consensus.cc:2804] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.814656  1770 raft_consensus.cc:697] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:04.816715  1770 consensus_queue.cc:237] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.820386  1623 raft_consensus.cc:2468] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 2.
I20260709 12:22:04.825443  1548 raft_consensus.cc:515] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.828902  1548 leader_election.cc:290] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 2 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:04.828303  1442 catalog_manager.cc:5697] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 1 to 2, leader changed from 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194) to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.829618  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156815799cdb498f9804e65be3824412" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:04.829644  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "156815799cdb498f9804e65be3824412" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:04.830579  1623 raft_consensus.cc:3060] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.830610  1695 raft_consensus.cc:3055] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:04.831255  1695 raft_consensus.cc:740] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:04.832276  1695 consensus_queue.cc:260] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.833864  1695 raft_consensus.cc:3060] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:04.840706  1623 raft_consensus.cc:2468] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 2.
I20260709 12:22:04.842485  1513 leader_election.cc:304] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:04.843528  1770 raft_consensus.cc:2804] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:04.843668  1695 raft_consensus.cc:2468] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 2.
I20260709 12:22:04.844134  1770 raft_consensus.cc:697] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:04.845237  1770 consensus_queue.cc:237] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:04.853492  1442 catalog_manager.cc:5697] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 1 to 2, leader changed from 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195) to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 2 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:04.917207  1548 raft_consensus.cc:1275] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.919109  1810 consensus_queue.cc:1048] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.929008  1695 raft_consensus.cc:1275] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.930825  1747 consensus_queue.cc:1048] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:04.947791  1548 raft_consensus.cc:1275] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Refusing update from remote peer 3c478c9a878d4bcb9b474e67d7829054: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.949718  1775 consensus_queue.cc:1048] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:04.959741  1623 raft_consensus.cc:1275] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Refusing update from remote peer 3c478c9a878d4bcb9b474e67d7829054: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:04.961426  1805 consensus_queue.cc:1048] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.197198  1548 raft_consensus.cc:1275] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.199172  1747 consensus_queue.cc:1048] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.200393  1623 raft_consensus.cc:1275] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Refusing update from remote peer 5568fb1ae11a4139959c130f3683e2f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.202665  1774 consensus_queue.cc:1048] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.212447  1694 raft_consensus.cc:1275] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.218101  1829 consensus_queue.cc:1048] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.219045  1694 raft_consensus.cc:1275] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 5568fb1ae11a4139959c130f3683e2f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.220908  1695 raft_consensus.cc:1275] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.223971  1760 consensus_queue.cc:1048] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.224570  1774 consensus_queue.cc:1048] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.230911  1623 raft_consensus.cc:1275] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Refusing update from remote peer 5568fb1ae11a4139959c130f3683e2f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.240866  1548 raft_consensus.cc:1275] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.242740  1748 consensus_queue.cc:1048] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.243130  1829 consensus_queue.cc:1048] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.255718  1697 raft_consensus.cc:1275] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 5568fb1ae11a4139959c130f3683e2f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.259238  1770 consensus_queue.cc:1048] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.271024  1548 raft_consensus.cc:1275] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.273229  1829 consensus_queue.cc:1048] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.283443  1697 raft_consensus.cc:1275] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.284140  1623 raft_consensus.cc:1275] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Refusing update from remote peer 5568fb1ae11a4139959c130f3683e2f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.285724  1760 consensus_queue.cc:1048] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.287038  1770 consensus_queue.cc:1048] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:05.293735  1620 raft_consensus.cc:1275] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Refusing update from remote peer 5568fb1ae11a4139959c130f3683e2f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.295929  1748 consensus_queue.cc:1048] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.300208  1695 raft_consensus.cc:1275] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 5568fb1ae11a4139959c130f3683e2f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.303512  1770 consensus_queue.cc:1048] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:05.311795  1695 raft_consensus.cc:1275] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 5568fb1ae11a4139959c130f3683e2f8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:05.313509  1748 consensus_queue.cc:1048] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:07.481973  1442 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60712:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:07.484942  1442 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:07.546401  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 9949df68ba2d42668b0b1b1734002cd4 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:07.547610  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 9949df68ba2d42668b0b1b1734002cd4 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:07.548094  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9949df68ba2d42668b0b1b1734002cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.549175  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9949df68ba2d42668b0b1b1734002cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.548853  1682 tablet_service.cc:1511] Processing CreateTablet for tablet 9949df68ba2d42668b0b1b1734002cd4 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:07.550413  1682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9949df68ba2d42668b0b1b1734002cd4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.551640  1605 tablet_service.cc:1511] Processing CreateTablet for tablet bee253b6be294df98dc9815a7efad53c (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:07.553094  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee253b6be294df98dc9815a7efad53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.558358  1533 tablet_service.cc:1511] Processing CreateTablet for tablet bee253b6be294df98dc9815a7efad53c (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:07.559983  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee253b6be294df98dc9815a7efad53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.570335  1686 tablet_service.cc:1511] Processing CreateTablet for tablet bee253b6be294df98dc9815a7efad53c (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:07.570690  1534 tablet_service.cc:1511] Processing CreateTablet for tablet d7f6f52a977c44ba91e36f8c7096f95c (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:07.571954  1611 tablet_service.cc:1511] Processing CreateTablet for tablet d7f6f52a977c44ba91e36f8c7096f95c (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:07.573470  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f6f52a977c44ba91e36f8c7096f95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.572055  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f6f52a977c44ba91e36f8c7096f95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.572055  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bee253b6be294df98dc9815a7efad53c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.591442  1684 tablet_service.cc:1511] Processing CreateTablet for tablet d7f6f52a977c44ba91e36f8c7096f95c (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:07.593853  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7f6f52a977c44ba91e36f8c7096f95c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.615151  1530 tablet_service.cc:1511] Processing CreateTablet for tablet a58a312e71c04d0c8c2e1e18cf7e3de7 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:07.617789  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58a312e71c04d0c8c2e1e18cf7e3de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.625901  1612 tablet_service.cc:1511] Processing CreateTablet for tablet a58a312e71c04d0c8c2e1e18cf7e3de7 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:07.627765  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58a312e71c04d0c8c2e1e18cf7e3de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.625784  1685 tablet_service.cc:1511] Processing CreateTablet for tablet a58a312e71c04d0c8c2e1e18cf7e3de7 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:07.635072  1843 tablet_bootstrap.cc:492] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:07.644979  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a58a312e71c04d0c8c2e1e18cf7e3de7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.659510  1611 tablet_service.cc:1511] Processing CreateTablet for tablet cc81105eea3e4130a80decf714207e07 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:07.660203  1683 tablet_service.cc:1511] Processing CreateTablet for tablet cc81105eea3e4130a80decf714207e07 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:07.660547  1534 tablet_service.cc:1511] Processing CreateTablet for tablet 5060c543260f4679badf5cd2d0b0fd00 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:07.661370  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc81105eea3e4130a80decf714207e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.661888  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc81105eea3e4130a80decf714207e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.662293  1534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5060c543260f4679badf5cd2d0b0fd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.672066  1843 tablet_bootstrap.cc:654] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.671634  1531 tablet_service.cc:1511] Processing CreateTablet for tablet cc81105eea3e4130a80decf714207e07 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:07.676458  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc81105eea3e4130a80decf714207e07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.672086  1845 tablet_bootstrap.cc:492] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:07.678570  1608 tablet_service.cc:1511] Processing CreateTablet for tablet 5060c543260f4679badf5cd2d0b0fd00 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:07.680369  1608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5060c543260f4679badf5cd2d0b0fd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.686630  1845 tablet_bootstrap.cc:654] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.704983  1846 tablet_bootstrap.cc:492] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:07.703166  1843 tablet_bootstrap.cc:492] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:07.706815  1605 tablet_service.cc:1511] Processing CreateTablet for tablet c775e95073774e258c45b92007777538 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:07.709707  1605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c775e95073774e258c45b92007777538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.703027  1684 tablet_service.cc:1511] Processing CreateTablet for tablet 5060c543260f4679badf5cd2d0b0fd00 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:07.711997  1684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5060c543260f4679badf5cd2d0b0fd00. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.717545  1686 tablet_service.cc:1511] Processing CreateTablet for tablet c775e95073774e258c45b92007777538 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:07.719513  1686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c775e95073774e258c45b92007777538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.727483  1533 tablet_service.cc:1511] Processing CreateTablet for tablet 18397f378d2e4f3292c3f8813e6ce704 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:07.729115  1533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18397f378d2e4f3292c3f8813e6ce704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.730336  1612 tablet_service.cc:1511] Processing CreateTablet for tablet 18397f378d2e4f3292c3f8813e6ce704 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:07.732458  1612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18397f378d2e4f3292c3f8813e6ce704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.727339  1843 ts_tablet_manager.cc:1403] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.093s	user 0.017s	sys 0.000s
I20260709 12:22:07.740370  1843 raft_consensus.cc:359] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:07.712284  1530 tablet_service.cc:1511] Processing CreateTablet for tablet c775e95073774e258c45b92007777538 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:07.763686  1531 tablet_service.cc:1511] Processing CreateTablet for tablet 6188aa46b4ee4f20b27d4676c9d3327f (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:07.764365  1530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c775e95073774e258c45b92007777538. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.765551  1531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6188aa46b4ee4f20b27d4676c9d3327f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.755366  1683 tablet_service.cc:1511] Processing CreateTablet for tablet 18397f378d2e4f3292c3f8813e6ce704 (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:07.765836  1843 raft_consensus.cc:385] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.766270  1843 raft_consensus.cc:740] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.767107  1683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18397f378d2e4f3292c3f8813e6ce704. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.767529  1843 consensus_queue.cc:260] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:07.761807  1846 tablet_bootstrap.cc:654] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.780763  1611 tablet_service.cc:1511] Processing CreateTablet for tablet 6188aa46b4ee4f20b27d4676c9d3327f (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:07.770867  1843 ts_tablet_manager.cc:1434] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.035s	user 0.000s	sys 0.006s
I20260709 12:22:07.782954  1611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6188aa46b4ee4f20b27d4676c9d3327f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.787021  1685 tablet_service.cc:1511] Processing CreateTablet for tablet 6188aa46b4ee4f20b27d4676c9d3327f (DEFAULT_TABLE table=soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:07.798767  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6188aa46b4ee4f20b27d4676c9d3327f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:07.805866  1843 tablet_bootstrap.cc:492] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:07.840147  1846 tablet_bootstrap.cc:492] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:07.841223  1846 ts_tablet_manager.cc:1403] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.137s	user 0.013s	sys 0.014s
W20260709 12:22:07.841946  1429 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.22.93.193:45459, user_credentials={real_user=slave}} blocked reactor thread for 45184us
I20260709 12:22:07.855983  1845 tablet_bootstrap.cc:492] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:07.856822  1845 ts_tablet_manager.cc:1403] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.185s	user 0.000s	sys 0.035s
I20260709 12:22:07.862741  1845 raft_consensus.cc:359] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:07.863773  1845 raft_consensus.cc:385] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.864246  1845 raft_consensus.cc:740] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.865439  1845 consensus_queue.cc:260] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:07.866431  1846 raft_consensus.cc:359] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:07.867514  1846 raft_consensus.cc:385] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.867894  1846 raft_consensus.cc:740] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.868498  1845 ts_tablet_manager.cc:1434] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:22:07.868870  1846 consensus_queue.cc:260] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:07.869910  1845 tablet_bootstrap.cc:492] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:07.871903  1846 ts_tablet_manager.cc:1434] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:22:07.873292  1846 tablet_bootstrap.cc:492] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:07.878312  1843 tablet_bootstrap.cc:654] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.890260  1846 tablet_bootstrap.cc:654] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.908077  1845 tablet_bootstrap.cc:654] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.915535  1805 raft_consensus.cc:493] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.916392  1805 raft_consensus.cc:515] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:07.926122  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f6f52a977c44ba91e36f8c7096f95c" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:07.926522  1843 tablet_bootstrap.cc:492] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:07.927241  1843 ts_tablet_manager.cc:1403] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.122s	user 0.016s	sys 0.017s
W20260709 12:22:07.930172  1660 leader_election.cc:343] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.932911  1843 raft_consensus.cc:359] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:07.934474  1843 raft_consensus.cc:385] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:07.935191  1843 raft_consensus.cc:740] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:07.936451  1843 consensus_queue.cc:260] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:07.937738  1805 leader_election.cc:290] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:07.944023  1843 ts_tablet_manager.cc:1434] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 12:22:07.946472  1843 tablet_bootstrap.cc:492] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:07.949481  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f6f52a977c44ba91e36f8c7096f95c" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
W20260709 12:22:07.952056  1662 leader_election.cc:343] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:07.953053  1662 leader_election.cc:304] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054; no voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:07.961128  1846 tablet_bootstrap.cc:492] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:07.962216  1846 ts_tablet_manager.cc:1403] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.089s	user 0.016s	sys 0.032s
I20260709 12:22:07.963209  1805 raft_consensus.cc:2749] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:07.965301  1770 raft_consensus.cc:493] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:07.966161  1770 raft_consensus.cc:515] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
W20260709 12:22:07.976397  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:45459, user_credentials={real_user=slave}} blocked reactor thread for 81661.4us
I20260709 12:22:07.979833  1843 tablet_bootstrap.cc:654] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:07.984473  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9949df68ba2d42668b0b1b1734002cd4" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:07.978641  1770 leader_election.cc:290] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:07.990782  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9949df68ba2d42668b0b1b1734002cd4" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:07.994288  1620 raft_consensus.cc:2468] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:07.997450  1513 leader_election.cc:304] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
W20260709 12:22:07.999708  1512 leader_election.cc:343] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:08.001606  1770 raft_consensus.cc:2804] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.002213  1770 raft_consensus.cc:493] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.002580  1770 raft_consensus.cc:3060] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.010579  1846 raft_consensus.cc:359] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.012360  1845 tablet_bootstrap.cc:492] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:08.015313  1846 raft_consensus.cc:385] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.013391  1770 raft_consensus.cc:515] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.015726  1846 raft_consensus.cc:740] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.016927  1846 consensus_queue.cc:260] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.017959  1770 leader_election.cc:290] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.015748  1845 ts_tablet_manager.cc:1403] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.146s	user 0.039s	sys 0.038s
I20260709 12:22:08.019440  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9949df68ba2d42668b0b1b1734002cd4" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:08.021396  1697 raft_consensus.cc:3060] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.019433  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9949df68ba2d42668b0b1b1734002cd4" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:08.023437  1620 raft_consensus.cc:3060] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.024490  1845 raft_consensus.cc:359] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.025352  1845 raft_consensus.cc:385] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.025637  1845 raft_consensus.cc:740] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.028445  1846 ts_tablet_manager.cc:1434] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.066s	user 0.005s	sys 0.009s
I20260709 12:22:08.029794  1846 tablet_bootstrap.cc:492] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:08.031678  1620 raft_consensus.cc:2468] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.031448  1845 consensus_queue.cc:260] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.033411  1513 leader_election.cc:304] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.034538  1770 raft_consensus.cc:2804] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.035089  1770 raft_consensus.cc:697] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:08.036056  1770 consensus_queue.cc:237] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.038295  1846 tablet_bootstrap.cc:654] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.039723  1845 ts_tablet_manager.cc:1434] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.003s
I20260709 12:22:08.048574  1845 tablet_bootstrap.cc:492] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:08.048218  1697 raft_consensus.cc:2468] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.061278  1845 tablet_bootstrap.cc:654] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.071136  1445 catalog_manager.cc:5697] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.063297  1843 tablet_bootstrap.cc:492] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:08.074708  1843 ts_tablet_manager.cc:1403] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.010s
I20260709 12:22:08.073833  1846 tablet_bootstrap.cc:492] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:08.079659  1846 ts_tablet_manager.cc:1403] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.017s
I20260709 12:22:08.081732  1843 raft_consensus.cc:359] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.082813  1843 raft_consensus.cc:385] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.083187  1843 raft_consensus.cc:740] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.084319  1843 consensus_queue.cc:260] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.085347  1845 tablet_bootstrap.cc:492] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:08.086519  1845 ts_tablet_manager.cc:1403] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.011s
I20260709 12:22:08.085906  1846 raft_consensus.cc:359] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.087230  1846 raft_consensus.cc:385] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.087654  1846 raft_consensus.cc:740] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.088052  1843 ts_tablet_manager.cc:1434] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:22:08.089291  1846 consensus_queue.cc:260] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.091360  1845 raft_consensus.cc:359] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.091938  1843 tablet_bootstrap.cc:492] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:08.092427  1845 raft_consensus.cc:385] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.092657  1846 ts_tablet_manager.cc:1434] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.006s
I20260709 12:22:08.092782  1845 raft_consensus.cc:740] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.094332  1846 tablet_bootstrap.cc:492] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:08.093961  1845 consensus_queue.cc:260] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.097069  1845 ts_tablet_manager.cc:1434] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:22:08.098727  1845 tablet_bootstrap.cc:492] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:08.106242  1843 tablet_bootstrap.cc:654] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.109709  1770 raft_consensus.cc:493] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.106242  1846 tablet_bootstrap.cc:654] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.110476  1770 raft_consensus.cc:515] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.113569  1845 tablet_bootstrap.cc:654] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.116720  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee253b6be294df98dc9815a7efad53c" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:08.117475  1620 raft_consensus.cc:2468] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.118964  1513 leader_election.cc:304] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.122941  1770 leader_election.cc:290] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.123608  1770 raft_consensus.cc:2804] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.124107  1770 raft_consensus.cc:493] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.124523  1770 raft_consensus.cc:3060] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:08.132239  1494 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:08.140225  1867 raft_consensus.cc:493] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.141072  1867 raft_consensus.cc:515] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.149591  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee253b6be294df98dc9815a7efad53c" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:08.150585  1697 raft_consensus.cc:2468] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.154296  1867 leader_election.cc:290] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.156080  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f6f52a977c44ba91e36f8c7096f95c" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:08.157001  1697 raft_consensus.cc:2468] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.157476  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f6f52a977c44ba91e36f8c7096f95c" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:08.158427  1620 raft_consensus.cc:2468] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.160674  1513 leader_election.cc:304] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.163486  1844 raft_consensus.cc:2804] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.162633  1846 tablet_bootstrap.cc:492] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:08.164109  1844 raft_consensus.cc:493] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.163489  1770 raft_consensus.cc:515] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.164920  1846 ts_tablet_manager.cc:1403] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.025s
I20260709 12:22:08.164917  1844 raft_consensus.cc:3060] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.166405  1843 tablet_bootstrap.cc:492] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:08.167073  1843 ts_tablet_manager.cc:1403] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.078s	user 0.025s	sys 0.012s
I20260709 12:22:08.167632  1770 leader_election.cc:290] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.169837  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee253b6be294df98dc9815a7efad53c" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:08.170661  1620 raft_consensus.cc:3060] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.171188  1843 raft_consensus.cc:359] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.172061  1843 raft_consensus.cc:385] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.172380  1843 raft_consensus.cc:740] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.173312  1846 raft_consensus.cc:359] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.173599  1843 consensus_queue.cc:260] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.174444  1846 raft_consensus.cc:385] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.175457  1846 raft_consensus.cc:740] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.176771  1843 ts_tablet_manager.cc:1434] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:22:08.176411  1846 consensus_queue.cc:260] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.184828  1844 raft_consensus.cc:515] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.185501  1846 ts_tablet_manager.cc:1434] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.004s
I20260709 12:22:08.186422  1620 raft_consensus.cc:2468] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.186806  1846 tablet_bootstrap.cc:492] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:08.178037  1843 tablet_bootstrap.cc:492] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:08.181003  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bee253b6be294df98dc9815a7efad53c" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:08.181735  1845 tablet_bootstrap.cc:492] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:08.187695  1697 raft_consensus.cc:3060] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.187968  1845 ts_tablet_manager.cc:1403] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.090s	user 0.030s	sys 0.032s
I20260709 12:22:08.188627  1513 leader_election.cc:304] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.189754  1867 raft_consensus.cc:2804] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.190624  1867 raft_consensus.cc:697] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:08.191665  1867 consensus_queue.cc:237] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.192226  1845 raft_consensus.cc:359] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.193077  1845 raft_consensus.cc:385] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.193377  1845 raft_consensus.cc:740] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.194360  1845 consensus_queue.cc:260] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.196388  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f6f52a977c44ba91e36f8c7096f95c" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:08.197125  1620 raft_consensus.cc:3060] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.197314  1697 raft_consensus.cc:2468] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.197820  1845 ts_tablet_manager.cc:1434] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:22:08.203282  1845 tablet_bootstrap.cc:492] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:08.203339  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7f6f52a977c44ba91e36f8c7096f95c" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:08.204288  1697 raft_consensus.cc:3060] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.208906  1843 tablet_bootstrap.cc:654] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.216387  1846 tablet_bootstrap.cc:654] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.217254  1844 leader_election.cc:290] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.221038  1845 tablet_bootstrap.cc:654] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.247928  1620 raft_consensus.cc:2468] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.250347  1513 leader_election.cc:304] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.251688  1867 raft_consensus.cc:2804] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.252861  1867 raft_consensus.cc:697] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:08.254266  1867 consensus_queue.cc:237] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.262409  1697 raft_consensus.cc:2468] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.262364  1444 catalog_manager.cc:5697] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.276093  1845 tablet_bootstrap.cc:492] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:08.276958  1845 ts_tablet_manager.cc:1403] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.078s	user 0.013s	sys 0.008s
I20260709 12:22:08.280874  1846 tablet_bootstrap.cc:492] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:08.281756  1846 ts_tablet_manager.cc:1403] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.095s	user 0.007s	sys 0.032s
I20260709 12:22:08.283560  1845 raft_consensus.cc:359] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.284893  1845 raft_consensus.cc:385] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.284868  1846 raft_consensus.cc:359] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.286044  1845 raft_consensus.cc:740] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.286355  1846 raft_consensus.cc:385] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.286749  1846 raft_consensus.cc:740] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.286954  1845 consensus_queue.cc:260] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.287731  1846 consensus_queue.cc:260] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.288947  1843 tablet_bootstrap.cc:492] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:08.289577  1843 ts_tablet_manager.cc:1403] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.112s	user 0.036s	sys 0.042s
I20260709 12:22:08.292744  1845 ts_tablet_manager.cc:1434] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.015s	user 0.009s	sys 0.002s
I20260709 12:22:08.294183  1845 tablet_bootstrap.cc:492] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:08.294739  1445 catalog_manager.cc:5697] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.300796  1843 raft_consensus.cc:359] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.301868  1843 raft_consensus.cc:385] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.302196  1843 raft_consensus.cc:740] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.302631  1845 tablet_bootstrap.cc:654] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.303093  1843 consensus_queue.cc:260] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.305302  1846 ts_tablet_manager.cc:1434] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.003s
I20260709 12:22:08.306130  1843 ts_tablet_manager.cc:1434] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:22:08.307565  1843 tablet_bootstrap.cc:492] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:08.316232  1843 tablet_bootstrap.cc:654] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.319515  1853 raft_consensus.cc:493] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.320237  1853 raft_consensus.cc:515] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.322971  1853 leader_election.cc:290] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.324331  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc81105eea3e4130a80decf714207e07" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:08.324894  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc81105eea3e4130a80decf714207e07" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:08.325219  1697 raft_consensus.cc:2468] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 0.
I20260709 12:22:08.325663  1548 raft_consensus.cc:2468] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 0.
I20260709 12:22:08.326010  1845 tablet_bootstrap.cc:492] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:08.326634  1845 ts_tablet_manager.cc:1403] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.004s
I20260709 12:22:08.327090  1587 leader_election.cc:304] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 
I20260709 12:22:08.328164  1853 raft_consensus.cc:2804] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.328562  1853 raft_consensus.cc:493] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.328876  1853 raft_consensus.cc:3060] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.329794  1843 tablet_bootstrap.cc:492] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:08.330507  1843 ts_tablet_manager.cc:1403] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.002s
I20260709 12:22:08.330796  1845 raft_consensus.cc:359] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.332321  1845 raft_consensus.cc:385] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.332610  1845 raft_consensus.cc:740] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.324357  1846 tablet_bootstrap.cc:492] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:08.333973  1845 consensus_queue.cc:260] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.337018  1845 ts_tablet_manager.cc:1434] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:22:08.338501  1845 tablet_bootstrap.cc:492] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:08.341403  1843 raft_consensus.cc:359] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.342382  1843 raft_consensus.cc:385] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.342729  1843 raft_consensus.cc:740] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.342851  1853 raft_consensus.cc:515] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.343811  1843 consensus_queue.cc:260] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.346616  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc81105eea3e4130a80decf714207e07" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:08.349474  1843 ts_tablet_manager.cc:1434] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:22:08.349570  1548 raft_consensus.cc:3060] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.349946  1845 tablet_bootstrap.cc:654] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.351089  1843 tablet_bootstrap.cc:492] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:08.360289  1846 tablet_bootstrap.cc:654] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.361912  1843 tablet_bootstrap.cc:654] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.363986  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc81105eea3e4130a80decf714207e07" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:08.364800  1697 raft_consensus.cc:3060] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.371083  1845 tablet_bootstrap.cc:492] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:08.371838  1845 ts_tablet_manager.cc:1403] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.006s
I20260709 12:22:08.374517  1853 leader_election.cc:290] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.375896  1697 raft_consensus.cc:2468] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 1.
I20260709 12:22:08.376204  1845 raft_consensus.cc:359] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.377208  1845 raft_consensus.cc:385] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.377565  1845 raft_consensus.cc:740] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.377540  1587 leader_election.cc:304] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 
I20260709 12:22:08.379102  1853 raft_consensus.cc:2804] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.378969  1845 consensus_queue.cc:260] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.381232  1853 raft_consensus.cc:697] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:08.382076  1845 ts_tablet_manager.cc:1434] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:22:08.382419  1853 consensus_queue.cc:237] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.383581  1845 tablet_bootstrap.cc:492] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:08.386881  1548 raft_consensus.cc:2468] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 1.
I20260709 12:22:08.391527  1843 tablet_bootstrap.cc:492] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:08.391573  1846 tablet_bootstrap.cc:492] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:08.392575  1843 ts_tablet_manager.cc:1403] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.028s
I20260709 12:22:08.392616  1846 ts_tablet_manager.cc:1403] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.069s	user 0.019s	sys 0.021s
I20260709 12:22:08.394709  1845 tablet_bootstrap.cc:654] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.397504  1846 raft_consensus.cc:359] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.398505  1846 raft_consensus.cc:385] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.398931  1846 raft_consensus.cc:740] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.399609  1843 raft_consensus.cc:359] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.400802  1843 raft_consensus.cc:385] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.400250  1846 consensus_queue.cc:260] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.401309  1843 raft_consensus.cc:740] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.402889  1843 consensus_queue.cc:260] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.406134  1843 ts_tablet_manager.cc:1434] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:22:08.407421  1843 tablet_bootstrap.cc:492] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:08.420029  1843 tablet_bootstrap.cc:654] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.422675  1443 catalog_manager.cc:5697] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 1 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.422976  1846 ts_tablet_manager.cc:1434] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.000s
I20260709 12:22:08.428963  1846 tablet_bootstrap.cc:492] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:08.437717  1846 tablet_bootstrap.cc:654] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.437848  1845 tablet_bootstrap.cc:492] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:08.438619  1845 ts_tablet_manager.cc:1403] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.055s	user 0.021s	sys 0.019s
I20260709 12:22:08.442392  1845 raft_consensus.cc:359] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.442891  1843 tablet_bootstrap.cc:492] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:08.443235  1845 raft_consensus.cc:385] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.443569  1845 raft_consensus.cc:740] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.443729  1843 ts_tablet_manager.cc:1403] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.037s	user 0.021s	sys 0.000s
I20260709 12:22:08.449395  1843 raft_consensus.cc:359] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.449630  1845 consensus_queue.cc:260] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.450301  1843 raft_consensus.cc:385] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.450770  1843 raft_consensus.cc:740] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.451598  1843 consensus_queue.cc:260] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.452533  1845 ts_tablet_manager.cc:1434] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.003s
I20260709 12:22:08.454006  1845 tablet_bootstrap.cc:492] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32: Bootstrap starting.
I20260709 12:22:08.455585  1843 ts_tablet_manager.cc:1434] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:22:08.457007  1843 tablet_bootstrap.cc:492] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8: Bootstrap starting.
I20260709 12:22:08.461293  1845 tablet_bootstrap.cc:654] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.464085  1843 tablet_bootstrap.cc:654] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.465762  1846 tablet_bootstrap.cc:492] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:08.466542  1846 ts_tablet_manager.cc:1403] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.008s
I20260709 12:22:08.470306  1846 raft_consensus.cc:359] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.471165  1846 raft_consensus.cc:385] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.471645  1846 raft_consensus.cc:740] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.472980  1846 consensus_queue.cc:260] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.475055  1846 ts_tablet_manager.cc:1434] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.008s	user 0.011s	sys 0.000s
I20260709 12:22:08.477432  1843 tablet_bootstrap.cc:492] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8: No bootstrap required, opened a new log
I20260709 12:22:08.478397  1843 ts_tablet_manager.cc:1403] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:22:08.482630  1843 raft_consensus.cc:359] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.484491  1843 raft_consensus.cc:385] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.484882  1843 raft_consensus.cc:740] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.485737  1843 consensus_queue.cc:260] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.487819  1846 tablet_bootstrap.cc:492] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:08.487897  1843 ts_tablet_manager.cc:1434] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:22:08.494541  1845 tablet_bootstrap.cc:492] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32: No bootstrap required, opened a new log
I20260709 12:22:08.495352  1845 ts_tablet_manager.cc:1403] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.005s
I20260709 12:22:08.496132  1846 tablet_bootstrap.cc:654] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.499266  1845 raft_consensus.cc:359] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.500133  1845 raft_consensus.cc:385] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.500443  1845 raft_consensus.cc:740] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.501427  1845 consensus_queue.cc:260] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.503973  1845 ts_tablet_manager.cc:1434] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:08.505756  1846 tablet_bootstrap.cc:492] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:08.506443  1846 ts_tablet_manager.cc:1403] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.002s
I20260709 12:22:08.509665  1846 raft_consensus.cc:359] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.510371  1846 raft_consensus.cc:385] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.510669  1846 raft_consensus.cc:740] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.511247  1867 consensus_queue.cc:1048] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:08.511493  1846 consensus_queue.cc:260] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.514130  1846 ts_tablet_manager.cc:1434] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:22:08.515237  1846 tablet_bootstrap.cc:492] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054: Bootstrap starting.
I20260709 12:22:08.522567  1846 tablet_bootstrap.cc:654] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:08.537761  1846 tablet_bootstrap.cc:492] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054: No bootstrap required, opened a new log
I20260709 12:22:08.537847  1805 raft_consensus.cc:493] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.538714  1846 ts_tablet_manager.cc:1403] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 12:22:08.538666  1805 raft_consensus.cc:515] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.542613  1846 raft_consensus.cc:359] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.543458  1846 raft_consensus.cc:385] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:08.543754  1846 raft_consensus.cc:740] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Initialized, Role: FOLLOWER
I20260709 12:22:08.543999  1844 raft_consensus.cc:493] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.543805  1805 leader_election.cc:290] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:08.544970  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58a312e71c04d0c8c2e1e18cf7e3de7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:08.544952  1844 raft_consensus.cc:515] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.546049  1620 raft_consensus.cc:2468] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 0.
I20260709 12:22:08.544296  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58a312e71c04d0c8c2e1e18cf7e3de7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:08.547111  1548 raft_consensus.cc:2468] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 0.
I20260709 12:22:08.544979  1846 consensus_queue.cc:260] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.547588  1844 leader_election.cc:290] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.548621  1844 consensus_queue.cc:1048] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:08.549700  1846 ts_tablet_manager.cc:1434] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:08.549034  1660 leader_election.cc:304] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.556126  1855 raft_consensus.cc:2804] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.556669  1855 raft_consensus.cc:493] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.557067  1855 raft_consensus.cc:3060] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.557896  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58a312e71c04d0c8c2e1e18cf7e3de7" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:08.555913  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58a312e71c04d0c8c2e1e18cf7e3de7" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:08.558781  1620 raft_consensus.cc:2468] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.560196  1513 leader_election.cc:304] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.561221  1844 raft_consensus.cc:2804] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.561617  1844 raft_consensus.cc:493] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.561966  1844 raft_consensus.cc:3060] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.564633  1864 raft_consensus.cc:493] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.565269  1864 raft_consensus.cc:515] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.568720  1855 raft_consensus.cc:515] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.569517  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6188aa46b4ee4f20b27d4676c9d3327f" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:08.570057  1697 raft_consensus.cc:2393] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5568fb1ae11a4139959c130f3683e2f8 in current term 1: Already voted for candidate 3c478c9a878d4bcb9b474e67d7829054 in this term.
I20260709 12:22:08.570351  1695 raft_consensus.cc:2468] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.573800  1864 leader_election.cc:290] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.574265  1512 leader_election.cc:304] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.575451  1867 raft_consensus.cc:2804] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.575987  1867 raft_consensus.cc:493] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.576346  1867 raft_consensus.cc:3060] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.577251  1844 raft_consensus.cc:515] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.579967  1844 leader_election.cc:290] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.574790  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6188aa46b4ee4f20b27d4676c9d3327f" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:08.581256  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58a312e71c04d0c8c2e1e18cf7e3de7" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:08.581605  1623 raft_consensus.cc:2468] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.582283  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58a312e71c04d0c8c2e1e18cf7e3de7" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:08.583113  1620 raft_consensus.cc:3060] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.579530  1864 consensus_queue.cc:1048] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:22:08.582314  1695 raft_consensus.cc:2393] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5568fb1ae11a4139959c130f3683e2f8 in current term 1: Already voted for candidate 3c478c9a878d4bcb9b474e67d7829054 in this term.
I20260709 12:22:08.587904  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58a312e71c04d0c8c2e1e18cf7e3de7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:08.588804  1548 raft_consensus.cc:2393] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3c478c9a878d4bcb9b474e67d7829054 in current term 1: Already voted for candidate 5568fb1ae11a4139959c130f3683e2f8 in this term.
I20260709 12:22:08.587119  1855 leader_election.cc:290] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:08.592475  1844 raft_consensus.cc:493] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.592453  1867 raft_consensus.cc:515] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.593343  1844 raft_consensus.cc:515] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.587898  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a58a312e71c04d0c8c2e1e18cf7e3de7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:08.595532  1867 leader_election.cc:290] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.596434  1662 leader_election.cc:304] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054; no voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8
I20260709 12:22:08.597167  1844 leader_election.cc:290] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.597903  1855 raft_consensus.cc:2749] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:08.597976  1622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5060c543260f4679badf5cd2d0b0fd00" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:08.597182  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6188aa46b4ee4f20b27d4676c9d3327f" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:08.598588  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5060c543260f4679badf5cd2d0b0fd00" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:08.599104  1622 raft_consensus.cc:2468] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.599200  1695 raft_consensus.cc:3060] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.599398  1697 raft_consensus.cc:2468] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.600649  1513 leader_election.cc:304] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.602075  1844 raft_consensus.cc:2804] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.602504  1844 raft_consensus.cc:493] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.602885  1844 raft_consensus.cc:3060] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.604606  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6188aa46b4ee4f20b27d4676c9d3327f" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:08.605314  1623 raft_consensus.cc:3060] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.610253  1695 raft_consensus.cc:2468] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.611845  1512 leader_election.cc:304] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.612890  1867 raft_consensus.cc:2804] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.613467  1867 raft_consensus.cc:697] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:08.614693  1867 consensus_queue.cc:237] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.616487  1844 raft_consensus.cc:515] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.618469  1623 raft_consensus.cc:2468] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.622284  1844 leader_election.cc:290] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.624773  1620 raft_consensus.cc:2468] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.623349  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5060c543260f4679badf5cd2d0b0fd00" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:08.623720  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5060c543260f4679badf5cd2d0b0fd00" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:08.647413  1695 raft_consensus.cc:3060] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.649662  1513 leader_election.cc:304] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 3c478c9a878d4bcb9b474e67d7829054
I20260709 12:22:08.647956  1623 raft_consensus.cc:3060] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.650903  1844 raft_consensus.cc:2804] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.651700  1844 raft_consensus.cc:697] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:08.650791  1864 consensus_queue.cc:1048] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:08.652845  1844 consensus_queue.cc:237] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.666311  1442 catalog_manager.cc:5697] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.669486  1623 raft_consensus.cc:2468] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.675487  1513 leader_election.cc:304] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.675585  1855 raft_consensus.cc:493] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.677852  1770 consensus_queue.cc:1048] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:08.676999  1855 raft_consensus.cc:515] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.677012  1867 raft_consensus.cc:2804] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.681810  1867 raft_consensus.cc:697] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:08.683055  1855 leader_election.cc:290] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:08.685920  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18397f378d2e4f3292c3f8813e6ce704" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8" is_pre_election: true
I20260709 12:22:08.686043  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18397f378d2e4f3292c3f8813e6ce704" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:08.686717  1548 raft_consensus.cc:2468] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 0.
I20260709 12:22:08.687074  1623 raft_consensus.cc:2468] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 0.
I20260709 12:22:08.683900  1867 consensus_queue.cc:237] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.685165  1695 raft_consensus.cc:2468] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.690145  1894 raft_consensus.cc:493] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:08.690088  1660 leader_election.cc:304] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.691025  1894 raft_consensus.cc:515] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.692235  1855 raft_consensus.cc:2804] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.692713  1855 raft_consensus.cc:493] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.693127  1855 raft_consensus.cc:3060] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.693818  1894 leader_election.cc:290] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.696727  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c775e95073774e258c45b92007777538" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32" is_pre_election: true
I20260709 12:22:08.697486  1623 raft_consensus.cc:2468] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.698757  1513 leader_election.cc:304] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.699819  1770 raft_consensus.cc:2804] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:08.700235  1770 raft_consensus.cc:493] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:08.700651  1770 raft_consensus.cc:3060] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.704386  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c775e95073774e258c45b92007777538" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054" is_pre_election: true
I20260709 12:22:08.705277  1695 raft_consensus.cc:2468] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 0.
I20260709 12:22:08.711210  1443 catalog_manager.cc:5697] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.712664  1855 raft_consensus.cc:515] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.716018  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18397f378d2e4f3292c3f8813e6ce704" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:08.716665  1548 raft_consensus.cc:3060] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.728233  1893 consensus_queue.cc:1048] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:08.730544  1770 raft_consensus.cc:515] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.733067  1855 leader_election.cc:290] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:08.733340  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18397f378d2e4f3292c3f8813e6ce704" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:08.734370  1620 raft_consensus.cc:3060] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.733628  1548 raft_consensus.cc:2468] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 1.
I20260709 12:22:08.746145  1660 leader_election.cc:304] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.748365  1855 raft_consensus.cc:2804] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.749888  1855 raft_consensus.cc:697] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Leader. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:08.752668  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c775e95073774e258c45b92007777538" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:08.752471  1855 consensus_queue.cc:237] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.753654  1621 raft_consensus.cc:3060] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.757411  1443 catalog_manager.cc:5697] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.755580  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c775e95073774e258c45b92007777538" candidate_uuid: "5568fb1ae11a4139959c130f3683e2f8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:08.757040  1620 raft_consensus.cc:2468] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 1.
I20260709 12:22:08.760578  1697 raft_consensus.cc:3060] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:08.757814  1770 leader_election.cc:290] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Requested vote from peers 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:08.769085  1697 raft_consensus.cc:2468] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.773216  1512 leader_election.cc:304] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:08.774593  1770 raft_consensus.cc:2804] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:08.775254  1770 raft_consensus.cc:697] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Leader. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:08.776227  1770 consensus_queue.cc:237] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:08.783043  1444 catalog_manager.cc:5697] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195). New cstate: current_term: 1 leader_uuid: "3c478c9a878d4bcb9b474e67d7829054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:08.796274  1443 catalog_manager.cc:5697] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193). New cstate: current_term: 1 leader_uuid: "5568fb1ae11a4139959c130f3683e2f8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:08.799927  1621 raft_consensus.cc:2468] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5568fb1ae11a4139959c130f3683e2f8 in term 1.
I20260709 12:22:08.844821  1853 consensus_queue.cc:1048] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:08.857564  1904 consensus_queue.cc:1048] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.090966  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5060c543260f4679badf5cd2d0b0fd00"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
mode: GRACEFUL
new_leader_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46758
I20260709 12:22:09.091686  1867 consensus_queue.cc:1048] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.092411  1547 raft_consensus.cc:606] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Received request to transfer leadership to TS 1527e8bf876143a8a808d60931fa6b32
I20260709 12:22:09.100057  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c775e95073774e258c45b92007777538"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
mode: GRACEFUL
new_leader_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46758
I20260709 12:22:09.100837  1547 raft_consensus.cc:606] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Received request to transfer leadership to TS 1527e8bf876143a8a808d60931fa6b32
I20260709 12:22:09.109568  1697 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "18397f378d2e4f3292c3f8813e6ce704"
dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
mode: GRACEFUL
new_leader_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:56322
I20260709 12:22:09.110458  1697 raft_consensus.cc:606] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Received request to transfer leadership to TS 1527e8bf876143a8a808d60931fa6b32
I20260709 12:22:09.112546  1844 consensus_queue.cc:1048] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.121948  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6188aa46b4ee4f20b27d4676c9d3327f"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
mode: GRACEFUL
new_leader_uuid: "3c478c9a878d4bcb9b474e67d7829054"
 from {username='slave'} at 127.0.0.1:46758
I20260709 12:22:09.122881  1547 raft_consensus.cc:606] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Received request to transfer leadership to TS 3c478c9a878d4bcb9b474e67d7829054
I20260709 12:22:09.142304  1844 consensus_queue.cc:1048] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.154207  1844 raft_consensus.cc:993] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8: : Instructing follower 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:09.155084  1867 raft_consensus.cc:1081] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Signalling peer 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:09.163350  1620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5060c543260f4679badf5cd2d0b0fd00"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46450
I20260709 12:22:09.164238  1620 raft_consensus.cc:493] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:09.164772  1620 raft_consensus.cc:3060] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.164837  1894 consensus_queue.cc:1048] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.168294  1867 consensus_queue.cc:1048] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.182646  1620 raft_consensus.cc:515] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.195442  1620 leader_election.cc:290] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:09.197132  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5060c543260f4679badf5cd2d0b0fd00" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:09.198418  1547 raft_consensus.cc:3055] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:09.198863  1547 raft_consensus.cc:740] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:09.204298  1547 consensus_queue.cc:260] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.205957  1547 raft_consensus.cc:3060] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.206943  1855 consensus_queue.cc:1048] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.207643  1867 consensus_queue.cc:1048] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.207882  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5060c543260f4679badf5cd2d0b0fd00" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:09.208593  1697 raft_consensus.cc:3060] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.232556  1805 consensus_queue.cc:1048] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.265054  1855 raft_consensus.cc:993] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054: : Instructing follower 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:09.265642  1855 raft_consensus.cc:1081] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Signalling peer 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:09.268143  1697 raft_consensus.cc:2468] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:09.269690  1620 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "18397f378d2e4f3292c3f8813e6ce704"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46436
I20260709 12:22:09.270450  1620 raft_consensus.cc:493] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:09.270910  1620 raft_consensus.cc:3060] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.272541  1547 raft_consensus.cc:2468] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:09.275303  1586 leader_election.cc:304] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:09.276557  1904 raft_consensus.cc:2804] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:09.278285  1904 raft_consensus.cc:697] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:09.280889  1904 consensus_queue.cc:237] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.282846  1867 consensus_queue.cc:1048] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.286298  1620 raft_consensus.cc:515] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.296440  1867 raft_consensus.cc:993] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8: : Instructing follower 3c478c9a878d4bcb9b474e67d7829054 to start an election
I20260709 12:22:09.297140  1867 raft_consensus.cc:1081] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Signalling peer 3c478c9a878d4bcb9b474e67d7829054 to start an election
I20260709 12:22:09.299721  1696 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6188aa46b4ee4f20b27d4676c9d3327f"
dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
 from {username='slave'} at 127.0.0.1:56320
I20260709 12:22:09.300480  1696 raft_consensus.cc:493] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:09.301129  1696 raft_consensus.cc:3060] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.311029  1770 consensus_queue.cc:1048] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:09.319357  1623 raft_consensus.cc:1240] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Rejecting Update request from peer 3c478c9a878d4bcb9b474e67d7829054 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:09.319748  1620 leader_election.cc:290] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:09.319834  1696 raft_consensus.cc:515] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.322907  1695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18397f378d2e4f3292c3f8813e6ce704" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:09.323696  1695 raft_consensus.cc:3055] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:09.323844  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6188aa46b4ee4f20b27d4676c9d3327f" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:09.324708  1548 raft_consensus.cc:3055] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:09.325066  1548 raft_consensus.cc:740] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:09.325428  1547 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18397f378d2e4f3292c3f8813e6ce704" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:09.322923  1696 leader_election.cc:290] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 2 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:09.326087  1547 raft_consensus.cc:3060] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.326360  1443 catalog_manager.cc:5697] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 1 to 2, leader changed from 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193) to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.331396  1855 consensus_queue.cc:1059] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:09.325992  1548 consensus_queue.cc:260] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.333988  1548 raft_consensus.cc:3060] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.337908  1547 raft_consensus.cc:2468] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:09.338264  1867 raft_consensus.cc:993] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8: : Instructing follower 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:09.339133  1867 raft_consensus.cc:1081] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Signalling peer 1527e8bf876143a8a808d60931fa6b32 to start an election
I20260709 12:22:09.339591  1623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6188aa46b4ee4f20b27d4676c9d3327f" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:09.339748  1586 leader_election.cc:304] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:09.340764  1623 raft_consensus.cc:3060] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.324121  1695 raft_consensus.cc:740] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:09.341722  1904 raft_consensus.cc:2804] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:09.351151  1904 raft_consensus.cc:697] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:09.351302  1623 raft_consensus.cc:2468] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 2.
I20260709 12:22:09.348626  1548 raft_consensus.cc:2468] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 2.
I20260709 12:22:09.352417  1904 consensus_queue.cc:237] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.342815  1621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c775e95073774e258c45b92007777538"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
 from {username='slave'} at 127.0.0.1:46450
I20260709 12:22:09.355114  1662 leader_election.cc:304] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 
I20260709 12:22:09.355770  1621 raft_consensus.cc:493] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:09.356261  1621 raft_consensus.cc:3060] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.356670  1855 raft_consensus.cc:2804] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:09.366664  1621 raft_consensus.cc:515] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.351281  1695 consensus_queue.cc:260] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.369944  1621 leader_election.cc:290] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195:39321)
I20260709 12:22:09.371107  1695 raft_consensus.cc:3060] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.374941  1855 raft_consensus.cc:697] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 2 LEADER]: Becoming Leader. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:09.375115  1548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c775e95073774e258c45b92007777538" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:09.375115  1697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c775e95073774e258c45b92007777538" candidate_uuid: "1527e8bf876143a8a808d60931fa6b32" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
I20260709 12:22:09.377171  1697 raft_consensus.cc:3060] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.376498  1548 raft_consensus.cc:3055] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:09.379592  1548 raft_consensus.cc:740] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:09.376559  1855 consensus_queue.cc:237] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.381618  1548 consensus_queue.cc:260] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:09.384459  1548 raft_consensus.cc:3060] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:09.386838  1697 raft_consensus.cc:2468] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:09.388322  1587 leader_election.cc:304] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1527e8bf876143a8a808d60931fa6b32, 3c478c9a878d4bcb9b474e67d7829054; no voters: 
I20260709 12:22:09.386029  1695 raft_consensus.cc:2468] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:09.389640  1443 catalog_manager.cc:5697] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 1 to 2, leader changed from 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195) to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.391150  1904 raft_consensus.cc:2804] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:09.391747  1904 raft_consensus.cc:697] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Becoming Leader. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:09.392761  1904 consensus_queue.cc:237] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
W20260709 12:22:09.394202  1805 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:22:09.395365  1548 raft_consensus.cc:2468] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1527e8bf876143a8a808d60931fa6b32 in term 2.
I20260709 12:22:09.402642  1442 catalog_manager.cc:5697] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 reported cstate change: term changed from 1 to 2, leader changed from 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193) to 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195). New cstate: current_term: 2 leader_uuid: "3c478c9a878d4bcb9b474e67d7829054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:09.409749  1443 catalog_manager.cc:5697] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 reported cstate change: term changed from 1 to 2, leader changed from 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193) to 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194). New cstate: current_term: 2 leader_uuid: "1527e8bf876143a8a808d60931fa6b32" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:09.670315  1697 raft_consensus.cc:1275] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:09.672099  1853 consensus_queue.cc:1048] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:09.681639  1548 raft_consensus.cc:1275] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:09.683763  1810 consensus_queue.cc:1048] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:09.800100  1695 raft_consensus.cc:1275] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:09.801088  1548 raft_consensus.cc:1275] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:09.801779  1853 consensus_queue.cc:1048] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:09.802747  1810 consensus_queue.cc:1048] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:09.811113  1547 raft_consensus.cc:1275] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:09.815569  1853 consensus_queue.cc:1048] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:09.845366  1695 raft_consensus.cc:1275] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Refusing update from remote peer 1527e8bf876143a8a808d60931fa6b32: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:09.849439  1904 consensus_queue.cc:1048] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:09.932330  1621 raft_consensus.cc:1275] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Refusing update from remote peer 3c478c9a878d4bcb9b474e67d7829054: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:09.933976  1805 consensus_queue.cc:1048] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:09.944871  1547 raft_consensus.cc:1275] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Refusing update from remote peer 3c478c9a878d4bcb9b474e67d7829054: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:09.948061  1805 consensus_queue.cc:1048] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:12.127378  1443 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:22:12.152842  1443 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60712:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:22:12.187502 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:22:12.314330  1947 log.cc:927] Time spent T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:22:12.382457  1967 tablet.cc:1724] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.473562  1971 tablet.cc:1724] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.547398  1547 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7"
dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
mode: GRACEFUL
new_leader_uuid: "3c478c9a878d4bcb9b474e67d7829054"
 from {username='slave'} at 127.0.0.1:56894
I20260709 12:22:12.548713  1547 raft_consensus.cc:606] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Received request to transfer leadership to TS 3c478c9a878d4bcb9b474e67d7829054
W20260709 12:22:12.547334  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:45459, user_credentials={real_user=slave}} blocked reactor thread for 116788us
I20260709 12:22:12.540402  1978 tablet.cc:1724] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:12.642869  1586 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.22.93.193:45459, user_credentials={real_user=slave}} blocked reactor thread for 49804.5us
I20260709 12:22:12.653645  1993 tablet.cc:1724] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:12.663760  1983 log.cc:927] Time spent T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32: Append to log took a long time: real 0.119s	user 0.003s	sys 0.000s
W20260709 12:22:12.664070  1975 log.cc:927] Time spent T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8: Append to log took a long time: real 0.238s	user 0.000s	sys 0.006s
W20260709 12:22:12.664851  1979 log.cc:927] Time spent T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32: Append to log took a long time: real 0.121s	user 0.002s	sys 0.000s
I20260709 12:22:12.661041  1988 tablet.cc:1724] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.663075  1992 tablet.cc:1724] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.707243  1967 tablet.cc:1724] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.733503  1989 tablet.cc:1724] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:22:12.752000  1991 log.cc:927] Time spent T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:22:12.761346  1999 tablet.cc:1724] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.786962  1997 tablet.cc:1724] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.801380  1992 tablet.cc:1724] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.809482  1971 tablet.cc:1724] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.815272  1973 raft_consensus.cc:993] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8: : Instructing follower 3c478c9a878d4bcb9b474e67d7829054 to start an election
I20260709 12:22:12.815806  1973 raft_consensus.cc:1081] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Signalling peer 3c478c9a878d4bcb9b474e67d7829054 to start an election
I20260709 12:22:12.819804  1697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7"
dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
 from {username='slave'} at 127.0.0.1:56320
I20260709 12:22:12.820379  1697 raft_consensus.cc:493] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:12.820837  1697 raft_consensus.cc:3060] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.832015  1978 tablet.cc:1724] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.813846  1620 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b"
dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
mode: GRACEFUL
new_leader_uuid: "3c478c9a878d4bcb9b474e67d7829054"
 from {username='slave'} at 127.0.0.1:39882
I20260709 12:22:12.837534  1620 raft_consensus.cc:606] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Received request to transfer leadership to TS 3c478c9a878d4bcb9b474e67d7829054
I20260709 12:22:12.839818 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:12.839572  1988 tablet.cc:1724] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.840677 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:12.840193  1967 tablet.cc:1724] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.830036  1993 tablet.cc:1724] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.835922  1998 tablet.cc:1724] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.810886  2005 tablet.cc:1724] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.845454  1989 tablet.cc:1724] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.863619  1989 tablet.cc:1724] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.866282  1442 catalog_manager.cc:5789] TS 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459) does not have the latest schema for tablet d7f6f52a977c44ba91e36f8c7096f95c (table soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]). Expected version 1 got 0
I20260709 12:22:12.867509  1442 catalog_manager.cc:5789] TS 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459) does not have the latest schema for tablet 9949df68ba2d42668b0b1b1734002cd4 (table soft_deleted_table [id=52219d7884fb4874a53865535dbb6496]). Expected version 1 got 0
I20260709 12:22:12.878763  1697 raft_consensus.cc:515] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:12.892474  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:12.893447  1543 raft_consensus.cc:3055] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:12.893899  1543 raft_consensus.cc:740] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5568fb1ae11a4139959c130f3683e2f8, State: Running, Role: LEADER
I20260709 12:22:12.895287  1543 consensus_queue.cc:260] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:12.896489  1543 raft_consensus.cc:3060] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.906910  1543 raft_consensus.cc:2468] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 3.
I20260709 12:22:12.909665  1660 leader_election.cc:304] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:12.909170  1993 tablet.cc:1724] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.911171  1972 raft_consensus.cc:2804] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:12.911746  1972 raft_consensus.cc:697] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 3 LEADER]: Becoming Leader. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:12.912774  1972 consensus_queue.cc:237] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } }
I20260709 12:22:12.917124  1971 tablet.cc:1724] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.919549  2003 tablet.cc:1724] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.919607  1989 tablet.cc:1724] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.927019  1988 tablet.cc:1724] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.931146  1967 tablet.cc:1724] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.934883  1697 leader_election.cc:290] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 3 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:12.936342  1620 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9eb6d4ebc7c94d63be65317be1ba14a7" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:12.937181  1620 raft_consensus.cc:3060] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:12.922191  1999 tablet.cc:1724] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:22:12.987525  1620 raft_consensus.cc:2468] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 3.
I20260709 12:22:12.993611  1443 catalog_manager.cc:5697] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 reported cstate change: term changed from 2 to 3, leader changed from 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193) to 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195). New cstate: current_term: 3 leader_uuid: "3c478c9a878d4bcb9b474e67d7829054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:13.003813  1442 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033: soft_deleted_table [id=52219d7884fb4874a53865535dbb6496] alter complete (version 1)
I20260709 12:22:13.338960  2004 raft_consensus.cc:993] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32: : Instructing follower 3c478c9a878d4bcb9b474e67d7829054 to start an election
I20260709 12:22:13.339562  1853 raft_consensus.cc:1081] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Signalling peer 3c478c9a878d4bcb9b474e67d7829054 to start an election
I20260709 12:22:13.341348  1697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b"
dest_uuid: "3c478c9a878d4bcb9b474e67d7829054"
 from {username='slave'} at 127.0.0.1:56308
I20260709 12:22:13.342545  1697 raft_consensus.cc:493] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:13.343618  1697 raft_consensus.cc:3060] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.351015  1697 raft_consensus.cc:515] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:13.352926  1697 leader_election.cc:290] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 3 election: Requested vote from peers 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459), 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981)
I20260709 12:22:13.353751  1543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5568fb1ae11a4139959c130f3683e2f8"
I20260709 12:22:13.354094  1621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8518e0449b143fbbf58f6c7ab7a0a5b" candidate_uuid: "3c478c9a878d4bcb9b474e67d7829054" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1527e8bf876143a8a808d60931fa6b32"
I20260709 12:22:13.354549  1543 raft_consensus.cc:3060] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.354777  1621 raft_consensus.cc:3055] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:13.355180  1621 raft_consensus.cc:740] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1527e8bf876143a8a808d60931fa6b32, State: Running, Role: LEADER
I20260709 12:22:13.355909  1621 consensus_queue.cc:260] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:13.356997  1621 raft_consensus.cc:3060] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:13.360971  1543 raft_consensus.cc:2468] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 3.
I20260709 12:22:13.362447  1660 leader_election.cc:304] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c478c9a878d4bcb9b474e67d7829054, 5568fb1ae11a4139959c130f3683e2f8; no voters: 
I20260709 12:22:13.363478  1972 raft_consensus.cc:2804] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:13.363624  1621 raft_consensus.cc:2468] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c478c9a878d4bcb9b474e67d7829054 in term 3.
I20260709 12:22:13.363986  1972 raft_consensus.cc:697] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 3 LEADER]: Becoming Leader. State: Replica: 3c478c9a878d4bcb9b474e67d7829054, State: Running, Role: LEADER
I20260709 12:22:13.365124  1972 consensus_queue.cc:237] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } }
I20260709 12:22:13.374130  1442 catalog_manager.cc:5697] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 reported cstate change: term changed from 2 to 3, leader changed from 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194) to 3c478c9a878d4bcb9b474e67d7829054 (127.22.93.195). New cstate: current_term: 3 leader_uuid: "3c478c9a878d4bcb9b474e67d7829054" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c478c9a878d4bcb9b474e67d7829054" member_type: VOTER last_known_addr { host: "127.22.93.195" port: 39321 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:13.510654  1543 raft_consensus.cc:1275] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 3 FOLLOWER]: Refusing update from remote peer 3c478c9a878d4bcb9b474e67d7829054: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:13.512441  1972 consensus_queue.cc:1048] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:13.527597  1621 raft_consensus.cc:1275] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 3 FOLLOWER]: Refusing update from remote peer 3c478c9a878d4bcb9b474e67d7829054: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:13.529309  1972 consensus_queue.cc:1048] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:13.842185 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:13.850448 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:13.851162 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:13.901032  1621 raft_consensus.cc:1275] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 3 FOLLOWER]: Refusing update from remote peer 3c478c9a878d4bcb9b474e67d7829054: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:13.902722  1972 consensus_queue.cc:1048] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1527e8bf876143a8a808d60931fa6b32" member_type: VOTER last_known_addr { host: "127.22.93.194" port: 34981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:13.913843  1543 raft_consensus.cc:1275] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 3 FOLLOWER]: Refusing update from remote peer 3c478c9a878d4bcb9b474e67d7829054: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:13.916409  2018 consensus_queue.cc:1048] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5568fb1ae11a4139959c130f3683e2f8" member_type: VOTER last_known_addr { host: "127.22.93.193" port: 45459 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:14.852713 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:14.860301 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:14.860945 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:15.862376 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:15.868327 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:15.868892 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:16.870220 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:16.875964 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:16.876395 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:17.877781 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:17.884063 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:17.884692 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:18.886036 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:18.892838 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:18.893426 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:19.895093 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:19.902127 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:19.902769 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:20.904103 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:20.910339 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:20.910940 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:21.912297 22903 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:21.918917 22903 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:21.919543 22903 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:22.990471 22903 tablet_server.cc:179] TabletServer@127.22.93.193:0 shutting down...
W20260709 12:22:23.020468  1586 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 16 similar messages]
W20260709 12:22:23.028302  1586 consensus_peers.cc:597] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:23.029574  1586 consensus_peers.cc:597] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:23.062400  1586 consensus_peers.cc:597] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:23.069617 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:23.070751 22903 tablet_replica.cc:333] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.071849 22903 raft_consensus.cc:2243] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.072765 22903 raft_consensus.cc:2272] T c775e95073774e258c45b92007777538 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.076571 22903 tablet_replica.cc:333] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.077451 22903 raft_consensus.cc:2243] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.078233 22903 raft_consensus.cc:2272] T 18397f378d2e4f3292c3f8813e6ce704 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.081534 22903 tablet_replica.cc:333] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.082309 22903 raft_consensus.cc:2243] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.083031 22903 raft_consensus.cc:2272] T cc81105eea3e4130a80decf714207e07 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.086189 22903 tablet_replica.cc:333] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.086913 22903 raft_consensus.cc:2243] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.088150 22903 raft_consensus.cc:2272] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.092028 22903 tablet_replica.cc:333] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.092806 22903 raft_consensus.cc:2243] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.093961 22903 raft_consensus.cc:2272] T bee253b6be294df98dc9815a7efad53c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.097133 22903 tablet_replica.cc:333] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.097916 22903 raft_consensus.cc:2243] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.098583 22903 raft_consensus.cc:2272] T 6188aa46b4ee4f20b27d4676c9d3327f P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.101616 22903 tablet_replica.cc:333] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.102339 22903 raft_consensus.cc:2243] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.103545 22903 raft_consensus.cc:2272] T d7f6f52a977c44ba91e36f8c7096f95c P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.107601 22903 tablet_replica.cc:333] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.108570 22903 raft_consensus.cc:2243] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.109719 22903 raft_consensus.cc:2272] T 9949df68ba2d42668b0b1b1734002cd4 P 5568fb1ae11a4139959c130f3683e2f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.112920 22903 tablet_replica.cc:333] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.113659 22903 raft_consensus.cc:2243] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.114817 22903 raft_consensus.cc:2272] T 9a5c4887be9b40a789432d640c1e4e8e P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.118184 22903 tablet_replica.cc:333] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.118906 22903 raft_consensus.cc:2243] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.119699 22903 raft_consensus.cc:2272] T 79d8c18f47a24342b5cebc8fd5c60617 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.122854 22903 tablet_replica.cc:333] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.123633 22903 raft_consensus.cc:2243] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.124289 22903 raft_consensus.cc:2272] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.128001 22903 tablet_replica.cc:333] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.128748 22903 raft_consensus.cc:2243] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.129815 22903 raft_consensus.cc:2272] T 5060c543260f4679badf5cd2d0b0fd00 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.133301 22903 tablet_replica.cc:333] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.134014 22903 raft_consensus.cc:2243] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.134667 22903 raft_consensus.cc:2272] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 5568fb1ae11a4139959c130f3683e2f8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:23.138244  1660 consensus_peers.cc:597] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:23.138517 22903 tablet_replica.cc:333] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.139465 22903 raft_consensus.cc:2243] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.140062 22903 raft_consensus.cc:2272] T e8518e0449b143fbbf58f6c7ab7a0a5b P 5568fb1ae11a4139959c130f3683e2f8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.143800 22903 tablet_replica.cc:333] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.144908 22903 raft_consensus.cc:2243] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.146807 22903 raft_consensus.cc:2272] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.151484 22903 tablet_replica.cc:333] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.152475 22903 raft_consensus.cc:2243] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.154078 22903 raft_consensus.cc:2272] T 156815799cdb498f9804e65be3824412 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.158397 22903 tablet_replica.cc:333] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.159363 22903 raft_consensus.cc:2243] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.160250 22903 raft_consensus.cc:2272] T f8044d53d4cf42ae9c776dfe50786c05 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.164911 22903 tablet_replica.cc:333] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8: stopping tablet replica
I20260709 12:22:23.165795 22903 raft_consensus.cc:2243] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.166615 22903 raft_consensus.cc:2272] T 784bc0f917cd483b9b9bba01d1e0fe01 P 5568fb1ae11a4139959c130f3683e2f8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:23.230089  1586 consensus_peers.cc:597] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:23.230759  1586 consensus_peers.cc:597] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:23.233623 22903 tablet_server.cc:196] TabletServer@127.22.93.193:0 shutdown complete.
W20260709 12:22:23.284839  1586 consensus_peers.cc:597] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:22:23.285684  1586 consensus_peers.cc:597] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:23.305824 22903 tablet_server.cc:179] TabletServer@127.22.93.194:0 shutting down...
W20260709 12:22:23.327144  1660 consensus_peers.cc:597] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:23.357832 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:23.358906 22903 tablet_replica.cc:333] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.359946 22903 raft_consensus.cc:2243] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.361263 22903 raft_consensus.cc:2272] T c775e95073774e258c45b92007777538 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.364574 22903 tablet_replica.cc:333] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.365347 22903 raft_consensus.cc:2243] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.366569 22903 raft_consensus.cc:2272] T 18397f378d2e4f3292c3f8813e6ce704 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.369609 22903 tablet_replica.cc:333] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.370304 22903 raft_consensus.cc:2243] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.371590 22903 raft_consensus.cc:2272] T cc81105eea3e4130a80decf714207e07 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.374588 22903 tablet_replica.cc:333] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.375666 22903 raft_consensus.cc:2243] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.376492 22903 raft_consensus.cc:2272] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.380534 22903 tablet_replica.cc:333] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.381336 22903 raft_consensus.cc:2243] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.381966 22903 raft_consensus.cc:2272] T 6188aa46b4ee4f20b27d4676c9d3327f P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.384979 22903 tablet_replica.cc:333] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.385795 22903 raft_consensus.cc:2243] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.386391 22903 raft_consensus.cc:2272] T d7f6f52a977c44ba91e36f8c7096f95c P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.389216 22903 tablet_replica.cc:333] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.389918 22903 raft_consensus.cc:2243] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.390619 22903 raft_consensus.cc:2272] T bee253b6be294df98dc9815a7efad53c P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.393468 22903 tablet_replica.cc:333] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.394151 22903 raft_consensus.cc:2243] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.394778 22903 raft_consensus.cc:2272] T 9949df68ba2d42668b0b1b1734002cd4 P 1527e8bf876143a8a808d60931fa6b32 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.397652 22903 tablet_replica.cc:333] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.398622 22903 raft_consensus.cc:2243] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.399395 22903 raft_consensus.cc:2272] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:23.402197  1660 consensus_peers.cc:597] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:23.403303 22903 tablet_replica.cc:333] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.404076 22903 raft_consensus.cc:2243] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.405154 22903 raft_consensus.cc:2272] T 79d8c18f47a24342b5cebc8fd5c60617 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.408123 22903 tablet_replica.cc:333] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.408793 22903 raft_consensus.cc:2243] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.409340 22903 raft_consensus.cc:2272] T 9a5c4887be9b40a789432d640c1e4e8e P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.412145 22903 tablet_replica.cc:333] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.412802 22903 raft_consensus.cc:2243] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.413908 22903 raft_consensus.cc:2272] T f8044d53d4cf42ae9c776dfe50786c05 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.416560 22903 tablet_replica.cc:333] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.417138 22903 raft_consensus.cc:2243] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.418260 22903 raft_consensus.cc:2272] T 5060c543260f4679badf5cd2d0b0fd00 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.421036 22903 tablet_replica.cc:333] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.421636 22903 raft_consensus.cc:2243] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.422093 22903 raft_consensus.cc:2272] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 1527e8bf876143a8a808d60931fa6b32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.424926 22903 tablet_replica.cc:333] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.425547 22903 raft_consensus.cc:2243] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.426052 22903 raft_consensus.cc:2272] T e8518e0449b143fbbf58f6c7ab7a0a5b P 1527e8bf876143a8a808d60931fa6b32 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.428854 22903 tablet_replica.cc:333] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.429688 22903 raft_consensus.cc:2243] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.430286 22903 raft_consensus.cc:2272] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.433166 22903 tablet_replica.cc:333] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.433784 22903 raft_consensus.cc:2243] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.434348 22903 raft_consensus.cc:2272] T 156815799cdb498f9804e65be3824412 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.437013 22903 tablet_replica.cc:333] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32: stopping tablet replica
I20260709 12:22:23.437552 22903 raft_consensus.cc:2243] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.438637 22903 raft_consensus.cc:2272] T 784bc0f917cd483b9b9bba01d1e0fe01 P 1527e8bf876143a8a808d60931fa6b32 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:23.470953  1660 consensus_peers.cc:597] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 -> Peer 5568fb1ae11a4139959c130f3683e2f8 (127.22.93.193:45459): Couldn't send request to peer 5568fb1ae11a4139959c130f3683e2f8. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.193:45459: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:23.494438 22903 tablet_server.cc:196] TabletServer@127.22.93.194:0 shutdown complete.
I20260709 12:22:23.556241 22903 tablet_server.cc:179] TabletServer@127.22.93.195:0 shutting down...
I20260709 12:22:23.596009 22903 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:23.597144 22903 tablet_replica.cc:333] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.598220 22903 raft_consensus.cc:2243] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.598971 22903 raft_consensus.cc:2272] T 18397f378d2e4f3292c3f8813e6ce704 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.602344 22903 tablet_replica.cc:333] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.603075 22903 raft_consensus.cc:2243] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.603622 22903 raft_consensus.cc:2272] T c775e95073774e258c45b92007777538 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.606228 22903 tablet_replica.cc:333] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.606854 22903 raft_consensus.cc:2243] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.607501 22903 raft_consensus.cc:2272] T cc81105eea3e4130a80decf714207e07 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.610109 22903 tablet_replica.cc:333] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.610785 22903 raft_consensus.cc:2243] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.611487 22903 raft_consensus.cc:2272] T a58a312e71c04d0c8c2e1e18cf7e3de7 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.614378 22903 tablet_replica.cc:333] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.615090 22903 raft_consensus.cc:2243] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.615653 22903 raft_consensus.cc:2272] T bee253b6be294df98dc9815a7efad53c P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.618628 22903 tablet_replica.cc:333] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.619395 22903 raft_consensus.cc:2243] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.619896 22903 raft_consensus.cc:2272] T 9949df68ba2d42668b0b1b1734002cd4 P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.622686 22903 tablet_replica.cc:333] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.623402 22903 raft_consensus.cc:2243] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.624449 22903 raft_consensus.cc:2272] T 6188aa46b4ee4f20b27d4676c9d3327f P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.627676 22903 tablet_replica.cc:333] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.628338 22903 raft_consensus.cc:2243] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.629081 22903 raft_consensus.cc:2272] T d7f6f52a977c44ba91e36f8c7096f95c P 3c478c9a878d4bcb9b474e67d7829054 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:23.631297  1662 consensus_peers.cc:597] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 -> Peer 1527e8bf876143a8a808d60931fa6b32 (127.22.93.194:34981): Couldn't send request to peer 1527e8bf876143a8a808d60931fa6b32. Status: Network error: Client connection negotiation failed: client connection to 127.22.93.194:34981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:23.632409 22903 tablet_replica.cc:333] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.633199 22903 raft_consensus.cc:2243] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.633746 22903 raft_consensus.cc:2272] T 784bc0f917cd483b9b9bba01d1e0fe01 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.636677 22903 tablet_replica.cc:333] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.637343 22903 raft_consensus.cc:2243] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.638510 22903 raft_consensus.cc:2272] T 37bf1701bc504dcaa7c9589b3ec6f8bd P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.641526 22903 tablet_replica.cc:333] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.642143 22903 raft_consensus.cc:2243] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.642740 22903 raft_consensus.cc:2272] T 156815799cdb498f9804e65be3824412 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.645702 22903 tablet_replica.cc:333] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.646281 22903 raft_consensus.cc:2243] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.646798 22903 raft_consensus.cc:2272] T 2a48bf4e64e346b49d0ba0c5cc51e493 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.649673 22903 tablet_replica.cc:333] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.650283 22903 raft_consensus.cc:2243] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.650820 22903 raft_consensus.cc:2272] T 9a5c4887be9b40a789432d640c1e4e8e P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.654052 22903 tablet_replica.cc:333] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.654681 22903 raft_consensus.cc:2243] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.655330 22903 raft_consensus.cc:2272] T 79d8c18f47a24342b5cebc8fd5c60617 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.658110 22903 tablet_replica.cc:333] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.658679 22903 raft_consensus.cc:2243] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.659332 22903 raft_consensus.cc:2272] T 5060c543260f4679badf5cd2d0b0fd00 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.661787 22903 tablet_replica.cc:333] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.662375 22903 raft_consensus.cc:2243] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.663477 22903 raft_consensus.cc:2272] T 9eb6d4ebc7c94d63be65317be1ba14a7 P 3c478c9a878d4bcb9b474e67d7829054 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.666215 22903 tablet_replica.cc:333] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.666798 22903 raft_consensus.cc:2243] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.667850 22903 raft_consensus.cc:2272] T e8518e0449b143fbbf58f6c7ab7a0a5b P 3c478c9a878d4bcb9b474e67d7829054 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.670521 22903 tablet_replica.cc:333] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054: stopping tablet replica
I20260709 12:22:23.671133 22903 raft_consensus.cc:2243] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:23.671675 22903 raft_consensus.cc:2272] T f8044d53d4cf42ae9c776dfe50786c05 P 3c478c9a878d4bcb9b474e67d7829054 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.724887 22903 tablet_server.cc:196] TabletServer@127.22.93.195:0 shutdown complete.
I20260709 12:22:23.777025 22903 master.cc:562] Master@127.22.93.254:38767 shutting down...
I20260709 12:22:23.813581 22903 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:23.814584 22903 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:23.815157 22903 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5a249e17a17b4cfda2609f19a24ab033: stopping tablet replica
I20260709 12:22:23.837224 22903 master.cc:584] Master@127.22.93.254:38767 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (22017 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (47880 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (394887 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:22:23.912711 22903 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2249 messages since previous log ~37 seconds ago
I20260709 12:22:23.913017 22903 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2248 messages since previous log ~37 seconds ago
I20260709 12:22:23.913209 22903 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2243 messages since previous log ~37 seconds ago
I20260709 12:22:23.913491 22903 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~58 seconds ago
I20260709 12:22:23.913714 22903 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~58 seconds ago
I20260709 12:22:23.914093 22903 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 4 messages since previous log ~257 seconds ago
I20260709 12:22:23.914319 22903 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 4 messages since previous log ~257 seconds ago
I20260709 12:22:23.914644 22903 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 12 messages since previous log ~0 seconds ago
I20260709 12:22:23.915038 22903 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
